Practical diagnostic sampling for large scale monitoring