1-1 Appendix 1 Responses to survey questions administered to ...

INLAND ADMINISTRATION--QUESTION 2
RESPONSES: 15
What is the greatest strength/weakness in standardized assessment procedures?
• Strength: Consistent, long-term data sets that show valuable “trends” on
numerous fisheries across the entire state – these have also served us well
politically because all significant lakes are sampled on a regular basis.
• The obvious strength is that data collected in the same manner (to the extent
possible) are more likely to be directly comparable.
• Greatest strength – the goal of consistent data collection to allow comparison of
trends over time.
• Strength – Consistency in data which allows pooling, time series analyses, etc.
• Strength – Ability to accumulate comparable data that will lead to a better
• understanding of ecosystem relationships.
• Flexibility to address new questions
• Anytime you can develop standard, consistent ways of collecting and analyzing
data that demonstrate sound science, you are better off. That being said, the
agency must be willing to constantly revise and revisit those procedures to make
sure they conform to the most up to date and sound methodologies available. The
typical pattern at most agencies is that receptiveness to change occurs with a
turnover in staff (e.g., new people, new ideas). A regular pattern of science
review, internally and externally, should be a goal.
• Greatest strength – data is consistently collected and analyzed the same over time
and across water bodies.
• Standard procedures are based on “best information available” and are continually
updated as needed. Procedures are repeatable and therefore suitable for acquiring
trend data and are generally adequate for identifying major problems.
• Strength-Randomized sampling.
• Strength – Standardized sampling eliminates sampling bias.
• Weakness-Adequate funding/manpower.
• The research upon which the program is based has not been formally published,
therefore, it has not received appropriate external evaluation. Sample sizes are
small and confidence intervals are large. Cannot afford to increase sample sizes
because of staff/time limitations.
• Weakness: minimum amounts of sampling are usually not enough to “statistically
validate” our conclusions. This is because our field staffs are spread too thin and
cannot always afford the time to sample as intensively as they might like.
• Greatest weakness – biologists tend to perform the minimum statewide
requirement and don’t have to “think” about why they are sampling in the first
place.
• Weakness – Cookbook procedures provide too easy an opportunity for staff NOT
to think.
2-19