Classroom technology - Is "Does it Work?" the right question?

Check out the very interesting article by Trip Gabriel and Matt Richtel in yesterday's New York Times, about the "report card" of technology in K12 education.

When evaluating technology, are people asking the right question, "Does it work?"

Would it be more useful to ask, "What is the proficiency objective?" before deciding how to assess any specific technology's effectiveness?

There seems to be wide agreement that student assessment should consist of more than a numerical score on a standardized test, and teacher assessment should consist of more than an aggregate of students' standardized test scores. So - can textbooks or technology be evaluated based on student test scores alone? Wouldn't it make sense to begin with what the teacher is trying to accomplish in the classroom, and find out how well the textbook and/or technology (or game, or gadget, or teaching tool) actually assists and promotes what the teacher's goals are for the lesson or the class period?

The New York Times article's 130 comments (as of this evening) range from thoughtful to vitriolic. It's a little disconcerting to see the comments that accuse school officials and curriculum publishers of somehow colluding to defraud or hoodwink the taxpaying public. We cannot remember a time when emotions ran this high about education standards, curriculum decisions, and school purchasing/finance strategies.

Our position has always been that technology cannot replace a good teacher, and that the best technology assists and supports the teacher to provide an engaging learning experience for every student. What could be controversial about that?

What do you think? Will we continue to see technology purchases portrayed with suspicion as somehow "replacing" the teacher? Is it fair to assess a technology investment based solely on aggregate standardized student test scores' improvements? Even if technology is not viewed as "replacing the teacher," how can educators avoid creating this impression, when teacher layoffs are taking place even while technology investments are increasing? Is your school facing this kind of situation?