may 14 2003 copyright 2002 deshpande center for technological innovation massachusetts institute of technology projects fall ideastream symposium automatically generated system specifications michael ernst eecs and lab computer science 4 opportunity a administrator s nightmare missed alarms getting paged at 3am because the website crashed false even though was fine programmer fail to understand implications code change crashes as result need understanding behavior what should my do does goal avoid solve problems 5 overview infer 1 observe in inputs outputs or events program values variables 2 generalize properties akin machine learning 3 filter via statistical other tests report user feed into another tool partial
