| Table I. Evaluation Matrix for the Variable Star (VS) Project | |||
| Project Goals and Outcomes | Project Activities | Assessment Data Sources and Analysis Strategies | Indicators of Success |
| To increase participants' knowledge of how variable stars are studied. | Provide participants with 5 hours of lecture, 10 hours of hands-on activities, and 2 hours of video. | 1. Pre-post multiple-choice knowledge test. 2. Individual interviews with participants. | 1. Statistically significant test score increases. 2. 80% of participants can correctly describe how variables are studied. |
| To improve participants' attitudes about, value for, and interest in astronomy as a lifelong learning activity. | Provide and moderate online discussion groups about recent news releases. | 1. Pre-post 1-5 scale attitude survey. 2. Analysis of electronic discussion transcripts. 3. Open-ended survey about lifelong learning. | 1. Statistically significant increases on attitude survey. 2. 50% of participants are active discussants. 3. Survey demonstrates that 80% of participants have active lifelong learning interests in astronomy. |
| To increase the amount of class time devoted to contemporary astronomy concepts in teacher-participants' classrooms. | Conduct 15 hours of teacher workshops on how to use “Hands-On Astrophysics” (HOA) curriculum package. | 1. Pre-post survey asking participants how many classroom hours are devoted to astronomy. 2. Focus group interviews. | 1. Statistically significant increases in number of hours devoted to astronomy. 2. Interview transcripts show that 80% will use the HOA materials next year. |
| Table II. TOPS 2003 Postworkshop Questionnaire | ||||||
| Name (optional) | ||||||
| Strongly Disagree | Disagree | Neutral of Don't Know | Agree | Strongly Agree | ||
| 1. | I have the knowledge to incorporate astronomy activities and/or content into my class. | 1 | 2 | 3 | 4 | 5 |
| 2. | I have adequate resources to incorporate astronomy activities and/or content into my class. | 1 | 2 | 3 | 4 | 5 |
| 3. | I have the skill s to incorporate astronomy activities and/or content into my class. | 1 | 2 | 3 | 4 | 5 |
| 4. | I feel confident in my abilities to incorporate astronomy activities and/or content into my class. | 1 | 2 | 3 | 4 | 5 |
| 5. | I am interested in incorporating astronomy activities and/or content into my class. | 1 | 2 | 3 | 4 | 5 |
| 6. | I have the knowledge to guide students in a remote observing project. | 1 | 2 | 3 | 4 | 5 |
| 7. | I have adequate resources to guide students in a remote observing project. | 1 | 2 | 3 | 4 | 5 |
| 8. | I have the skills to guide students in a remote observing project. | 1 | 2 | 3 | 4 | 5 |
| 9. | I feel confident in my abilities to guide students in a remote observing project. | 1 | 2 | 3 | 4 | 5 |
| 10. | I am interested in guiding students in a remote observing project. | 1 | 2 | 3 | 4 | 5 |
| 11. | I have the knowledge to resent a talk or lead an activity at a workshop(such as NSTA or HSTA).a | 1 | 2 | 3 | 4 | 5 |
| 12. | I have adequate resources to present a talk or lead an activity at a workshop (such as NSTA or HSTA). | 1 | 2 | 3 | 4 | 5 |
| 13. | I have the skills to present a talk or lead an activity at a workshop (such as NSTA or HSTA). | 1 | 2 | 3 | 4 | 5 |
| 14. | I feel confident in my abilities to present a talk or lead an activity at a workshop (such as NSTA or HSTA). | 1 | 2 | 3 | 4 | 5 |
| 15. | I am interested in presenting a talk or leading an activity at a workshop (such as NSTA or HSTA). | 1 | 2 | 3 | 4 | 5 |
| 16. | I have the knowledge to organize a professional development workshop for other teachers. | 1 | 2 | 3 | 4 | 5 |
| 17. | I have adequate resources to organize a professional development workshop for other teachers. | 1 | 2 | 3 | 4 | 5 |
| 18. | I have the skills to organize a professional development workshop for other teachers. | 1 | 2 | 3 | 4 | 5 |
| 19. | I feel confident in my abilities to organize a professional development workshop for other teachers. | 1 | 2 | 3 | 4 | 5 |
| 20. | I am interested in organizing a professional development workshop for other teachers. | 1 | 2 | 3 | 4 | 5 |
| aNSTA=National Science Teachers Association; HSTA=Hawaii Science Teachers Association. | ||||||