Carmody Consulting Leadership

Courtenay Carmody, M.A.

Having conducted evaluation research in the NYC public schools for the past 8 years and having taught for 12 years previously, Courtenay brings extensive experience to navigating the complexities and realities of program evaluation in urban school settings. 

From 2000-July 2007, Courtenay oversaw all program evaluation and research efforts for MOUSE, a nonprofit organization that creates technology-based opportunities that motivate underserved students to succeed in today’s information society.  Prior to working in the non-profit sector, Courtenay taught middle and high school English and served in a number of secondary school administrative capacities in Chicago and New York City. Ms. Carmody received her BA degree in English Literature and Education from Northwestern University in 1988 and her Masters in Education from Teacher's College, Columbia University in 1997.

In July 2007, Courtenay launched Carmody Consulting Evaluation Services in response to the non-profit sector's need for assistance with establishing and measuring outcomes and providing accountability to funders and constituents. Past and current clients to date include Academy for Educational Development, Exploring the Arts, MOUSE, NYC Outward Bound,  and PENCIL.

Courtenay's most recent presentation experience includes concurrent sessions at the National After School Association Conference (NAA) in 2006, The National Education & Computing Conference (NECC) in 2006 and 2005, presentations at local conferences and extensive student training and teacher professional development. Ms. Carmody has also served as an advisor for the Bertelsmann Foundation's Teacher Awards and The Academy of American Poets' Online Poetry Classroom and has authored extensive curriculum for Thirteen's Ed Online. 

Select Experience

MOUSE (July 2000 – June 2007)
Director of Research and Evaluation
Evaluation:

• Design and Implementation: Designed qualitative and quantitative evaluation initiatives; selected or designed survey instruments, assessments, site observation protocols, and interview protocols; managed staff data collection.
• Analysis: Cleaned quantitative data and provided basic statistical analysis, using STATA and Excel for pre-and post-satisfaction questionnaires, performance assessments and other data. Performed qualitative data analysis on open-ended responses and feedback.
• Monitoring and Information Management: Directed the aggregation, analysis and documentation of  demographics and participation data; created and implemented an information management system to track program outcomes and membership information; directed recent search for Constituent Relationship Management tool, including the development of specs and program process map.
• Reporting: Provided ongoing formative reports on findings, trend information and recommendations;  generated yearly program evaluation reports.
• Program Development: Coordinated the use of formative evaluation data for program development and the creation of new MOUSE programs, working directly with the Director of Programs and program staff.
• Institutional Review Board (IRB) Approvals: Obtained IRB approvals for quasi-experimental matched group comparison studies, from Fordham IRB and NYC Department of Education (NYCDOE) Office of Assessment and Accountability.
• Quality Control: Established quality control processes, standards and criteria with an aim toward establishing fidelity of implementation for MOUSE programs.
• Strategic Planning: Directed strategic planning efforts including the development of a Theory of Change for MOUSE Squad, MOUSE’s flagship program.
• Independent Evaluators: Hired, managed and collaborated on evaluation design and planning for MOUSE Squad independent evaluators, The National Center for Schools & Communities (NCSC) at Fordham.
• Budgeting and Management: Prepared and maintained oversight of evaluation/research budget; managed all MOUSE evaluation personnel and consultants; oversaw and managed all phases of NYCDOE -approved MOUSE Squad Evaluation.
• Development: Wrote and consulted on multiple evaluation and capacity building grants in consultation with MOUSE’s Development Director .
• Presenting: Authored and delivered presentations at forums, conferences, meetings etc. (See below.)

• Surveys: Designed and disseminated: comprehensive best practices survey of 119 New York City Community Technology Centers; a pilot technology infrastructure survey of technology coordinators in two NYCDOE school districts; and, a Technology Integration Best Practices Video Teacher Survey of NYCDOE teachers and coaches.
• Best Practices and New Markets Research: Developed and directed all MOUSE research projects, including best practices and new markets research for MOUSE’s flagship program, MOUSE Squad. Identified areas of education research specifically pertaining to MOUSE interests and program development efforts.
• Dissemination: Directed MOUSE’s dissemination efforts through participation in forums, conferences, and meetings.
• Management: Managed all MOUSE research personnel and consultants; mentored interns and new staff.

Online Publications

MOUSE Programs Evaluation 2005-06, September 2006, MOUSE.
http://www.mouse.org/pdf/2005_06_ms_eval_final.pdf

Findings from the TechSource  iTeachiLearn Video Coach/Teacher Survey, December 2005, MOUSE.
(http://www.mouse.org/pdf/iteach%20ilearntechsourcefindings.pdf)

Findings from the TechSource Region 7 Video Teacher Survey, November 2005, MOUSE. (http://www.mouse.org/pdf/region7techsourcefindings.pdf)

Linking Individuals, Knowledge & Culture (LINK) MOUSE Squad Evaluation, October 2005, MOUSE. (http://www.mouse.org/pdf/linc_evaluation.pdf)

MOUSE Squad Evaluation 2004-05, August 2005, MOUSE.
(http://www.mouse.org/pdf/2004_05_mseval.pdf)

MOUSE Squad 2003-04 Evaluation Executive Summary, September 2004, MOUSE.
(http://www.mouse.org/pdf/2003_04_mseval_execsum.pdf)

TechSource 2003 Pilot Survey Findings, November 2003, MOUSE.
(http://www.mouse.org/pdf/final%20techsource%20pilotfindings%202003.pdf)

MOUSE Squad 2002-03 Evaluation executive Summary, September 2003, MOUSE.
(http://www.mouse.org/pdf/ms_eval_execsummary2002_03sept__2003.pdf)

New York City Community Technology Center Survey Results, February 2001, MOUSE.
(http://www.mouse.org/pdf/Final_Survey_Commentary.pdf)

Lesson Plan: The Tudor’s True Story (Grades 9-12). (http://www.thirteen.org/edonline/lessons/tudors/)

Lesson Plan: Comparing Wives and Lives (Grades 8-10). (http://www.thirteen.org/edonline/lessons/wives/)

Lesson Plan: Utilizing Songs from Broadway Musicals from Renée Fleming and Bryn Terfel: Music Under the Stars (Grades 5-8).
(http://www.pbs.org/wnet/gperf/education/plan_stars_overview.html)

Lesson Plan: Exploring Stereotypes and 19^th Century Culture from “The Merry Widow” from The San Francisco Opera (Grades 9-12).  (http://www.pbs.org/wnet/gperf/education/plan_merrywidow_overview.html)

Lesson Plan: Appreciating the Men of Ballet from Dance in America: Born to Be Wild: The Leading Men of American Ballet Theater (Grades 5-8). (http://www.pbs.org/wnet/gperf/education/plan_btbw_overview.html)

Conferences/Presentations

National After School Association Conference (NAA): “Confronting Challenges While Building Effective OST Programs”: Phoenix, AZ, March 22, 2007; presenter.

National Education & Computing Conference (NECC): “Empowering Youth and Providing Support: Evaluation Findings from Youth Technical Support Programs”: San Diego, CA, July 5, 2006; organizer, presenter.

National Education & Computing Conference (NECC): “e-learning Tools: If You Build Them, Will They Learn?”: Philadelphia, PA, June 29, 2005; presenter.

National Education & Computing Conference (NECC): “A Student Conversation: Technology in Urban Public Schools”: Philadelphia, PA, June 27, 2005; organizer, presenter.

New York State Association for Computers (NYSCATE) Conference: Learning without Boundaries, Albany NY, November 23, 2003: presenter.

National Community Technology Center Programs Conference, CTCs Moving Forward: Programming for Digital Communities, February 26, 2001, New York, NY: organizer.

New York State Association for Computers (NYSCATE) Regional Conference, March 4, 2000, New York: presenter.