McKay School of Education > CITES > EPP Assessment > Products

Products

• Team Goals
• Research Projects
• Publications & Presentations
• Reports: Semester and Annual
• Database: Stores all of the core assessment raw data from Fall 2004 forward
• Statistical/SPSS Handbook

TEAM GOALS

Fall 2009

1. COMPLETE & DISTRIBUTE THE 08-09 ANNUAL REPORT (SEPT. 14, 2009)
2. PRESENT THE DATABASE & WEBSITE TO EPP (SEPT. 14, 2009)
3. STAKEHOLDER ACCESS TO DATABASE & REPORTS (SEPT. 14, 2009)
4. CONTINUE STUDENT TRACKING RESEARCH & BEGIN STUDENT SUCCESS FACTORS RESEARCH (OCT. 2009)
5. SOLIDIFY WINTER 2010 MASTER CALENDAR (OCT. 2009)
6. COMPLETE & DISTRIBUTE THE SPRING/SUMMER SEMESTER REPORTS (OCT. 31, 2009)
7. SOLIDIFY TRANSITION 4 ASSESSMENT TOOL DEVELOPMENT, DISTRIBUTION, ANALYSIS & REPORTING (with BYU Institutional Research Office) (NOV. 2009)
8. REVIEW & REVISE THE ASSESSMENT, ANALYSIS, REPORTING, & RESEARCH WEBSITE (INCLUDING POLICIES, PROCEDURES, & PROCESSES) (Ongoing)

"MEASURE WHAT IS VALUED DRIVE DECISIONS FROM WHAT IS MEASURED"

RESEARCH PROJECTS

• Susan Pulsipher: Developing a Student Tracking System
• Aubrie Amelang: Testing the Reliability of the CPAS

CITES Research Division/MEG Grant Proposal
submitted October 30, 2009

Building a Culture of Evidence: Factors of Student Success in the McKay School of Education

Project start date: January 10, 2010
Project end date: January 10, 2011

Research Questions   

1. What does the McKay School of Education do beyond the routine or expected to create and achieve a student-centered environment or culture of student success?  
2. From the student perspective, what are the essential or common factors that made a difference in achieving success in the McKay School of Education? What constitutes success? What made a difference?  
3. What does the research data suggest as common themes or trends that promote student success in the McKay School?  
4. What are the connections between practice and the research?  That is, what are the factors or conditions from the student perspective that made a difference in their educational journey (in the McKay School of Education)?  
5. Re success factors, are adequate and consistent measures or processes in place to create a student profile database including MSE admission, retention, graduation, and placement rates?  To enrich the database, other factors that also would be included are data from senior, alumni, and employer surveys.

Research Objectives   

1. To identify student success factors, conditions, trends and themes derived from an analysis of the research data,
2. Based on the review of the relevant data (obtained from BYU’s student information system including data from BYU’s Research and Assessment Office, and from other processes described below), incorporate a student tracking (profile) database withing the current EPP program core assessments database -- one that includes among other factors admission, retention, graduation, and placement rates; and data on success factors -- what made a difference in the education process from alumni, senior and employer surveys.
3. Student-mentored research.

Methodology 

Data gathering and analysis will take approximately one year beginning later fall semester 2009.  The research will use student focus groups, research and data analysis derived from old and new senior, alumni, and employer surveys.  In addition, data from NSSE and CIRP data collected on McKay School students, EBI (Educational Benchmarking …) archival data, and data derived from new and specific instruments that focus on student expectations, e.g. College Student Expectations Questionnaire/College Student Experience (CSXQ/CSEQ) will be used. 

Principle Investigators 

Gary Kramer and Coral Hanson, CITES (Research Division), Danny Olsen, Institutional Assessment and Analysis

Deliverables  

1. The development of a Culture of Evidence that combines Documentation on Student Success Factors with the current Educator Preparation Program (EPP) Documentation for Learning database.
2. Paper presentation(s)/article(s), e.g. Association for Institutional Research, AERA (American Evaluation and Research Association).
3. Student-mentored research -- the direct involvement of students in all aspects of the research project including paper presentations and the reporting of research results in research journals.

PUBLICATIONS & PRESENTATIONS

(Since the EPP Data Assessment, Analysis, Reporting, and Research Team was organized 2007)

• Kramer, F. Fostering Student Success in the Campus Community,  November 2007, Jossey-Bass Publishers, Editor—chapters contributed
  Putting Students First in the Campus Community. In G. Kramer (Editor, Fostering Student Success in the Campus Community, (with Thomas Grites, Eric White, Michael Haynes, Virginia Gordon, Michael McCauley, Wesley Habley, Margaret King—Past presidents of NACADA, National Academic Advising Association)
  Fostering Student Success:  What Really Matters.  In G. Kramer (Editor), Fostering Student Success in the Campus Community
• Hanson, C.  (2008, April).  A systems approach to assessment.  Presentation given at the North Carolina State Undergraduate Assessment Symposium, Raleigh, North Carolina.
• Kramer, G., & Olsen, D. (2008, September).  The pursuit of increased learning: Coalescing assessment strategies at a large research university.  Presentation given at the International Assessment Education on Association, Cambridge UK.
• Pulsipher, S., & Hanson, C. (2008, October).  Using a systems approach to improve program assessment, analysis and reporting.  Presentation given at the Rocky Mountain Association of Institutional Research Conference.
• Kramer, G, & Olsen, D.  (2009, January).  The pursuit of increased learning: Assessment strategies as a mechanism of change and improvement in higher education.  Presentation given at Hawaii International Conference on Education.
• Kramer, G. & Olsen, D.  (2009, February). The Pursuit of Increased Learning: Assessment Strategies as a Mechanism of Change and Improvement in Higher Education. Presentation given at the Texas A&M Assessment Conference.
• Kramer, G., Olsen, D., Amelang, A., and Pulsipher, S. (2009, May). A systems approach to improving program assessments, analysis, and reporting. Presentation given at the Association for Institutional Research Forum.
• Amelang, A. (2009, July). Testing the reliability of the CPAS. Presentation given at the Association of Institutional Research Forum.
• Pulsipher, S. (2009, July). Developing a student tracking system. Presentation given at the Association of Institutional Research Forum.
• Kramer, G., & Swing, R. (Executive Director, Association for Institutional Research ). (2010).  Assessments that drive change in higher education and improve student learning and development.  ACE (American Council on Education) and Rowman/Littlefield, Publishers, forthcoming March 2010—chapter contributions:
  • Leading Assessments on the Campus:  Measuring What is of Value, Driving Decisions From What is Measured. Kramer, G., Olsen, D., Hanson, C., (Chapter 2).
  • Bridging Learner Outcomes: Finding Common Ground Among Assessments, Osguthorpe,R., Bradley, B., Johnson, T. (Chapter 7).
  • Putting Students First as Partners in the Learning Enterprise, Gary Kramer with Thomas  Miller, Associate Professor, School of Education & Former Associate VP & Dean of Students, University of South Florida (Chapter 10).
•  Kramer, G. Wesley R. Habley and Thomas Grites. Student Success:  Stories Told, Lessons Learned and Advice Given, in review and process, Rowman and Littlefield, Publishers, anticipated November 2010
• Olsen, D., Kramer, G., & Hanson, C.  (2010). The Pursuit of Increased Learning:  Coalescing Assessment Strategies at A Large University, in process, The Professional File, AIR (Association for Institutional Research), anticipated Spring 2010.