Siena College Assessment Report Process Guidelines

Completing the Siena College Assessment Report Sponsored by the Student Learning Assessment Committee (SLAC) May 2018

Siena College Assessment Report Exercise 1. Take a minute to read the diagram below 2. How familiar is this to you? 3. What are the first thoughts that come to mind? 1. Major/Program Student Learning Outcomes Student will be able to... 2. Phase 3. Assessment Procedures (Planning/ determining) 4. Assessment Results (Collecting/ analyzing) 5. Use of Results (Discussing/ using results) 6. Determining if changes impacted student learning Check all that apply 1. Enter your first student learning outcome in this box. Planning/ determining procedures (Col. 3) Collecting/ analyzing (Col. 3,4) Discussing/ using results (Col. 4,5) Determining if Assessment had an Impact on Student Learning (Col. 6) Check the appropriate box to the right

Siena College Assessment Report The Assessment Report The Siena College Assessment Report is now being collected through Process Maker Submission of your report through this method gives you more flexibility in how you record and use your assessment reports Each year, you will be able to either add to your previous report or edit a previous report to contain your current year data The step-by-step process reviewed here will also be available online

The Data Entry Screen: When you log in to Process Maker, this is what you will see Student Learning Assessment Report, Academic If you have any questions about the online submission please contact Mildred Savidge at msavidge@siena.edu. Hover your mouse over the The red asterisk to the left * indicates a required field. If you are not finished, you can still save what has been entered by clicking the Save As Draft button. You will receive an email with a link to complete the application. to the right of a question for more details/description. - Select One - - Select One - - Select One - - Select One - * Report Year * School * Degree * Program Retrieve previously submitted reports - Select One - * Are you the Head of Unit (e.g. Director)? - Select One - Mission Indicate number of assessments. 1 (There should be at least one row per student learning outcome. Every student learning outcome should be listed.) Criteria 1. Major/Program Student Learning Outcomes Student will be able to... 2. Phase 3. Assessment Procedures (Planning/ determining) Check all that apply (How do you know students are achieving learning outcome?) 1. Planning/ determining procedures (Col. 3) Planning/ Redesigning based on past assessment (Col. 3) Collecting/ analyzing assessment data (Col. 3,4) Discussing/ using results (Col. 4,5) Determining if Changes had an Impact on Student Learning (Col. 6) Objective not assessed this year If you would like to send this report to another user as a draft please select a user and click the Save as Draft button below The person who receives the report will have the ability to edit the report. You will not have the ability to edit the report until it is sent back to you. If this field is left blank you will receive an email with a link to access the draft for further edits.

Screen Detail: Top of Screen

Assessment Year Siena College Assessment Report Student Learning Assessment Report, Academic If you have any questions about the online submission please contact Mildred Savidge at msavidge@siena.edu. Hover your mouse over the The red asterisk to the left* indicates a required field. If you are not finished, you can still save what has been entered by clicking the Save As Draft button. You will receive an email with a link to complete the application. to the right of a question for more details/description. * Report Year - Select One - Current options include 2014-15, 2015-16 2016-17, and 2017-18. To work on this year s report, choose - The current academic year The first step is to choose the academic year for your current entry. This ensures that when you save your report, it is saved under that year.

Program Identification Siena College Assessment Report SchoolSelect One Liberal Arts, Science, Interdisciplinary, Core, Library, and Other * Degree Select One Current options include Certificate, Major, or Minor * ProgramSelect One Drop down options are dependent on previous answers, only available programs will be listed. Current options include Business, Next, choose your school, the degree type, and the program name, working your way across the screen. Once you have chosen your school and degree, only programs of that type will appear in the drop-down list. If you don t find your program, please contact OIE.

Last Report Options Siena College Assessment Report Now you can pull up a previous year s report. You can edit your last report, and populate the report with only this year s data, or you can add to what is already there, if you prefer to have both years in the same report. When you save the document, it will save under the year you entered previously (step 1)

Mission Statement Siena College Assessment Report If you have past years reports, your program mission should already be entered in your report. If your program mission has changed, make sure to note that here. Make sure you choose the right number of assessments in the drop down box. This will give you the right number of rows in the table.

Program Outcomes Siena College Assessment Report For each assessment indicated in the drop down box, a row like the one below will appear in the table. 1. Major/Program Student Learning Outcomes Student will be able to 2. Phase 3. Assessment Procedures Criteria (Planning/ determining) (How do you know students are Check all that apply achieving learning outcome?) What are your performance expectations? For students? For the program? 1 Method: (ex. tests, presentations, research paper, etc.) How will you measure this outcome? Planning/ determining procedures The student learning outcome goes here. What will the student be able to do as a result of this learning activity? Planning/ Redesigning based on past assessment Collecting/ analyzing assessment data Discussing/ using results Determining if Changes had an Impact on Student Learning Objective not assessed this year Using a Sample of Students? - Select One - When does assessment occur? How often does assessment occur? The student learning outcome being assessed should appear in column 1.

Siena College Assessment Report Student Learning Outcomes Most of your outcomes will have already been entered. This is a good time to review them and make any changes. If you have new outcomes, add lines for those outcomes. If you are dropping an outcome, please make a note of that. What will students be able to do as a result of completing this program? Are there other steps along the way to this outcome that might need progress assessments along the way? You can enter more than one assessment for a single learning outcome, or you can use the same assessment for more than one outcome. What are the four/five large themes regarding student learning for your program?

Assessment Phase Siena College Assessment Report Once your outcome is entered, check the phase of assessment you are currently in. If you check planning, you will see the following: 1. Major/Program Student Learning Outcomes Student will be able to 2. Phase 3. Assessment Procedures Criteria (Planning/ determining) (How do you know students are Check all that apply achieving learning outcome?) 1 Method: (ex. tests, presentations, research paper, etc.) Planning/ determining procedures The student learning outcome goes here. What will the student be able to do as a result of this program? Planning/ Redesigning based on past assessment Collecting/ analyzing assessment data Discussing/ using results Determining if Changes had an Impact on Student Learning Objective not assessed this year Using a Sample of Students? - Select One - When does assessment occur? How often does assessment occur? The assessment phase that you enter determines which areas of the form are open for data entry

Siena College Assessment Report 2. Phase: Check all that apply Planning/ Determining procedures (Col. 3) Planning/ Redesigning based on past assessment (Col. 3) Collecting/ analyzing (Col. 3, 4) Discussing/ using results (Col. 4, 5) Determining if Assessment Use had an Impact on Student Learning (Col. 6) Objective not assessed this year Check boxes All assessments should NOT be in planning phase Usually, your assessment phase this year would be one phase ahead of where you were last year

Assessment Methods Siena College Assessment Report Your method of assessment is entered in Col. 3. The text boxes allow you to explain your assessment method and sample. You are also asked about when and how frequently this assessment occurs. You can enter more text in the boxes than it appears here. Please explain your assessment thoroughly. 3. Assessment Procedures (Planning/ determining) Method: (ex. tests, presentations, research paper, etc.) What is your method of assessment? Using a Sample of Students? Yes/ No box If yes, describe your sample. Who is your sample? i.e. all majors in X When does assessment occur? mid-semester, end semester, etc. How often does assessment occur? annually, semi-annually, bi- annually, etc.

Siena College Assessment Report Assessment Criteria Criteria (How do you know students are achieving learning outcome?) You will also be asked to establish a criteria for demonstrating that the program outcome has been met. The criteria is now discussed in column four, as part of number 3, assessment procedures, which is different from where it has been located on the form in the past. Use this space to define your criteria for student and program success (i.e. 90% of students will receive a rating of 4 or 5 on this exercise) In stating your criteria, please be sure to describe the MINIMUM level of student performance that provides a reliable indicator that the objective has been met AND The proportion of students who must achieve that level for the program to be consider effective.

1. Major/Program Student Learning Outcomes Student will be able to 2. Phase 3. Assessment Procedures Criteria (Planning/ determining) (How do you know students are Check all that apply achieving learning outcome?) 1 Method: (ex. tests, presentations, research paper, etc.) Planning/ determining procedures Planning/ Redesigning based on past assessment Collecting/ analyzing assessment data Discussing/ using results Determining if Changes had an Impact on Student Learning Objective not assessed this year Using a Sample of Students? - Select One - When does assessment occur? How often does assessment occur? 4. Assessment Results (Collecting/ analyzing) Learning Outcome Met? (Based on Criteria) - Select One - 5. Use of Results (Discussing/ using results) 6. Determining if changes impacted student learning If you would like to send this report to another user as a draft please select a user and click the Save as Draft button below The person who receives the report will have the ability to edit the report. You will not have the ability to edit the report until it is sent back to you. If this field is left blank you will receive an email with a link to access the draft for further edits.

Report Progress Siena College Assessment Report As your proceed with your assessment, you will have results. The phase you check in column 2 controls your data entry. The further you are in the process, the more boxes will be open to you. 4. Assessment Results (Collecting/ analyzing) Learning Outcome Met? (Based on Criteria) - Select One - 5. Use of Results (Discussing/ using results) 6. Determining if changes impacted student learning If you would like to send this report to another user as a draft please select a user and click the Save as Draft button below The person who receives the report will have the ability to edit the report. You will not have the ability to edit the report until it is sent back to you. If this field is left blank you will receive an email with a link to access the draft for further edits.

Siena College Assessment Report Assessment Results Assessment results are entered in the next row, in Number 4. In order to facilitate a complete description of results, this space has been made larger, and easier to read. 4. Assessment Results (Collecting/ analyzing) What were the results of your assessment? How many students were successful? Did the students struggle with the assessment or just breeze through it? Did you meet your program criteria? Is the evidence of student learning clearly linked to expected student learning outcomes? What does the outcome tell you about program quality? Please feel free to use as much space as you need. Learning Outcome Met? (Based on Criteria) This is a yes/ no box - Select One -

Results Siena College Assessment Report What to Include in Assessment Results How did your students do on their test/paper/presentation/etc.? Are your students learning? Is their level of proficiency acceptable? Indicate percent of students who met criteria (ex. 75% students achieved 3 or better on rubric criteria) If criteria was met, indicate that Learning Outcome was met Small programs may need additional time to collect adequate data if this applies to you, please make a note in the results box

Siena College Assessment Report Use of Results Learning Outcome Met - Great!!! Demonstrates relevance Affirms student learning Provides evidence of value Here, you can also discuss any changes you might want to make to improve your program, your results, or to give you more information Learning Outcome not Met What problems did the students have? Were there commonalities in problems between students? See if you can pin point a couple of areas that were problematic or could use improvement

Discussion of Results Siena College Assessment Report The next step in the process is to explain or discuss how your program intends to use the information you have collected. To open this dialog box, you have to check the discussing/ using results box under phase 5. Use of Results (Discussing/ using results) Use this space to provide a discussion of your assessment results. What do your results tell you about the current state of your program? Do they bring up any areas of concern? Do they point out places where some improvement can be made? This should be a thoughtful discussion of how all the information you have collected guides you to the changes that you make.

Impact Siena College Assessment Report 6. Determining if changes impacted student learning. Changes made, as discussed in Number 5, will take some time (maybe a year or two) to show an impact. Once the changes have been implemented and the assessment has been repeated, use this box to track how those changes have impacted student learning. Was there an improvement? If so, describe If not, determine why? Also include additional actions that will be taken to make improvements in program outcomes.

TIME Siena College Assessment Report As discussed in the previous slide, it will take some time before you know if your determined changes will have an impact. It could take a year or two to determine the impact of changes. When you have seen evidence of changes in outcomes, use this space to start closing the loop When you check the determining if assessment had an impact box under Phases , the dialog box for that part of the report will be available for data entry.

Impacts: What to Include Any changes made in the program will take some time to implements and produce changes in outcomes. Depending on how often the specific assessment is completed this could take a year or two. When changes have been made and re-assessed, use this space to track how those changes have impacted student learning. Did the changes made change the outcome? Was there an improvement, no change, or did the changes made have a negative impact? If so, have you given the changes enough time to really see a difference? Is there a reason you can pinpoint that might have made the change less successful than anticipated? Are there additional actions that will be taken to make more improvements in program outcomes?

Siena College Assessment Report You will complete one entry for each learning outcome assessment Some outcomes may have multiple assessments It is also the case that you may use the same assessment for multiple outcomes. If that is the case, please complete an entry for each outcome, so that you can discuss the specific outcome as you move through the report

Save / Submit Siena College Assessment Report Once you have finished entering all the information for each Assessment or Student Learning Objective, you have several options 1. Send the report to another person for review or approval 2. Save your work as a draft and complete it at another time 3. Submit your report If you would like to send this report to another user as a draft please select a user and click the Save as Draft button below If this field is left blank you will receive an email with a link to access the draft for further edits.

Report Recipients Siena College Assessment Report When you submit your report, a notice of the submitted report and an attached PDF of the report I automatically sent to: 1. OIE 2. Your School s Assessment Coordinator 3. Your Department Chair 4. The Dean of your School 5. Your VPAA

Report Review Siena College Assessment Report All submitted Assessment Reports are reviewed Seven areas corresponding to the assessment report are used to assure that Assessment Reports are complete and appropriate 1. Program Student Learning Outcomes 2. Assessment Criteria 3. Assessment Procedures 4. Assessment Results 5. Use of Assessment Results 6. Impact of Changes 7. Assessment Stage After review, feedback will be provided to program directors

Academic Assessment Report: Review Considerations Are the outcomes clearly stated? Are the outcomes measurable? Points for reflection (skill-based, affective outcomes) Review Area Program Student Learning Outcomes Assessment Criteria Assessment Procedures Comments Reviewer Comments here Is Criteria clearly stated in terms of student expectations? Are assessment criteria rigorous? Is each assessment method clearly described, and linked to the SLO? Is the assessment useful for evaluating student achievement of outcome? Is the evidence of student learning clearly liked to expected outcomes? Do they give an indication of program quality? Are assessment results thoughtfully discussed and used to make well-defined changes for program improvement? Is there an obvious connection between changes make and assessment results? Does the report describe how the implemented changes impact student learning or program outcomes? Assessment Results Use of Results Impact of Changes Assessment Stage Is the assessment process being used for program improvement, or simply to affirm program quality? Have results been used for planning, budgeting, decision- making?

Siena College Assessment Report NEED HELP? Work with Assessment Coordinator in your School She/he: Is your mentor; understands your programs & associated issues Should be meeting with each department to review assessments Can help you identify best practices and model assessments Call OIE Extension 4235 I can provide one on one assistance, although I may not be as familiar with your program as your School Assessment Coordinator.

Siena College Assessment Report Middle States New Requirements & Standards for 2017-18 Raises the bar: expects that institutions are doing/using assessment Not good enough to just plan or show slight progress Must show rigor Criteria must be appropriate Assessment part of ALL standards

Siena College Assessment Report Middle States Requirements of Affiliation 8. The institution systematically evaluates its educational and other programs and makes public how well and in what ways it is accomplishing its purpose. 9. Student learning programs are characterized by rigor, coherence, and appropriate assessment of student achievement throughout educational offerings 10. Institutional planning integrates goals for academic and institutional effectiveness and improvement, student achievement of educational goals, student learning, and the results of academic and institutional assessments.

Siena College Assessment Report Middle States Standards I. Mission and Goals: 1. clearly defined mission and goals that are periodically evaluated 3. goals that focus on student learning and institutional improvement III. Design and Delivery of the Student Learning Experience: 2. student learning experiences that are designed, delivered, and assessed by the faculty 5. a general education program that (b) offers a curriculum designed so that students acquire and demonstrate essential skills 8. periodic assessment of the effectiveness of programs providing student learning opportunities

Siena College Assessment Report Middle States Standard V. Educational Effectiveness Assessment: Assessment of students learning and achievement demonstrates that the institution s students have accomplished education goals consistent with their program of study, degree level, the institution s mission, and appropriate expectations for institutions of higher education.

Siena College Assessment Report Middle States Standard Vcriteria includes: 1. Clearly stated educational goals at both the institution and degree /program levels which are: a. interrelated with one another b. connected to relevant educational experiences c. Interrelated with the institution s mission

Siena College Assessment Report Middle States Standard Vcriteria includes: 2. organized and systematic assessments a. Define meaningful curricular goals with defensible evaluation standards. b. articulate how they prepare students c. support and sustain assessment of student achievement and communicate the results to stakeholders

Siena College Assessment Report Middle States Standard V criteria includes: 3. consideration and use of assessment for the improvement of educational effectiveness a. assist students in improving learning b. improving pedagogy and curriculum d. planning, conducting, and supporting a range of professional development activities g. improving key indicators of success (ex. retention, graduation) h. Implementing other processes and procedures designed to improve educational programs and services 5. periodic assessment of the effectiveness of assessment processes used by the institution for the improvement of educational effectiveness

Middle States Siena College Assessment Report Standards Standard VI : Planning, Resources, and Institutional Improvement: 1. institutional objectives, both institutional-wide and for individual units, that are clearly stated, assessed appropriately, linked to mission and goal achievement, reflect conclusions drawn from assessment results, and are used for planning and resource allocation. 2. clearly documented and communicated planning and improvement processes that provide for constituent participation and incorporate the use of assessment results. 8. strategies to measure and assess the adequacy and efficient utilization of institutional resources required to support the institution s mission and goals 9. Periodic assessment of the effectiveness of planning, resource allocation, institutional renewal process, and availability of resources

Middle States Siena College Assessment Report Standard V criteria includes: 2. organized and systematic assessments a. Define meaningful curricular goals with defensible evaluation standards. b. articulate how they prepare students c. support and sustain assessment of student achievement and communicate the results to stakeholders 3. consideration and use of assessment for the improvement of educational effectiveness a. assist students in improving learning b. improving pedagogy and curriculum d. planning, conducting, and supporting a range of professional development activities g. improving key indicators of success (ex. retention, graduation) h. Implementing other processes and procedures designed to improve educational programs and services 4. periodic assessment of the effectiveness of assessment processes used by the institution for the improvement of educational effectiveness VI. Planning, Resources, and Institutional Improvement:

Siena College Assessment Report Middle States VII. Governance, Leadership, and Administration: 3. CEO .responsible for establishing procedures for assessing the organizations efficiency and effectiveness 4. An administration possessing or demonstrating systematic procedures for evaluating administrative using and for using assessment data to enhance operations 5. Periodic assessment of the effectiveness of governance, leadership, and administration. Each standard s criteria includes periodic assessment

Siena College Assessment Report Check out our Online Resources Assessment: https://community.siena.edu/academic- affairs/offices/institutional-effectiveness/assessment1/ Assessment Repository: https://community.siena.edu/academic- affairs/offices/institutional-effectiveness/assessment1/assessment- repository# - Requires a sign-in Assessment Instruments: https://sites.google.com/a/siena.edu/rubrics SLAC: https://community.siena.edu/academic- affairs/offices/institutional-effectiveness/assessment1/student- learning-assessment-committee/ Contact Information If you have any questions, email oie@siena.edu.