<p>
<p>1 Office of Superintendent of Public Instruction K-12 Supplemental Instructional Materials Review Publisher’s Questions and Answers UPDATED: 11/17/08 Submission of Materials, Set-Up, Review Week Logistics 1. Do we need one checklist for each grade range that is submitted for review? a. One checklist should be submitted for each unique product. For example, if your product “Math Rocks” spans grades K-8, please submit just one checklist. 2. How many sets of materials are needed for each program? a. Please submit TWO (2) bins per grade level that the program addresses. If materials are the same for multiple grades (i.e., 2, 3, and 4), submit 2 bins for each grade level the program addresses. Please note that this is different than the verbal guidance given at the Supplemental Publisher’s Meeting on November 9. 3. How many computers are needed for the review? a. See Supplemental Program Checklist – One computer for each grade band (K-5, 6-8, 9-12) with two sets of hard copy materials. 4. If the program is specifically aligned with multiple core programs, not just those made by the publisher, how could we indicate the multiple programs? a. List all programs that the program is directly aligned with (and intended for use with) on the Checklist. General Process and Review Documents 5. When will the draft scoring rubric and review documents be finalized? a. 5 business days following 9-12 core review (by November 21, 2008 – Friday). Please note this is different than the verbal communication provided at the Supplemental Publisher’s Meeting on November 9. 6. How will publishers be involved in this process? a. Each publisher submitting a program for review will complete the Program Alignment Worksheets for each program that is submitted to the review. While publishers are not expected to provide a presentation, we are asking that publishers provide a Publisher Information Packet (Program Overview and Research Summary) for each program submitted. Reviewers will be instructed to spend no more than 15-20 minutes reviewing the Publisher Information Packet. These materials will be used to provide background information on your program for reviewers. They will not be scored in any way. 2 b. There is not a specific format or template to use for the Program Overview or Research Summary however please keep in mind that reviewers will be instructed to spend no more than 20 minutes reviewing the information provided. 7. How will the Other Factors be weighted? a. The overall weighting for Other Factors is 30%. See slide 8 in the PowerPoint presentation from 11/9/08 Publisher Meeting for more details. 8. What does each of the Other Factors categories mean? a. The statements that reviewers will be asked to respond to are shown on the Other Factors score sheet. The final version of this document will be posted to the web site on or before Friday, November 21, 2008. 9. Will publishers need to complete an alignment worksheet for the Other Factors? a. No. The Other factors are professional judgments by the reviewers, there is no separate form that publisher will complete for use during the review. b. A publisher could represent some of the Other Factor topics in the Program Overview document. 10. How will time be managed to allow fair review of all products? a. Approximately 3 hours on average will be spent per reviewer per product. Citations 11. Some programs meet standards in multiple grades. How should this be represented on the Program Alignment Worksheet (PAW)? a. Complete one PAW for each program submitted for review. The Program Information tab in the Excel spreadsheet asks you to indicate the target grade for the materials and then asks you to indicate which grades the materials may align to in which citations would be provided. Indicate all grade levels within the worksheets to which the program aligns, and complete the applicable worksheets i. Include the book name, page and section numbers with each citation. If there is other information that will assist reviewers in locating the citation, include it briefly as well. b. Ensure that all relevant worksheets from the PAW are printed (in legible type) for each bin. For example, if the “Math Rocks” 3rd grade supplemental text aligns to standards in grades 2, 3, 4 and 5; print out those worksheets and include a copy in both of the 3rd grade bins. 12. How many citations per standard are necessary? a. When listing citations, please indicate which you believe are critical to meeting the standards first (in order of importance). There is no limit on the number of citations. However, be mindful that the reviewers will spend an average of 3 hours per program, and that excessive references are not helpful. 13. Can we provide a footnote for assisting the reviewer to find the materials based on the citations provided? 3 a. Yes – in addition, by providing publisher contact information on the program checklist, we will contact publishers if reviewers do not understand the citations. Final Report and Data Display 14. How will data from this review be presented in the final report? a. The final report will provide information for teachers and districts that link core programs with the supplemental programs that may fill the gaps in each of the core programs that were reviewed for K-8 and 9-12. There will be a program-specific section that describes how the program aligned across the board of standards alignment and other factors. 15. Is there a way that programs can be listed so as to not give preferential treatment to any one program? a. We will consider listing programs alphabetically whenever possible. Programs may be listed in rank order if the measurement has statistical significance.</p>
<div></div>
</p>