{"doc_desc":{"title":"Teaching and assessment","idno":"DDI-KEN-APHRC-TEACHINGANDASSESSMENT-2023-V10","producers":[{"name":"African Population and Health Research Center","abbreviation":"APHRC","affiliation":"","role":" DDI Documentation"}],"prod_date":"2024-04-04","version_statement":{"version":"Version 1.0 (April 2024)"}},"study_desc":{"title_statement":{"idno":"DDI-KEN-APHRC-TEACHINGANDASSESSMENT-2023-V10","title":"High-Stakes Testing and its influence on Classroom Instructional Practices: A Sub-Saharan Africa Perspective","sub_title":"N\/A","alt_title":"N\/A"},"authoring_entity":[{"name":"Moses Ngware","affiliation":"APHRC"}],"oth_id":[{"name":"Mambe Shem","affiliation":"African Population and Health Research Center","email":"","role":"Data documentist"}],"production_statement":{"producers":[{"name":"Amani Karisa","affiliation":"APHRC","role":"Co-Investigator"},{"name":"Jack Rossiter","affiliation":"CGD","role":"Co-Investigator"}],"copyright":"Copyright \u00a9 APHRC, 2024","funding_agencies":[{"name":"Center for Global Development","abbreviation":"CGD","role":""}]},"series_statement":{"series_name":"Demographic and Health Survey [hh\/dhs]","series_info":"This was a quantitative data collection to generate evidence that improves our understanding of the influence of assessments on teachers' teaching behavior inside the classroom with a focus on sub-Saharan Africa"},"version_statement":{"version_date":"2024-04-04"},"holdings":[{"text":"","location":"","callno":"","uri":"10.60719\/aphrc-02-2024.1.01"}],"study_info":{"abstract":"Background: Tests are known to influence instructional practices in the classroom. However, most literature on this phenomenon is from the Global North, with gaps in knowledge from the Global South.\nObjectives: The broad objective of this study is to generate evidence that improves our understanding of the influence of assessments on teachers' teaching behavior inside the classroom with a focus on sub-Saharan Africa.\nMethods: The study will collect data from primary school teachers in Kenya through exploratory surveys to examine their perceptions of the influence of assessment and assessment data on their teaching decisions. The study design will be an exploratory survey. The sample will consist of 200 primary school teachers. Data collection methods will include a structured interview using closed-ended questions to collect quantitative data. These data will be analyzed using statistical techniques that employ small sample sizes to explore relationships\/correlations. Nonparametric tests will also be used to examine the possible non-normal distributions likely to be encountered with the small sample size. \nResults: The study findings are likely to inform policy and practice on testing as it relates to classroom instructional practice in Kenya and other jurisdictions that are adopting new educational approaches in sub-Saharan Africa. Such evidence is useful in designing teacher professional development programs that use students' learning outcomes to inform classroom instructional strategies.","coll_dates":[{"start":"2023-08-07","end":"2023-08-30","cycle":""}],"nation":[{"name":"KENYA","abbreviation":"KEN"}],"geog_coverage":"Approximately 50 public primary schools will be targeted for this study (inclusive of possible non-response): 20 from Nairobi, 15 from Kajiado and 15 from Embu.","analysis_unit":"The unit of analysis was teacher","universe":"Approximately 50 public primary schools will be targeted for this study (inclusive of possible non-response): 20 from Nairobi, 15 from Kajiado and 15 from Embu.","notes":"Quantitative data will be collected to answer our research questions. As this is an exploratory study, survey questionnaires will be administered to 200 teachers spread across Grades 5, 6, and 8. This sample size is chosen conveniently based on budgetary and time constraints. While the sample size is relatively small, the intention of this study is not to generalize, but to understand what is happening in regard to the phenomenon, in order to inform the design of a larger study that will be representative of the larger population of teachers in Kenya. Grade 5, 6, and 8 are purposely selected to allow for comparisons on how teachers' classroom instructional practices       are influenced by assessments (grade 5: no high stakes test, grade 6: there is the new KPSEA based on CBC, and grade 9: there is the old high stakes KCPE). \nThe targeted teachers will be those teaching English and Mathematics in schools located in counties where APHRC conducts education research. Specifically, three counties will be selected: Nairobi, Kajiado and Embu.","study_scope":"Quantitative data will be collected to answer our research questions. As this is an exploratory study, survey questionnaires will be administered to 200 teachers spread across Grades 5, 6, and 8. This sample size is chosen conveniently based on budgetary and time constraints. While the sample size is relatively small, the intention of this study is not to generalize, but to understand what is happening in regard to the phenomenon, in order to inform the design of a larger study that will be representative of the larger population of teachers in Kenya. Grade 5, 6, and 8 are purposely selected to allow for comparisons on how teachers' classroom instructional practices       are influenced by assessments (grade 5: no high stakes test, grade 6: there is the new KPSEA based on CBC, and grade 9: there is the old high stakes KCPE). \nThe targeted teachers will be those teaching English and Mathematics in schools located in counties where APHRC conducts education research. Specifically, three counties will be selected: Nairobi, Kajiado and Embu."},"method":{"data_collection":{"sampling_procedure":"the study population will be all primary school teachers who are teaching English and Mathematics in Nairobi, Kajiado, and Embu counties in Kenya. The following inclusion and exclusion criteria will be used to select the sample of teachers.\nInclusion criteria\n\u00b7\tPrimary school teachers teaching in public schools in Nairobi, Kajiado, and Embu counties in Kenya.\n\u00b7\tPrimary school teachers teaching English and Mathematics.\n\u00b7\tPrimary school teachers teaching grades 5, 6, and 8.\n\u00b7\tMale and female primary school teachers (to include different gender perspectives).\n\nExclusion criteria\n\u00b7\tPrimary school teachers who have a known history of cognitive or mental impairment that could affect their ability to provide accurate responses.\n\u00b7\tPrimary school teachers who are currently on leave or are expected to be absent during the data collection period.\nPrimary school teachers who are not currently employed as full-time primary school teachers (they may not have the same level of experience and exposure to the current teaching practices and assessments as full-time teachers).","coll_mode":"Face-to-face [f2f]","research_instrument":"Teacher questionnaire which was used to collect data on teacher perception on tests and how they affect their delivery in the classroom.","act_min":"Each of the 3 study sites had a field supervisor in charge of logistics, ensuring quality checks, and reporting back to the research team at APHRC. Furthermore, 2 of the project research team members at APHRC were in charge of the overall data collection. They provided technical support and overall oversight of data collection and backstopping while in the field. The team leads also held weekly briefing sessions with the APHRC research team to share the progress of data collection and any challenges from the field\nTo ensure high-quality data collection, the research team accompanied the teams in the field during data collection.\nThe data analyst  run the data daily to check on completeness, correctness and consistency on 100% of the collected data. A discrepancy report were then generated to enable resolution of any inconsistencies or errors in the data with the responsible interviewer.","cleaning_operations":"Data quality monitoring processes and checks were implemented throughout the data collection process, during the time of developing the data collection tools (through built-in quality control in the tablet-based platform), during training of fieldworkers using mock interviews and inter rater reliability tests (IRR), in real time during data collection (routine monitoring by the research team and periodic cross-checks against the protocols), and during the data cleaning process. During fieldwork, data quality was enhanced through regular spot checks and sit-ins by supervisors to verify the authenticity of data collected. Data were then reviewed and certified by the field coordinator before they were transferred to the server.\n\nThe quantitative data were collected using SurveyCTO, a survey platform for electronic data collection that has in-built skips and quality checks. Using this software increased efficiency and reduced the time needed for cleaning the data. In addition, the platform supported offline data capturing for regions with slow or no internet connectivity and data transmission when the internet became available. Fieldwork was conducted by trained fieldworkers using digital tablets with the questionnaire loaded in SurveyCTO. Data was uploaded from the tablets onto a secure African Population and Health Research Center (APHRC) server after each day of data collection. Data were synchronized automatically to a server when the tablet was in a location with network coverage. The uploaded data were then checked for quality daily by a data manager and a team dedicated to coordinate field procedures and at the APHRC head office in Nairobi."},"analysis_info":{"sampling_error_estimates":"N\/A"}},"data_access":{"dataset_use":{"contact":[{"name":"African Population and Health Research Center","affiliation":"","email":"datarequests@aphrc.org\/info@aphrc.org","uri":"aphrc.org"}],"cit_req":"Use of the dataset must be acknowledged using a citation which would include:\n- the Identification of the Primary Investigator\n- the title of the survey (including country, acronym and year of implementation)\n- the survey reference number\n- the source and date of download","conditions":"APHRC data access condition\n\nAll non-APHRC staff seeking to use data generated at the Center must obtain written approval to use the data from the Director of Research.\nThis form is developed to assess applications for data use and facilitate responsible sharing of data with external partners\/collaborators\/researchers. By entering into this agreement, the undersigned agrees to use these data only for the purpose for which they were obtained and to abide by the conditions outlined below:\n\n1.Data Ownership:\nThe data remain the property of APHRC; any unauthorized reproduction and sharing of the data is strictly prohibited. The user will, therefore, not release nor permit others to use or release the data to any other person without the written authorization from the Center.\n\n2.Purpose:\nThe provided data must be used for the purpose specified in the Data Request Form; any other use not specified in the form must receive additional or separate authorization.\n\n3.Respondent Identifiers:\nThe Center is committed to protecting the identity of the respondents who provide information in its research. All analytical data sets (both qualitative and quantitative) released by the Data Unit MUST are stripped of respondent identifiers to protect the identity of the respondents. By accepting to use APHRC data, the user is pledging that he\/she will not, under any circumstance, regenerate the identifiers or permit others to use the data to learn the identity of any individual, household or community included in any data set.\n\n4.Confidentiality pledge:\n The user will not use nor permit others to use the data to report any information in the data sets that could identify, directly or by inference, individuals or households.\n \n5.Reporting of errors or inconsistencies:\nThe user will promptly notify the Head of the Statistics and Survey Unit any errors discovered in the data as soon as the errors are discovered.\n\n6.Publications resulting from APHRC data:\nThe Center requires external collaborators to work with APHRC staff on all publications resulting from its data. In order to facilitate this, lead authors should send a detailed concept note of the paper (including the background, rationale, data, analytical methods, and preliminary findings) to the Principle Investigator (or Theme Leader) for the project (with a copy to the Director of Research), who will circulate the abstract to concerned researchers for possible expression of interest in participating in the publication as co-authors. Any exception to the involvement of APHRC staff should be approved by the Director of Research, APHRC.\n\n7.Security:\nThe user will take responsibility for the security of the data by ensuring that the data are used and stored in a secure environment where access is password protected. This will ensure that non-authorized people should not have access to the data.\n\n8.Loss of privilege to use data:\n In the event that APHRC determines that the data user is in violation of the conditions for using the data, or if the user wishes to cancel this agreement, the user will destroy the data files provided to him\/her. APHRC retains the right to revoke this agreement or informs publishers to withhold publication of any work based wholly or in part on its data if the conditions for using the data are violated.\n\n9.Acknowledgement:\nAny work\/reports from this data must acknowledge APHRC as the source of these data. For example, the suggested acknowledgement for NUHDSS data is:\n\"This research uses livelihoods data collected under the longitudinal Nairobi Urban Health and Demographic Surveillance System (NUHDSS) since 2006. The NUHDSS is carried out by the African Population and Health Research Center in two slums settlements (Korogocho and Viwandani) in Nairobi City.\"Additionally all funders, the study communities that provided the data, and staff who collected and analyzed or processed the data should be acknowledged.\n\n10.Deposit of Reports\/Papers:\nThe user should submit electronic and paper copies of all publications generated using APHRC data to the Policy Engagement and Communications Department, with copies to the Director of Research.\n\n11.Change of contact details:\nThe user will promptly inform the Director of Research of any change in your personal details as contained on this data request form.","disclaimer":"The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses."}}}}