The Rater Agreement
Although the overall intra-rated and inter-rated agreement was high in the current study, the reliability of the Charter`s action data remained below 100%. This means that there may be misclassification during data collection, which can lead to a distortion of the zero hypothesis (type II error) of the intervention study. One way to overcome this potential problem is to get a sufficient sample size. Future evaluations of Charter action may include regression modelling to examine heterogeneity in Kappa`s statistics and the impact of potential explanatory factors on the likelihood of agreement. Methods such as the Liang and Zeger General Estimation Equation (EEG)  are considered useful for matching in councils using multi-center cluster designs that collect data over several periods. Based on the elements contained in the current study, possible covariates for the study may include the number of abstractions involved, differences in the elements or categories of Traction of the Charter, and the length of time between abstractions. To date, we have reported results on rate reliability and the number of divergent assessments within and between subgroups, using two different but equally legitimate reliability estimates. We also looked at factors that could influence the likelihood of obtaining two statistically divergent ratings and described the magnitude of the differences observed. These analyses focused on reliability and consistency between councils, as well as related measures. In this last section, we look to the Pearson correlation coefficient to study the linear relationship between ratings and their strength within and between rate subgroups. The Primary Asthma Care Project (PCAPP) was a community-based participatory study funded by the Ontario Ministry of Health and Long-Term Care. Pcapp was launched in 2003 to determine whether the use of an evidence-based asthma care program (CPA) would lead to improved asthma care and outcomes for patients from 15 satellite clinics in eight local communities across Ontario.
The patients included in the PCAPP were patients aged 2 to 55 years with mild to moderate asthma. The satellite clinics included eight municipal health centres, a rural family health team, a group health centre and an Aboriginal access centre. PCAPP participants agreed that their medical charts were audited four times to measure the treatment process related to the implementation of ACP countries. Ten different researchers carried out graphic abstraction on the different sites, so it was important to ensure that over time, data was collected consistently on each participating site (internal reliability) and on all sites (interrater-reliability). Although collected by several abstractions, the results show a high sensitivity and specificity and an essential inter-rater and intra-rater agreement, which guarantees confidence in the use of Charter action for the evaluation of ACP countries. In summary, this report has two main objectives: to create a methodological tutorial to assess the reliability, correspondence and linear correlation of evaluation pairs and to assess whether the German parental questionnaire ELAN (Bockmann and Kiese-Himmel, 2006) can be reliably used with Kita teachers to evaluate the development of early expressive vocabulary. We compared mother-father and parent-teacher evaluations in terms of agreement, correlation and reliability of evaluations. We also looked at the factors related to children and advice that influence the adequacy and reliability of advice. In a relatively homogeneous group of predominantly middle-class families and high-quality kite environments, we expected high matching and a linear correlation of assessments. The diagram cut-off shape and sample portion of a fictitious medical diagram used to assess the reliability of inter-advisors.