Shiksha Awards FaQ's

Shiksha Awards Ranking and Scoring (Link)

Summary : 

Project : Shiksha Awards Tracking

Request from : School Success Team

Business Spoc : Dinesh Reddy, Ankit Lakra

L1 : Loluck Baby, Vibhanshu Pratap Singh 

Analytics Spoc : Phani Srinivas

Escalation matrix : 

L0 : Customer Support Team 

L1 : Jeswin James & Yogesh Kumar

L2 : Dinesh Reddy & Ankit Lakra

L3 : Phani Srinivas

QC Status: Complete

1. Analytics Spoc : Phani Srinivas  (4th Aug)
2. Business Spoc : Ankit Lakra & Dinesh Reddy (6th & 7th Aug)
3. Copilot QC : Phani Srinivas (11th Aug)
   
   

Approach : 

All one list schools that have primary product Lead, Pinnacle or Propel, and are serviceable (i.e. they are not ECS or Curriculum only) are eligible to participate in Shiksha Awards for Lead Techbook, Lead, Propel & Pinnacle. The schools have been divided into four Product categories. Each school can fall into exactly one of the four product categories.

1. Techbook: All schools part of Base One List with Techbook billed in any one class subject 
2. Lead: All schools part of Base One List, whose primary product is Lead, and who have no classes subjects billed as Techbook.
3. Pinnacle: All schools part of Base One List, whose primary product is Pinnacle, and have no classes subjects billed as Techbook.
4. Propel: All schools part of Base One List, whose primary product is Propel, and have no classes subjects billed as Techbook.

Additionally the schools within each category are also segmented by School Size, depending on the net billed sparks [computed on Individual school basis]. A school can fall into one of the five following categories:

1. 1000+: schools that have more than 1000 billed sparks.
2. 601-1000: schools that have more than 600, and less than or equal to 1000 billed sparks.
3. 401-600: schools that have more than 400, and less than or equal to 600 billed sparks.
4. 200-400: schools that have more than or equal to 200, and less than or equal to 400 billed sparks.
5. Less than 200: schools that have less than 200 billed sparks.

 

Note: In case of techbook schools also, the overall sparks count is considered for this segmentation, and not just techbook sparks.

 

For Propel Schools, the segmentation is as follows:

1. 1000+: schools that have more than 1000 billed sparks.
2. 501-1000: schools that have more than 500, and less than or equal to 1000 billed sparks.
3. 251-500: schools that have more than 250, and less than or equal to 500 billed sparks.
4. Less than 250: schools that have less than or equal to 250 billed sparks.

 

Logic for calculating Billed Sparks:

• For a given class, if STEK is billed, we consider sparks count of STEK.
• For a given class, if only Addon is billed, we consider sparks count of Addon.
• For a given class, if both STEK and Addon are billed, we consider only sparks count of STEK.
• Returns are accounted for.

Note: Billed Sparks in Shiksha will differ from the sparks count on SOA. (As SOA does not consider Addon only classes.)

Ranking  & Geotagging :  

 

• For national ranking, schools compete with other schools in the same Product and same School Size. 

 

• For zonal ranking the schools compete with other schools within the same product category & same zone but school size is not considered in this ranking. 

 

• For State ranking, schools compete with other schools in the same Product and State (or Cluster State, if applicable as described below), irrespective of School Size.

 

Schools have been divided into five Zones based on their state (As tagged in hubspot).

 

For Propel, the two South Zones have been combined into a single South zone, and Jammu and Kashmiri is considered in the East Zone instead of the North. This Zonal division is present in the Combined Zone column on copilot.

State mapping for zonal ranking as follows : 

 

Zone	States
West	Rajasthan, Gujarat, Maharashtra, Madhya Pradesh, Chhattisgarh, Goa
South1	Andhra Pradesh, Telangana, Odisha
South2	Karnataka, Tamil Nadu, Kerala, Puducherry
East	Assam, Mizoram, Manipur, Arunachal Pradesh, Meghalaya, Tripura, Nagaland, Sikkim, Jharkhand, West Bengal
North	Bihar, Delhi, Haryana, Himachal Pradesh, Jammu and Kashmir, Punjab, Uttarakhand, Uttar Pradesh

 

For State ranking, some states which have very few schools have been combined as follows:

1. Arunachal Pradesh, Nagaland, Mizoram and Manipur have been combined into a single state called ‘NE1’
2. Meghalaya and Sikkim have been combined into ‘NE2’
3. Maharashtra and Goa have been combined into ‘MH+Goa’

 

Details of this are present in the Cluster State column on the Shiksha dashboard

Additionally, schools from Sikkim, Nagaland, Manipur, Meghalaya and Jammu and Kashmir, are considered as early start schools, which have been flagged as 1 in the Early Start column on Copilot. These schools have a slightly different scoring system for monthly and weekly criteria

 

Scoring criteria & Methodology : 

 

Lead Schools are scored on the following criteria:

1. Implementation (CRL Casting) (Weekly) 
2. RRR/CO (Monthly)
3. Student App Usage (Weekly)
4. SLC/SLM events (YTD) 
5. LGA Course Completion (YTD) 

 

Pinnacle Schools are scored on the following criteria:

1. Implementation (CRL Casting) (Weekly)
2. Student App Usage (Weekly)
3. SLC/SLM events (YTD)
4. LGA Course Completion (YTD)

 

Techbook Schools are scored on the following criteria:

1. Implementation (CRL Casting) (Weekly)
2. RRR/CO (Monthly)
3. Student App Usage (Weekly)
4. SLC/SLM events (YTD)
5. LGA Course Completion (YTD)
6. ARI Casting by Teachers (in Math and EVS subjects) (Monthly)
7. PIE Usage by students (in Techbook grades) (Weekly)
8. IRA Usage by students (in Techbook grades) (Weekly)
9. ARI Usage by students (in Techbook grades) (Monthly)

Propel Schools are scored on the following criteria:

1. Implementation (CRL Casting) (Weekly)
2. Assessment Creation on Teacher App (YTD)
3. LLC/LLM events (YTD)
4. LGA Course Completion (YTD)

 

Scores across all the individual metrics are added up to calculate the final score for the school. Schools with the highest score receive a rank of 1. In case two schools are competing against each other and receive the same final score, then the tie is broken by considering the individual metric scores in the same order as mentioned above. If scores across all the metrics are also same, then the two schools receive the same rank.

 

Details of the criteria & Point scoring : 

Implementation (CRL Casting)

Implementation is calculated as follows:

(No. of class subjects in the school where teacher has cast for at least two days in a week) / (total number of class subjects in the school)

 

Note: Principals are excluded from this metric. Only those ACs with some class subject assigned are considered. Class 9 and 10 are excluded. CCS is excluded. All non-CCS subjects until Class 8 are considered. 

Only those weeks are considered where the school has at most 2 holidays marked in the academic calendar in that week. If there are more than 2 holidays in that week, CRL casting for that week is not considered. Since in implementation tracking on copilot considers Class 9 & 10 when evaluating overall implementation, there will be this difference between what we see in Shiksha vs Portfolio monitoring

The implementation percentage across all weeks is then ranked and the best 14 weeks are considered for Techbook, Lead and Pinnacle & 12 weeks in case of Propel [8 weeks in case of early start schools across all Products (identification defined above)]. 

 

• If implementation is greater than or equal to 80% in a week, the school receives 1000 points. (1750 for early start, 1500 for early start Propel)
• If implementation is greater than or equal to 50%, but less than 80% in a week, the school receives 500 points. (875 for early start, 750 for early start Propel)
• Zero points for all other weeks.

 

Schools, including early start, can score at max 14000 points in this metric (12000 in case of Propel Schools). Point scaling for early start schools is incorporated. 

 

RRR/CO

RRR/CO is calculated only for Lead school teachers, and is only applicable for Lead and Techbook Schools. If a school has Lead as primary product, but a different product in other sub schools, teachers from the other sub schools are not considered for this metric. For this reason, there may be differences between Shiksha & Portfolio monitoring

 

Score is calculated as follows:

(No. of Lead teachers who have completed at least 2 RRRs on two different days and at least 1 CO in a given calendar month) / (Total number of Lead teachers in the school)

 

Note: Teachers must satisfy both RRR and CO criteria within the same month to be counted.

 

The RRR/CO percentage is then ranked and the best 3 months are considered. (2 months in case of early start schools). 

 

• If RRR/CO is greater than or equal to 70% in a month, the school receives 2000 points. (3000 for early start)
• If RRR/COis greater than or equal to 50%, but less than 70% in a month, the school receives 1000 points. (1500 for early start)
• Zero points for all other months.

 

Schools, including early start, can score at max 6000 points in this metric. Point scaling for early start schools is incorporated. 

SLC/SLM

Schools receive points for conducting parent facing events as follows:

 

For Lead, Pinnacle and Techbook Schools :

 

• Any SLC/SLM or Sankalp Events conducted are considered. For conducting one of these events, they receive 5000 points. If they have conducted more than one of these events, they receive 6000 points.

 

Therefore, Lead, Pinnacle and Techbook schools can score at max 6000 points in this metric. 

 

For Propel schools : 

• Any LLC/LLM Events conducted are considered. For conducting one of these events, they receive 6000 points. If they have conducted more than one of these events, they receive 8000 points. Therefore, Propel schools can score at max 8000 points in this metric.

 

This is captured basis App Sheet inputs.

LGA Course Completion

 

For Techbook, Pinnacle & Lead : 

 

• LGA Course Completion Percentage is calculated as follows: (No. of Teachers in the school who have completed at least 38 courses on LGA) / (Total no. of teachers in the school who have LGA courses tagged against them) 

Additionally, for Lead, Pinnacle and Techbook schools, if at least one Principal/AC has completed at least 38 courses on LGA, the school receives an additional 1000 points bonus.

Note: Principals and ACs are not accounted for in calculating LGA course completion percentage. This tagging is as per nucleus

For Propel Schools, the threshold number of courses is 20.

• If the LGA completion percentage is greater than or equal to 50%, the school receives 5000 points.
• If the LGA completion percentage is greater than or equal to 40%, but less than 50% the school receives 4000 points.
• If the LGA completion percentage is greater than or equal to 30%, but less than 40% the school receives 3000 points.
• If the LGA completion percentage is greater than or equal to 20%, but less than 30% the school receives 2000 points.
• If the LGA completion percentage is greater than or equal to 10%, but less than 20% the school receives 1000 points.
• Otherwise the school receives no points.

The schools can score at max 6000 points in this metric. (5000 in case of Propel as they receive no bonus points.)

Student App Usage

Student App Usage Percentage is computed only for Techbook, Lead and Pinnacle schools calculated as follows:

(No. of students who have logged in to student app and completed any one activity on it in a given week i.e a Learner) / (Total number of students in the school, i.e. net billed sparks)

This percentage is then ranked and the best 14 weeks are considered. (8 weeks in case of early start schools). The schools receives points against each week as follows:

• If student app usage percentage is greater than or equal to 70%, the school receives 500 points. (875 points for early start schools)
• If student app usage percentage is greater than or equal to 50%, but less than 70%, the school receives 200 points. (350 points for early start schools)
• Zero points for all other weeks.

Schools, including early start, can score a maximum of 7000 points for this metric. 

Additionally, for only Techbook schools, 4 other metrics related to app usage are calculated - 

1. IRA Usage:

IRA Usage Percentage is calculated as follows:

(No. of students who have completed at least one IRA activity in the given week) / (Total no. of techbook sparks in the school)

This percentage is then ranked and the best 14 weeks are considered. (8 weeks in case of early start schools). The schools receives points against each week as follows:

• If IRA usage percentage is greater than or equal to 50%, the school receives 500 points. (875 points for early start schools)
• If IRA usage percentage is greater than or equal to 30%, but less than 50%, the school receives 200 points. (350 points for early start schools)
• Zero points for all other weeks.

Schools, including early start, can score a maximum of 7000 points for this metric.

1. PIE Usage:

PIE Usage Percentage is calculated as follows:

(No. of students who have completed at least one PIE activity in the given week) / (Total no. of techbook sparks in the school)

This percentage is then ranked and the best 14 weeks are considered. (8 weeks in case of early start schools). The schools receives points against each week as follows:

• If PIE usage percentage is greater than or equal to 50%, the school receives 500 points. (875 points for early start schools)
• If PIE usage percentage is greater than or equal to 30%, but less than 50%, the school receives 200 points. (350 points for early start schools)
• Zero points for all other weeks.

Schools, including early start, can score a maximum of 7000 points for this metric.

1. ARI Student Usage:

This metric is calculated month-wise. ARI Student Usage percentage is calculated as follows:

(No. of students who have completed at least one ARI activity on the student app in the given week) / (Total no. of techbook sparks in the school).

This percentage is then ranked and the best 3 months are considered. (2 months in case of early start schools). The schools receives points against each week as follows:

• If ARI student usage percentage is greater than or equal to 50%, the school receives 500 points. (750 points for early start schools)
• If ARI student usage percentage is greater than or equal to 50%, but less than 30%, the school receives 200 points. (300 points for early start schools)
• Zero points for all other weeks.

Schools, including early start, can score a maximum of 1500 points for this metric.

1. ARI Usage:

This metric is calculated month-wise. ARI Usage percentage is calculated as follows:

(No. of class subjects where ARI resource was cast at least twice in the given month) / (Total no. of ARI class subjects in the school)

Note: This metric is calculated only for Maths and EVS subjects.

This percentage is then ranked and the best 3 months are considered. (2 months in case of early start schools). The schools receives points against each week as follows:

• If ARI usage percentage is greater than or equal to 50%, the school receives 500 points. (750 points for early start schools)
• If ARI usage percentage is greater than or equal to 50%, but less than 30%, the school receives 200 points. (300 points for early start schools)
• Zero points for all other weeks.

Schools, including early start, can score a maximum of 1500 points for this metric.

Teacher Ranking

Teachers, as mapped on Nucleus, from Techbook, Lead and Pinnacle schools compete in their respective product categories at National Level. CCS Teachers compete separately among each other. (Refer to the Bracket column on copilot for the segmentation.)

School Size, Zone and State are not considered for teachers. There is only one national ranking segmented by Product. 

Note: ACs who have at least one class subject assigned to them are also considered for the Shiksha Teacher Awards. Principals are not eligible.

Teachers are judged according to two criteria:

1. Implementation (CRL Casting) (Weekly)
2. LGA Course Completion (YTD)

Implementation (CRL Casting)

Implementation for teacher is calculated as follows:

(No. of class subjects in the school where teacher has cast for at least two days in a week) / (total number of class subjects assigned to the teacher)

Note: Principals are excluded from this metric. Only those ACs with some class subject assigned are considered. Class 9 and 10 are excluded. CCS is excluded. All non-CCS subjects until Class 8 are considered. 

Only those weeks are considered where the school has at most 2 holidays marked in the academic calendar in that week. If there are more than 2 holidays in that week, CRL casting for that week is not considered. Since in implementation tracking on copilot considers Class 9 & 10 when evaluating overall implementation, there will be this difference between what we see in Shiksha vs Portfolio monitoring

The implementation percentage across all weeks is then ranked and the best 14 weeks are considered [8 weeks in case of early start schools across all Products (identification defined above)]. 

• If implementation is greater than or equal to 80% in a week, the teacher receives 1000 points. (1750 for early start)
• If implementation is greater than or equal to 50%, but less than 80% in a week, the teacher receives 500 points. (875 for early start)
• Zero points for all other weeks.

Teachers, including in early start schools, can score at max 14000 points in this metric. Point scaling for early start schools is incorporated. 

For CCS Teachers, implementation is calculated as follows:

(No. of class subjects in the school where teacher has cast for at least two days in a month) / (total number of class subjects assigned to the teacher)

 

The implementation percentage across all months is then ranked and the best 3 months are considered [2 months in case of early start schools across all Products (identification defined above)]. 

 

• If implementation is greater than or equal to 80% in a month, the teacher receives 5000 points. (7500 for early start)
• If implementation is greater than or equal to 50%, but less than 80% in a week, the teacher receives 2000 points. (3000 for early start)
• Zero points for all other weeks.

 

CCS Teachers, including in early start schools, can score at max 15000 points in this metric. Point scaling for early start schools is incorporated. 

LGA Course Completion

LGA Course Completion Percentage for teacher is calculated as follows: 

(No. of courses completed on LGA) / (Total no. of courses tagged against the teacher on LGA) 

• If the LGA completion percentage is greater than or equal to 50%, the teacher receives 5000 points.
• If the LGA completion percentage is greater than or equal to 40%, but less than 50% the teacher receives 4000 points.
• If the LGA completion percentage is greater than or equal to 30%, but less than 40% the teacher receives 3000 points.
• If the LGA completion percentage is greater than or equal to 20%, but less than 30% the teacher receives 2000 points.
• If the LGA completion percentage is greater than or equal to 10%, but less than 20% the teacher receives 1000 points.
• Otherwise the teacher receives no points.

The teacher can score at max 5000 points in this metric.

Frequently Asked Questions:-