Demonstration: ratings are saved only in this browser and are not included in the study.
Term evaluation
Sign in with the email address you registered. For your first sign-in, use the starter password in the invitation email. You will then choose your own password.
For help, contact the organizer through the group website.
Choose your password
Choose a password with at least 8 characters. Use this password for future sign-ins.
Before you begin
This study evaluates Sanskrit-based technical terminology. For each concept, you will see an English definition and a list of proposed Sanskrit terms.
- Read the definition and indicate how familiar you are with the concept.
- Rate every proposed term for Accuracy and Understandability, using the definitions below. Rate similar spellings separately.
- Use Cannot judge for either rating if you cannot assess it. You can give one rating and choose Cannot judge for the other.
- Select Save and next after completing the ratings for a concept. You can take breaks and resume later.
Accuracy: How well does the term express the concept in the definition?
Understandability: How easy would the term be for a learner with basic Sanskrit knowledge to understand when introduced with this definition?
Use 1 (very poor), 2 (poor), 3 (moderate), 4 (good), or 5 (very good). All terms for a concept may receive low scores, high scores, or the same score. Rate each term separately; you do not need to rank the terms or use every score on the scale.
We ask you to complete 100 concepts. Further concepts are optional. This task is unpaid and voluntary; you may stop at any time. We estimate 5–10 hours for 100 concepts, spread across several sessions.
Acknowledgment: Participants who complete ratings for at least 100 concepts will be eligible for acknowledgment in resulting publications or project materials, with their permission. Contributions below this threshold may not qualify for acknowledgment.
We will use your ratings for research and may report them in publications under a participant ID. Your name and email will not be published with your ratings. For questions or to request withdrawal, contact the organizer through the group website.
Please complete 100 concepts. Further concepts are optional. You can stop and resume later.
Instructions and rating guide
- Read the definition and indicate how familiar you are with the concept.
- Rate every term for Accuracy and Understandability, including terms with similar spellings. All terms for a concept may receive low scores, high scores, or the same score. You do not need to rank the terms or use every score on the scale.
- Use Cannot judge for either rating if you cannot assess it.
- Select Save and next to submit the concept and continue. To pause partway through a concept, select Save draft and wait for Draft saved before signing out.
- Use Skip this concept to save a draft and move the concept to the end of all 289 concepts. It remains unfinished and still belongs to its original target or optional set. The deferred order is remembered in this browser only.
Accuracy: How well does the term express the concept in the definition?
Understandability: How easy would the term be for a learner with basic Sanskrit knowledge to understand when introduced with this definition?
1 = very poor · 2 = poor · 3 = moderate · 4 = good · 5 = very good.
This task is unpaid and voluntary. You may stop at any time.
Acknowledgment: Participants who complete ratings for at least 100 concepts will be eligible for acknowledgment in resulting publications or project materials. Contributions below this threshold may not qualify. Your permission will be sought before naming you.
No concepts assigned yet
Please contact the organizer.
Rating progress
Sanskrit terminology evaluation
Evaluations per term
Number of terms with 0, 1, 2, 3, 4, or at least 5 submitted evaluations.
Term counts
Counts include submitted concepts only. “Cannot judge” responses are listed separately. A term produced by several models is counted once per annotator.
| Concept | Term | Evaluations | Accuracy | Understandability | Assigned in first 100 |
|---|
Accounts
Manager access applies to this terminology task. Managers can view rating counts. Only administrators can grant or remove manager access.
| Account | Status | Manager access | Target concepts completed |
|---|