A guide of processes and best practices for inspector general committee members.

The role consists of a monthly cycle through 4 phases:

  1. Conducting monthly evaluations for guilds.
  2. Finalizing and publishing the monthly report.
  3. Revising the system based on observation, feedback, discussions, and roadmap.
  4. Publishing revisions to the Guidelines.

Conducting Regular Evaluations

This phase of work consists of preparing the guild report and evaluating each of the candidates using the standard score card. To prepare for the evaluations:

  1. Make sure to update the template to include the current month's Guild Updates and Score Sheet.
    1. Depending on how the Guidelines have evolved, you may need to adjust the rows in the score sheet or scoring formulas.
  2. Copy each new section from the template and paste it into all of the guild records. There should be an Updates section and Score Sheet section for each monthly period.
    1. (TODO: automate this using Notion API)
  3. Clear out the scores for last month under "Total" so that it's apparent which guilds have been rated this month.
  4. Pull in any guild updates submitted to [email protected] mailing list - these can be added to the Guild Updates section and new information can be reflected in the guild's score.
  5. Ensure each inspector's Calendly / calendar link is public and allows meetings to be booked for 1 week out of each month.

After preparing the Guild Ratings pages, the next step is to go line by line through the Score Sheet, tallying each guild's score in the score sheet. Public endpoints need to be tested again each month and can be double checked against other validation tools. It is the IG's responsibility to make sure each item is reviewed and not just copy points over from the previous month. Getting the report accurate on the first pass reduces the amount of follow up work needed in the appeals period and improves Guild UX.

Tech Tips for Testing Guilds

Testing RPC