Class Resources

COURT PERFORMANCE STANDARDS

CourTools Bibliography: Introduction and Core Resources
Unit 1: Why Measure Performance?
Unit 2: Overview of the Court Performance Standards (CPS): CourTools
Unit 3: CourTool Measures and Real Court Results
Unit 4: Court Culture & Change Management
Unit 5: Implementing Performance Measurement Using CourTools
Unit 6: Court Myths & What Does the Data Mean?
Unit 7: Measuring Results with CourTools
Unit 8: Putting It All Together
Internet Resources: Organizations

Introduction and Core Resources

“CourTools is a set of ten trial court performance measures that offer court managers a balanced perspective on court operations.” – Future Trends in State Courts 2006

Case Processing Time Standards. National Center for State Courts, Knowledge and Information Services.
- http://www.ncsconline.org/cpts/cptsType.asp
CourTools. National Center for State Courts, Research Division.
- http://www.ncsconline.org/D_Research/CourTools/index.html
CourTopics: Performance Measurement. National Center for State Courts, Knowledge and Information Services.
- http://www.ncsc.org/Topics/Court-Management/Performance-Measurement/Resource-Guide.aspx
Core Competencies Curriculum Guidelines. National Association for Court Management.
- http://www.nacmnet.org/CCCG/cccg_CoreCompetencies.html
Future Trends in State Courts. National Center for State Courts, Knowledge and Information Services.
- http://www.ncsconline.org/D_KIS/Trends/index.html
Steelman, David C., John A. Goerdt, and James E. McMillan. Caseflow Management: The Heart of Court Management in the New Millennium. Williamsburg, VA: National Center for State Courts, 2000. (Available in the NCSC Library.)
TCPS. Trial Court Performance Standards and Measurement System. National Center for State Courts, Research Division.
- http://www.ncsconline.org/D_Research/tcps/index.html
Tobin, Robert W. An Overview of Court Administration in the United States. Williamsburg, VA: National Center for State Courts, 1997.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1249
Tobin, Robert W. Creating the Judicial Branch: The Unfinished Reform. Williamsburg, VA: National Center for State Courts, 2004.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1249
National Center for State Courts.
- http://www.ncsc.org/
- The mission of NCSC is to improve the administration of justice through leadership and service to state courts, and courts around the world. Through original research, consulting services, publications, and national educational programs, NCSC offers solutions that enhance court operations with the latest technology; collects and interprets the latest data on court operations nationwide; and provides information on proven "best practices" for improving court operations. To contact Knowledge and Information Services, please call 800-616-6164. To contact the Institute for Court Management, please call 800-616-6160.

TOP

Unit 1 – Why Measures Performance?

“Performance measurement is not an end in itself. So, why should public managers measure performance? Because they may find such measures helpful…to evaluate, control, budget, motivate, promote, celebrate, learn, and improve.” – Robert Behn, Harvard University

Behn, Robert D. “Why Measure Performance? Different Purposes Require Different Measures.” 63 Public Administration Review 5 (2003): 586. (Available in the NCSC Library.)
Buckingham, Marcus and Curt Coffman. First, Break All the Rules: What the World’s Greatest Managers Do Differently. New York: Simon and Schuster, 1999. (Available in the NCSC Library.)
Brown, Mark G. Keeping Score: Using the Right Metrics to Drive World-Class Performance. New York: Quality Resources, 1996.
Chang, Richard Y., and Mark W. Morgan. Performance Scorecards: Measuring the Right things in the Real World. San Francisco, CA: Jossey-Bass, 2000
Conference of Chief Justices: Resolution 3: In Support of Strengthening Court Oversight and Performance in Child Abuse and Neglect Cases. Adopted at the Mid-Year meeting in Scottsdale, AZ. 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/famct&CISOPTR=261
Conference of Chief Justices: Resolution 14: In Support of Measuring Court Performance. Adopted by CCJ/COSCA at the 57^th Annual Meeting on August 3, 2005.
- http://ccj.ncsc.dni.us/CourtAdminResolutions/resol14MeasuringCourtPerformance.html
Conference of Chief Justices: Resolution 23: In Support of Principles of Effective Judicial Governance and Accountability. Adopted by CCJ at the 27^th Midyear Meeting on January 21, 2004.
- http://ccj.ncsc.dni.us/CourtAdminResolutions/resolJudicialGovandAccountabilityJan2004.html
Conference of State Court Administrators: Position Paper on Effective Judicial Governance and Accountability. Arlington, VA: National Center for State Courts, Government Relations Office, 2001.
- http://cosca.ncsc.dni.us/WhitePapers/judgovwhitepapr.pdf
Goldkamp, John, S., Doris Weiland, and Cheryl Irons-Guynn. Developing an Evaluation Plan for Community Courts: Assessing the Hartford Community Court Model. Washington, DC: U.S. Department of Justice, Office of Justice Programs, Bureau of Justice Assistance, Crime and Justice Research Institute, 2001.
- https://www.ncjrs.gov/txtfiles1/bja/185689.txt
Greacen, John M. “An Administrator’s Perspective: Developing Performance Measures for Trial and Appellate Courts.” 41 Judges Journal 2, (2002): 40. (Available in the NCSC Library.)
Holding Courts Accountable: Counting What Counts. Williamsburg, VA: National Association for Court Management, 1999. (Available in the NCSC Library.)
How To Assess Quality in the Courts: Quality Benchmarks for Adjudication are a Means for the Improvement of the Activity of the Courts, The Court of Appeal of Rovaniemi, Finland, 2006.
- http://www.oikeus.fi/uploads/6tegx.pdf
Kaplan, Robert S., and David P. Norton. “The Balanced Scorecard: Measures That Drive Performance,” Harvard Business Review, (January-February 1992): 71-79.
Keilitz, Ingo. “Top Ten Reasons for Performance Measurement: September 26, 2005.” Made2Measure.
- http://made2measure.blogspot.com/2005/09/top-10-reasons-for-performance.html
Keilitz, Ingo. “Ten Reasons Not to Measure Court Performance.” Made2Measure.
- http://made2measure.blogspot.com/2008/11/ten-reasons-not-to-measure-court.html
Link, Angela Marie. Assessing the Utility of the Trial Court Performance Standards for the Austin Municipal Court. Austin, TX: University of Texas at Austin, 2001. (Available in the NCSC Library.)
Neumann, Peter J. Using Cost-Effectiveness Analysis to Improve Health Care Opportunities and Barriers. New York: Oxford University Press, 2004
Schauffler, Richard Y. “Judicial Accountability in the US State Courts: Measuring Court Performance.” 3 Utrecht Law Review 1 (June 2007):112.
- http://www.utrechtlawreview.org/publish/articles/000040/article.pdf
“The Struggle to Measure Performance.” Business Week (January 9, 2006).
- http://www.businessweek.com/print/magazine/content/06_02/b3966060.htm?chan=gl
Trial Court Performance Standards and Measurement System Program Brief. U.S. Department of Justice, Washington, D.C., 1997.
- http://www.ncjrs.gov/txtfiles1/161569.txt

TOP

Unit 2 – Overview of the Court Performance Standards (CPS): CourTools

CourTools is a set of ten trial court performance measures that offers court managers a balanced perspective on court operations. –National Center for State Courts, CourTools

Access to Justice Through the Use of Court Tools and Online Resource Links. Olympia, WA: Administrative Office of the Courts, 2007. (Available in the NCSC Library on CD-ROM.)
Babb, Barbara A. Performance Standards and Measures for Maryland’s Family Divisions. Annapolis, MD: Maryland Judiciary, 2002. (Available in the NCSC Library.)
Burke, Judge Kevin and Judge Steve Leben. Procedural Fairness: A Key Ingredient in Public Satisfaction: A White Paper of the American Judges Association. Williamsburg, VA: American Judges Association, 2007.
- http://aja.ncsc.dni.us/htdocs/AJAWhitePaper9-26-07.pdf
Goerdt, J. A., C. Lomvardias, and G. Gallas. Examining Court Delay: The Pace of Litigation in 26 Urban Trial Courts. Williamsburg, VA: National Center for State Courts, 1989.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=11
Goodman, M. L. “Effective Case Monitoring and Timely Dispositions: The Experience of One California Court.” Judicature 76 (1993): 254. (Available in the NCSC Library.)
Hall, Dan et al. Court Performance Measurement Systems - From Vision to Reality. Seattle, WA: Ninth National Court Technology Conference, 2005.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=836
Hanson, Roger A. Appellate Court Performance Standards and Measures. Williamsburg, VA: National Center for State Courts, 1999.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/appellate&CISOPTR=56
Keilitz, I. “Standards and Measures of Court Performance.” Criminal Justice 2000, Volume 4, Measurement and Analysis of Crime and Justice. Washington, DC: U.S. Department of Justice, Office of Justice Programs, National Institute of Justice, July 2000, 559-593.
- http://www.ncjrs.org/criminal_justice2000/vol_4/04k.pdf
Keilitz, Ingo. Family Court Performance Standards and Measures. Wilmington, DE: Family Court of the State of Delaware, 1999. (Available in the NCSC Library.)
Saari, David J. Trial Court Performance Standards: “Testing the Measures:” An Evaluation of National Testing of 75 Measures of Trial Court Performances in Courts of Ohio, New Jersey, Virginia, and Washington, 1991-1994: Final Report. Annapolis, MD: David J. Saari, 1995. (Available in the NCSC Library.)
Scorsone, Eric and Emaunuele Padovani. A Conceptual Framework for Performance Measurement Development in an Intergovernmental Setting: The Case of Intergovernmental Systems in the USA and Italy. Milan, Italy: 2008.
- http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1137543
Testing the Trial Court Performance Standards’ Measurement System: The Virginia Experience. Richmond, VA: Office of the Executive Secretary, Supreme Court of Virginia, 1995. (Available in the NCSC Library.)
Tobin, Robert W., Penelope J. Wentland and Chang-Ming Yeh. Performance Audit of the Town of Hilton Head Island Municipal Court: Final Report. Denver, CO: National Center for State Courts, 2004.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/spcts&CISOPTR=139
Trial Court Performance Standards Desk Reference Manual and CD-ROM. Williamsburg, VA: National Center for State Courts, 2003.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=433
Trial Court Performance Standards with Commentary. Williamsburg, VA: National Center for State Courts, 1990.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=335

TOP

**Unit 3 – CourTool Measures and Real Court Results**

“States can learn much from the experience of New Jersey and its successful use of statewide data to improve court performance.” – John M. Greacen

Accountability through Measurement: January 1, 2005 – December 31, 2005. Lubbock County, TX: Lubbock County Board of Judges and Administrative Office of the Courts, 2006.
- http://www.co.lubbock.tx.us/egov/docs/1287103150_845428.pdf
Brewer, David. “Appellate Court Performance Measurement: Transforming Processes and Building Trust in the Oregon Court of Appeals.” Future Trends in State Courts 2010. Williamsburg, VA: National Center for State Courts, 2010.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/appellate&CISOPTR=193.
Chatters, Jake. “Defining Operational Successes: Measuring the Performance of a Court’s Front-Line Staff.” Future Trends in State Court 2009. Williamsburg, VA: National Center for State Courts, 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1488.
Cheesman, Fred L. Performance Measurement & Program Evaluation for Drug Courts. Williamsburg, VA: National Drug Court Institute, 2010.(Available in the NCSC Library.)
Clements, Tiffany. Trial Court Performance Standards. Williamsburg, VA: Institute for Court Management, 2006.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=471
Coleman, Faye A. An Evaluation of the Level of Employee Morale and Employee Retention in the Twenty-first Judicial Circuit of Missouri in the Circuit Clerk’s Office of St. Louis County. Williamsburg, VA: Institute for Court Management, 2003.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/hr&CISOPTR=62
Court Performance Measurement System. North Carolina Court System.
- http://www.nccourts.org/Citizens/SRPlanning/Performance/Default.asp
CourTools on Demand: Web-based Software for Judges, Court Managers and Court Staff. Williamsburg, VA: National Center for State Courts, CTC presentation, 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1507.
CourTools Report II: Continuing Accountability through Measurement: January 1, 2006 – December 31, 2006. Lubbock County, TX: Lubbock District Judicial Branch, 2007.
- http://www.co.lubbock.tx.us/egov/docs/1287103044_169006.pdf
Domingo, Elizabeth. As Assessment of Union’s Volunteer Self-Help Center. Williamsburg, VA: National Center for State Courts, Institute for Court Management, Court Executive Development Program Phase III, 2010.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/accessfair&CISOPTR=192
Durbin, Jacque. Access and Fairness in the Gila County Superior Court. Williamsburg, VA: Institute for Court Management, 2009.
- http://www.ncsconline.org/D_Consult/StatewideTAs/StatewideTABulletin_6.pdf
Expanding Access to Justice in New York State. New York: Office of the Deputy Chief Administrative Judge for Justice Initiatives, 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/accessfair&CISOPTR=158
Greacen, John M. “The Court Administrator’s Perspective: Performance Measurement – A Success Story in New Jersey.” Future Trends in State Courts 2007. Williamsburg, VA: National Center for State Courts, 2007.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1288
Griller, Gordan M. Fifteenth Judicial District Court, Ann Arbor, Michigan: Operational and Management Review. Denver, CO: National Center for State Courts, 2008. (Available in the NCSC Library.)
Hannaford-Agor, Paula L. Juror Utilization in the York County Court of Common Pleas. Williamsburg, VA: National Center for State Courts, 2006.
- http://www.ncsconline.org/D_Research/cjs/pdf/York_PA_Final_Report_with_TOC.pdf
Hannaford-Agor, Paula L. and G. Thomas Munsterman. Assessment of Juror Utilization in the Massachusetts Trial Courts: Final Report. Denver, CO: National Center for State Courts, 2007
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/juries&CISOPTR=107
Hewitt, William E., Geoff Gallas, and Barry Mahoney. Courts That Succeed: Six Profiles of Successful Courts. Williamsburg, VA: National Center for State Courts, 1990.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=10
Holewa, Sally A. Access, Fairness, and Trust in the North Dakota Court System. Williamsburg, VA: Institute for Court Management, 2007.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctcomm&CISOPTR=30
How to Create a Vital Records Protection Plan. New York: New York State Unified Court System, Division of Court Operations, Office of Records Management, 2003.
- http://www.courts.state.ny.us/admin/recordsmanagement/pubs_training/Vital-Protect-Plan-Manual.pdf
Judicial Administration Standards and Measures that Promote the Fair and Efficient Administration of Justice: Report to the Legislature. San Francisco, CA: Administrative Office of the Courts, 2009.
- http://www.courts.ca.gov/documents/judadmin-standards.pdf
Klaversma, Laura. “Courts and Collections.” Future Trends in State Courts 2008. Williamsburg, VA: National Center for State Courts, 2008.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/financial&CISOPTR=122
Law and the Courts: The Role of Courts (Volume 1). Chicago, IL: American Bar Association, Division for Public Education, 2000. (Available in the NCSC Library.)
Lieberman, Jethro K. The Role of Courts in American Society: The Final Report of the Council on the Role of Courts. St. Paul, MN: West Publishing Co., 1984. (Available in the NCSC Library.)
Marlinga, Jennifer. Continuous Feedback: An Analysis of Performance Evaluation and Employee Feedback Systems in a Trial Court Environment. Williamsburg, VA: Institute for Court Management, National Center for State Courts, 2006.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/hr&CISOPTR=56
Onyile, Ekpoanwan Erete. The Performance of Juvenile Diversion Programs in the Superior Court of New Jersey, Essex Vicinage. Williamsburg, VA: National Center for State Courts, Institute for Court Management CEDP paper, 2010.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/famct&CISOPTR=297
Performance Measures for Texas District and Appellate Courts. Texas Judicial Council Annual Report, 1998 -1999.
- http://www.courts.state.tx.us/tjc/ar99/performance.htm
Pound, Roscoe. Organization of Courts. Boston, MA: Little, Brown and Company, 1940. (Available in the NCSC Library.)
Permanand, Radha. Appellate Caseload, Time Standards and Case Processing Performance: The Caribbean Court of Justice. Williamsburg, VA: National Center for State Courts, Institute for Court Management CEDP paper, 2010.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/appellate&CISOPTR=190.
Purposes and Responsibilities of Courts: Midyear Conference Notebook. Portland, OR: National Association for Court Management, 2009. (Available in the NCSC Library.)
Rottman, David R., and William E. Hewitt. Trial Court Structure and Performance: A Contemporary Reappraisal. Williamsburg, VA: National Center for State Courts, 1996.
- http://www.ncsconline.org/WC/Publications/KIS_CasManTrCtStrucPerf.pdf
Slayton, David W. An Analysis of the Effective Use of Jurors in Lubbock County. Williamsburg, VA: Institute for Court Management, 2007.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/juries&CISOPTR=36
Teleis, Kenneth R. Public Perceptions of Access and Fairness in the Summit County Domestic Relations Court. Williamsburg, VA: Institute for Court Management, 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctcomm&CISOPTR=114
Thomas, Rebecca M. Nevada judicial evaluation pilot project. Grant Sawyer Center for Justice Studies, 2009. (Available in the NCSC Library).
- http://www.nevadajudiciary.us/images/JEPReport042809.pdf
Wallis, James D. A Critical Evaluation of Delay in an Ohio Criminal Trial Court. Williamsburg, VA: Institute for Court Management, 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1450
Webster, Larry. Court Automation Performance Standards, Pt. 2. Williamsburg, VA: National Center for State Courts, CTC presentation, 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/tech&CISOPTR=752.
Yankelovich, Skelly and White, Inc. Survey of Judges on the Role of Courts in American Society. Washington, D.C.: United States Department of Justice, Office for Improvements in the Administration of Justice, 1979.
- http://www.icpsr.umich.edu/cocoon/ICPSR/STUDY/07824.xml

TOP

Unit 4 – Court Culture & Change Management

“No one culture dominates all work areas and there is no dominant cultural mosaic across the twelve courts. A logical question arises: Does this cultural variation have differential performance consequences? Public management experts contend that, in general, culture shapes institutional performance.” – Trial Courts as Organizations

Conference of State Court Administrators: Position Paper on Promoting a Culture of Accountability and Transparency: Court System Performance Measures. Williamsburg, VA: National Center for State Courts, 2008.
- http://cosca.ncsc.dni.us/WhitePapers/2008WhitePaper-PerformanceMeasurement-Final-Dec5-08.pdf (See Conference of Chief Justices – Resolution 4: In Support of Promoting a Culture of Transparency and Accountability through Court System Performance Measures adopted in August 2009.)
Brown, Karen J. Court Culture: Measuring and Analyzing the Impact of Judicial/Administrative Culture in the 16^th Judicial Circuit Court. Williamsburg, VA: Institute for Court Management, 2006.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=470
Burke, Hon. Kevin and Frank Broccolina. “Another View of Local Legal Culture: More than Court Culture.” 20 Court Manager 4 (Winter 2005):29. (Available in the NCSC Library.)
Gallas, Geoff. “Local Legal Culture: More than Court Culture.” 20 Court Manager 4 (Winter 2005):23. (Available in the NCSC Library.)
Mulligan, Judge Robert A. “Metrics in the Trial Court: Creating a Culture of High Performance.” Boston Bar Journal (May/June 2007): 5.
- http://170.63.97.68/courts/mulligan_mayjune07.pdf
Ostrom, Brian J. et al. “Court Cultures and their Consequences.” 20 Court Manager 1 (2005):14.
- http://contentdm.ncsconline.org/cgibin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=986
Ostrom, Brian J. and Roger A. Hanson. “Understanding Court Culture is Key to Successful Court Reform.” Future Trends in State Courts. Williamsburg, VA: National Center for State Courts, 2010.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1611
Ostrom, Brian J., Roger Hanson, and Matthew Kleiman. “Examining Court Culture.” 11Caseload Highlights 2 (May 2005).
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=664
Ostrom, Brian J. et al. The Mosaic of Institutional Culture and Performance: Trial Courts as Organizations. Williamsburg, VA: National Center for State Courts and National Institute of Justice, 2005.
- http://ncsc.contentdm.oclc.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1852
Ostrom, Brian J., et al. Trial Courts as Organizations. Philadelphia, PA: Temple University Press, 2007. (Available in the NCSC Library.)
Waters, Nicole L. Mental Health Court Culture: Leaving Your Hat at the Door. Williamsburg, VA: National Center for State Courts, 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/spcts&CISOPTR=209

TOP

Unit 5 – Implementing Performance Measurement Using CourTools

“Performance measurement can fundamentally change the way courts to business. For performance measurement to deliver its full benefit, it must be integrated with a court’s key business processes and day-to-day management.” – National Center for State Courts CourTools

Anabasis-Straub (firm). The Essentials of Trial Court Performance : A Handbook for California Courts. San Francisco, CA: California Administrative Office of the Courts, 1996. (Available in the NCSC Library.)
Anabasis-Straub (firm). Implementation & Institutionalization of the Trial Court Performance Standards (TCPS): Los Angeles Municipal Court. San Francisco, CA: California Administrative Office of the Courts, 2000. (Available in the NCSC Library.)
Carlson, Alan and Martha Wade Steketee. Public Access to Court Records: Implementing the CCJ/COSCA Guidelines: Final Project Report. Williamsburg, VA: National Center for State Courts, 2005.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/accessfair&CISOPTR=196
Cissner, Amanda B. Avoiding failures of implementation: lessons from process evaluation. Center for Court Innovation, 2009. (Available in the NCSC Library).
- http://www.courtinnovation.org/_uploads/documents/Failure%20Final.pdf
CourTools: Community of Practice. Williamsburg, VA: National Center for State Courts.
- http://www.icmeducation.org/courTools/form/
DiPrimo, Joseph, and Ingo Kielitz. Beyond Dashboards, Scorecards and Report Cards: Building a Court Performance Measurement System Step-By-Step. Kansas City, MO: Eighth National Court Technology Conference, 2003.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1276
Douglas, John and Ingo Keilitz. Building a Performance Measurement System for the Office of the District Clerk, Collin County, Texas. Denver, CO: National Center for State Courts, 2007.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1055
Dybas, Julie A. Application of NCSC CourTools “Measure Seven”. Williamsburg, VA: Institute for Court Management, 2007.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=467
Hewitt, William E., Brian Ostrom and Richard Schauffler. “Performance Measurement Gains Momentum Through CourTools. Future Trends in State Courts 2006. Williamsburg, VA: 2006.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1288
Implementing CourTools. Williamsburg, VA: National Center for State Courts.
- http://www.ncsconline.org/D_Research/CourTools/Images/ImplementingCourTools.pdf
Keilitz, Ingo. Automated Court Performance Measurement Systems: The Next Big Thing. Kansas City, MO: Eighth National Court Technology Conference, 2003.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1275
Keilitz, Ingo. “Smart Courts: Performance Dashboards and Business Intelligence.” Future Trends in State Courts 2010. Williamsburg, VA: National Center for State Courts, 2010.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1613.
Keith, Ann L. Expediting Dependency Appeals: Strategies to Reduce Delay. Williamsburg, VA: National Center for State Courts, 2003.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/appellate&CISOPTR=97
Making the Verbatim Court Record. Williamsburg, VA: National Association for Court Management, 2007. (Available in the NCSC Library.)
New Hampshire`s Performance Evaluation Questionnaire. This is an online version of New Hampshire's Supreme Court Performance Evaluation Questionnaire.
- http://www.courts.state.nh.us/press/2002/trialjudperfquest.htm
Ostrom, Brian. Achieving High Performance: A Framework for Courts. Williamsburg, VA: National Center for State Courts, 2010.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1510
Ostrom, Brian et al. Implementing Performance Management in the California Courts. San Francisco, CA: Administrative Office of the Courts, 2007.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1068
Rodriquez, Nancy. CourTool 1: An Evaluation and Comparison of Access and Fairness in the Tempe Municipal Court. Williamsburg, VA: Institute for Court Management, 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctcomm&CISOPTR=112
Slayton, David. “Using Performance Measures to Enhance Fair and Impartial Courts: A Practitioner’s View.” Future Trends in State Courts 2008. Williamsburg, VA: National Center for State Courts, 2008.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1283
Uruburu, Ronna. Initiating the Trial Court Performance Standards. Williamsburg, VA: Institute for Court Management, 1998.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/spcts&CISOPTR=45
Waint, Gary J. Missouri Standards for the Administration of Juvenile Justice: Identifying Barriers and Incentives for their Use in Juvenile Delinquency Cases. Williamsburg, VA: Institute for Court Management, 2002.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/famct&CISOPTR=75

TOP

Unit 6 – Court Myths & What Does the Data Mean?

"This is not third-party research. These are things the court does on a regular basis. This is information for us.” – Ingo Keilitz

Case Processing Time Standards. National Center for State Courts, Knowledge and Information Services Division.
- http://www.ncsconline.org/cpts/cptsType.asp
Clarke, Thomas M. et al. A Unifying Framework for Court Performance Measurement: Final Report. Williamsburg, VA: National Center for State Courts, 2008.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1079
CourTools Analysis Templates. National Center for State Courts, Research Division.
- http://www.ncsconline.org/d_research/CourTools/ctTemplates.htm
Heck, Cary. Local Drug Court Research: Navigating Performance Measures and Process Evaluations. Alexandria, VA: National Drug Court Institute, 2006.
- http://www.ndci.org/sites/default/files/ndci/Mono6.LocalResearch.pdf
Hanson, Roger A. Jurisdiction, Caseload, and Timeliness of State Supreme Courts: A Report. Williamsburg, VA: National Center for State Courts, 2001.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/appellate&CISOPTR=58
Hernandez, Saul E. Spanish Speaker Perceptions of Access and Fairness in the Superior Court of New Jersey in Vicinage XV and Improvement Recommendations. Williamsburg, VA: Institute for Court Management, 2008.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctcomm&CISOPTR=91
Keilitz, Ingo. Performance Dashboards: Measuring, Monitoring and Managing Your Court. Tampa, FL: Tenth National Court Technology Conference, 2007.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1251
An Overview of the Statistical Reporting Process. Columbus, OH: Ohio Judicial System, 2008.
- http://www.supremecourt.ohio.gov/Publications/annrep/10OCS/summary/1.pdf
Ostrom, Brian J. and Roger A. Hanson. Efficiency, Timeliness, and Quality: A New Perspective from Nine State Criminal Trial Courts. Williamsburg, VA: National Center for State Courts, 1999.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=409
Patterson, Christopher T. Toward Service Excellence: A Preliminary Assessment of Service Quality in Georgia Courts. Williamsburg, VA: Institute for Court Management, 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctcomm&CISOPTR=117
Presenting Court Data. National Center for State Courts, Institute for Court Management.
- http://www.ncsconline.org/D_ICM/coursedb/showcourse_06.asp?id=312
Schauffler, Richard et al. State Court Guide to Statistical Report. Williamsburg, VA: National Center for State Courts, 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1472
- Shared Expectations: Judicial Accountability in Context. Denver, CO: Institute for the Advancement of the American Legal System, 2006.
  - http://iaals.du.edu/images/wygwam/documents/publications/Shared_Expectations_Judicial%20Accountability_Context2006.pdf

TOP

Unit 7 – Measuring Results with CourTools

“The Courts continue to believe that it is crucial for the judiciary to be independent as intended by the framers of our country; however, that independence requires accountability.” – Lubbock District Judicial Branch

Accountability through Measurement: January 1, 2005 – December 31, 2005. Lubbock County, TX: Lubbock County Board of Judges and Administrative Office of the Courts, 2006.
- http://www.co.lubbock.tx.us/egov/docs/1287103150_845428.pdf
Best Practices in Court-Based Programs for the Self-Represented: Concepts, Attributes, Issues for Exploration, Examples, Contacts, and Resources. Williamsburg, VA: National Center for State Courts, 2008.
- http://www.abanet.org/legalservices/sclaid/atjresourcecenter/downloads/best_practices_7-08.pdf
CourTools Report II: Continuing Accountability through Measurement: January 1, 2006 – December 31, 2006. Lubbock County, TX: Lubbock District Judicial Branch, 2007.
- http://www.co.lubbock.tx.us/egov/docs/1287103044_169006.pdf
Greacen, John M. “The Court Administrator’s Perspective: Performance Measurement – A Success Story in New Jersey.” Future Trends in State Courts 2007. Williamsburg, VA: National Center for State Courts, 2007.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1288
Hardin, Mark and Susan Koenig. Court Performance Measures in Child Abuse and Neglect Cases: Technical Guide. Washington, D.C.: U.S. Department of Justice, Office of Justice Programs, Office of Juvenile Justice and Delinquency Prevention, 2008.
- https://www.ncjrs.gov/app/Search/Abstracts.aspx?id=245494
Hatry, Harry P. Performance Measurement: Getting Results. Washington, D.C.: Urban Institute Press, 1999. (Available in the NCSC Library.)
Krause, Richard A. Public Perceptions of the Accessibility and Fairness of the Circuit Court of Lake County, Illinois. Williamsburg, VA: Institute for Court Management, 2008.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctcomm&CISOPTR=90
McDavid, James C. and Laura R. L. Hawthorn. Program Evaluation and Performance Measurement: An Introduction to Practice. Thousand Oaks, CA: Sage Publications, 2006. (Available in the NCSC Library.)
Morrow County Court of Common Pleas -- Court Evaluation: NCSC Trial Court Performance Standards – CourTools. Williamsburg, VA: National Center for State Courts, 2005.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1255
Patterson, Christopher T. Toward Service Excellence: A Preliminary Assessment of Service Quality in Georgia Courts. 2009 (Available in the NCSC Library).
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctcomm&CISOPTR=117
Performance Measures: Key Results and Measures. St. Paul, MN: Minnesota Judicial Branch, 2009.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/ctadmin&CISOPTR=1445
Rubio, Dawn Marie and Fred Cheesman. Wyoming Drug Court Performance Measures Project, Williamsburg, VA: National Center for State Courts, 2007.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/spcts&CISOPTR=146
Rubio, Dawn Marie, Fred Cheesman and William Federspiel. Performance Measurement of Drug Courts: The State of the Art. Williamsburg, VA: National Center for State Courts, 2008.
- http://www.ncsconline.org/D_Consult/StatewideTAs/StatewideTABulletin_6.pdf
Special Report: CourTools. Pima County Superior Court, Tucson Arizona, 2008.
- http://www.sc.pima.gov/SC_Web/Portals/0/Library/Comm/CourTools_Survey_Results.pdf

TOP

Unit 8 – Putting It All Together

“In 2004, the Utah Judicial Council began implementing a court performance measurement system developed in part by the National Center for State Courts. The performance management system helps courts identify and monitor important performance measures and make improvements to better serve the needs of the public.” – Utah State Courts

Budgeting for the U.S. Judiciary: Preparing for the Future. Washington, D.C.: National Academy of Public Administration, 2007.
- http://www.napawash.org/wp-content/uploads/2007/07-08.pdf
Building a Better Court: Measuring and Improving Court Performance and Judicial Workload in Child Abuse and Neglect Cases. Williamsburg, VA: National Center for State Courts, American Bar Association, and National Council of Juvenile and Family Court Judges, 2004.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/famct&CISOPTR=63
Court Quality Forum: Panel Discussion on the International Framework for Court Excellence. Sydney, Australia, 2008.
- http://www.aija.org.au/Court%20Quality%20Forum%2008/Presentations/Framework%20Panel%20PPT.pdf
Final Report of the Appellate CourTools Committee. Phoenix, AZ: Arizona Supreme Court, 2009
- http://www.supreme.state.az.us/ajc/MeetingMaterials/2009/09June/PDFS/AppUpdatedappellateCouroolsCommitteeFinal%20Report%20(AJC).pdf
Hamilton County Juvenile Court: 2008 Annual Report. Cincinnati, OH: Hamilton County Juvenile Court, 2009.
- http://www.hamilton-co.org/juvenilecourt/Annual_Report/2008_Annual_Report.pdf
Hammond, Clarke. Planning for the Future in the City of Austin Municipal Court: How the Use of Strategic Planning, Business Alignment, Performance Measurement and an Annual Report Can Lead to Process Improvement and Improved Public Perception. Austin, TX: City of Austin Municipal Court, 1999.
- http://contentdm.ncsconline.org/cgi-bin/showfile.exe?CISOROOT=/spcts&CISOPTR=23
Mesa County Justice Center: Public Access and Fairness Survey: Summer 2008. Denver, CO: Colorado Judicial Branch, Planning and Analysis Division, 2008.
- http://www.mesacourt.org/PDF/Courtools%20Survey%20Results%202008.pdf
A Performance Management Framework for State and Local Government: From Measurement and Report to Management and Improving: Public Review Draft. Washington, D.C.: National Performance Management Advisory Commission, 2009.
- http://www.slideshare.net/Jackie72/a-performance-management-framework-for-state-and-local-government
Simon, Phil. Why New Systems Fail: Theory and Practice Collide. AuthorHouse, 2009. (Available in the NCSC Library).
Striving for Excellence in Judicial Administration. Boston, MA: Massachusetts Court System, 2008.
- http://www.mass.gov/courts/sjc-report-feb-08.pdf
Superior Court. Yuma County, AZ: Yuma County Superior Court, 2008.
- http://www.co.yuma.az.us/admin/PDF/0910RecB-SupCt.pdf
Utah Courts Performance Measures. Utah State Courts.
- http://www.utcourts.gov/courtools/
Waters, Nicole L., Fred L. Cheesman and Sarah A. Gibson. Mental Health Courts Performance Measures (NADCP Annual Conference. Williamsburg, VA: National Center for State Courts, 2010. (Available in the NCSC Library.)
Wessels, Bob. Performance Based Criminal Case Processing. Anaheim, CA: NACM Annual Conference, 2008.
- http://www.ccl.hctx.net/criminal/examine/Performance%20Based%20Criminal%20Case%20Processing.pdf

TOP

For more information and resources on CourTools and Performance Measures, visit the National Center for State Courts Library online catalog at:

http://nstc.sirsi.net/uhtbin/cgisirsi/x/0/0/49

NCSC digital resources are located in the Digital Archive available at:

http://www.ncsconline.org/D_KIS/Library/ncsc_digital_archive_home.htm

Call 1-800-616-6164 or email [email protected] for more information.

Knowledge and Information Services

National Center for State Courts

Williamsburg, Virginia

TOP

Internet Resources: Organizations

ORGANIZATION	WEB ADDRESS
Alliance for Justice	www.afj.org
American Bar Association	www.abanet.org
American Judicature Society	www.ajs.org
Bureau of Justice Assistance	www.ojp.gov/BJA
Citizens for Independent Courts	www.faircourts.org
Conference of Chief Justices	http://ccj.ncsc.dni.us
Council for Excellence in Government	www.excelgov.org
Internet Legal Research Group	www.ilrg.com
JERITT – Michigan State University	http://jeritt.msu.edu
Justice at Stake Campaign	www.justiceatstake.org
Justice Management Institute	www.jmijustice.org
National Academy of Public Administration	www.napawash.org
National Association for Court Management	www.nacmnet.org
National Center for State Courts	www.ncsc.org
National Human Resources Association	www.humanresources.org
National Labor Management Association	www.nlma.org
Office of Justice Programs Information Technology Initiatives	www.it.ojp.gov
Rand Institute for Civil Justice	www.rand.org
State Justice Institute	www.sji.gov
U.S. Department of Labor, Bureau of Labor Statistics	www.bls.gov/home.htm
U.S. Equal Employment Opportunity Commission	www.eeoc.gov
U.S. Office of Personnel Management	www.opm.gov

TOP

Class Resources

COURT PERFORMANCE STANDARDS

Introduction and Core Resources

Unit 1 – Why Measures Performance?

Unit 2 – Overview of the Court Performance Standards (CPS): CourTools

**Unit 3 – CourTool Measures and Real Court Results**

Unit 4 – Court Culture & Change Management

Unit 5 – Implementing Performance Measurement Using CourTools

Anabasis-Straub (firm). The Essentials of Trial Court Performance : A Handbook for California Courts. San Francisco, CA: California Administrative Office of the Courts, 1996. (Available in the NCSC Library.)

Anabasis-Straub (firm). Implementation & Institutionalization of the Trial Court Performance Standards (TCPS): Los Angeles Municipal Court. San Francisco, CA: California Administrative Office of the Courts, 2000. (Available in the NCSC Library.)

Unit 6 – Court Myths & What Does the Data Mean?

Unit 7 – Measuring Results with CourTools

Unit 8 – Putting It All Together

Internet Resources: Organizations