Con Justicia
Con Justicia
June 2021
PROGRAMA PARA EL FORTALECIMIENTO DE INSTITUCIONES DE JUSTICIA PENAL ESTATAL (CONJUSTICIA)
Start and End Date: July 24, 2020 – July 23, 2025
This document was produced for review by the Unites States Agency for International Development (USAID). It was prepared by DAI Global
LLC for the Programa para el Fortalecimiento de Instituciones de Justicia Penal Estatal (ConJusticia), contract number 72052320C00001. This
document is made possible by the support of the American People through USAID.
PROGRAMA PARA EL FORTALECIMIENTO DE INSTITUCIONES DE JUSTICIA PENAL ESTATAL (CONJUSTICIA)
CONTENTS
INTRODUCTION
This document presents the United States Agency for International Development’s (USAID) Programa para
el Fortalecimiento de Instituciones de Justicia Penal Estatal (ConJusticia) Activity Monitoring, Evaluation and
Learning (MEL) Plan. Developing the Activity MEL Plan is the integral first step in performance management
for the life of activity (LOA).
Per USAID’s Automated Directives System (ADS) 201.3.4.10 policy guidelines, implementers must have an
approved activity MEL Plan in place before major implementation actions begin. These plans should be
submitted to the Contracting Officer’s Representative (COR) in accordance with the guidelines in an
Activity’s contract. In the case of the ConJusticia Activity, the MEL Plan is due 60 days after contract award.
Following best practices, this MEL Plan will be updated as necessary and reported in a consistent manner to
allow for easy tracking and progress over the LOA.
Data collection, analysis, and feedback are a critical part of performance monitoring; it indicates to partner
staff, USAID, and other stakeholders whether the activity is achieving its objectives. The activity MEL Plan
establishes a process for monitoring, evaluating, and learning from implementation, in order to adapt and
achieve results. The plan also does the following:
The ConJusticia Activity MEL Plan outlines approaches and activities for monitoring progress against
objectives and using research and learning to inform adaptive management. It serves as a management tool
to:
• Provide a framework to enable the systematic collection, aggregation, analysis, and interpretation of
data to support evidence- and performance-informed decision making
• Identify core indicators to assess the ConJusticia Activity’s progress toward achieving planned
results
• Describe the main data tools, sources, and methods used to collect data
• Describe roles and responsibilities associated with MEL
• Define data quality assurance measures and data management procedures to provide transparency
and ensure data quality
• Align with USAID’s strategies in Mexico
• Facilitate consultation and discussion with USAID, key stakeholders, and partners
1. The ConJusticia Activity theory of change (ToC) and results framework (RF), which present
expected LOA outcomes.
2. Description of the activity MEL approach including the practices and processes that the ConJusticia
Activity will implement to measure progress and learn from data, including collecting, reporting, and
responding to feedback from beneficiaries.
3. Details of how the activity will collect, store, and analyze data.
4. Indicators and annual LOA targets presented in an Indicator Performance Tracking Table (IPTT),
Annex 1, and detailed in the Performance Indicator Reference Sheets (PIRS), Annex 2.
Updates to this plan will be provided to the USAID COR for review and approval on an annual basis or
whenever revisions to the plan are proposed.
The purpose of ConJusticia Activity is to increase the effectiveness of the Mexican criminal justice system,
primarily at the state level, in order to reduce impunity, increase accountability and improve citizen
perceptions of the justice sector.
To this end, ConJusticia will work to enable justice sector institutions and actors to effectively fulfil their
mandates first individually, then collectively, and ultimately sustainably into the future. Through this activity,
justice stakeholders such the state-level Attorney General’s Offices (Fiscalías General del Estado, FGEs),
State Courts (Tribunales de Justicia) as well as prosecutors, judges, and other state-level and non-justice
sector actors (including private sector organizations and NGOs) strengthen their capacity, performance,
and collaboration to deliver a marked improvement in prosecution of high-priority crimes in Mexico.
The ConJusticia Activity Cost Plus Fixed Fee (CPFF) Completion contract was awarded to DAI Global LLC
(DAI) on July 23, 2020. The period of performance for the activity is five years starting July 24, 2020 and
ending on July 23, 2025. The total estimated cost for this Contract is $29,050,089 million USD.
The ConJusticia consortium is comprised of DAI as the prime in partnership with ConJusticia’s major
subcontractor, Fortis Consultoría, as well as Rapid Results Institute (RRI) and U.S.-based small business
Metropolitan Group.
The ConJusticia Activity supports the achievement of the current USAID/Mexico Country Development
Cooperation Strategy (CDCS) 2020-2025 goal that Mexico makes progress towards achievement of its
citizen security, justice, human rights, and environmental goals through bilateral partnership, and
Development Objective (DO) I, Impunity and Violence reduced in Targeted Regions. ConJusticia’s results
framework connects directly to DO 1 by enabling justice sector institutions and actors to effectively fulfil
their mandates individually (under the program’s Intermediate Result-IR- 1), collectively (IR 2), and
sustainably (IR 3) into the future.
Development Context
Since 2008, Mexico, with support from USAID, has made considerable progress in implementing the
Adversarial Criminal Justice System as mandated by the Mexican Congress to reduce impunity. Considerable
work remains, however, as crime and violence continue to afflict the country, high levels of impunity
continue to exist and varied implementation results of the new system across states leave many citizens
frustrated that the government is not delivering justice or protecting the most vulnerable.
Most states continue to lack processes for determining priorities and do not focus on cases likely to make
the highest impact on lowering impunity, increasing public safety, or capturing persistent offenders. In
addition, many justice sector actors lack data collection and management tools that would allow them to
monitor performance, identify issues, strengthen external collaboration, and better focus on attending to
and resolving high-priority crimes.
IF, justice sector processes, structures and practices within the individual institutions become more
efficient and effective,
and IF, local actors address deeply rooted challenges that diminish the sustainability of results,
THEN, there will be a more effective and accountable justice response to criminal misconduct, resulting
in lower levels of impunity and increased citizen confidence in the Mexican government.
The activity’s ToC is premised on several key assumptions listed in Table 1. As the activity proceeds, staff
will use the list below as guidance for action and adaptation, where needed, and will document information
collected on all assumptions in a structured manner to include as part of the activity’s collaboration, learning
and adaptation (CLA) work.
Government of Mexico (GoM), FGEs, State Courts and other relevant local Activity Documentation
system actors (e.g., Citizen Security Secretariats, Public Defenders, civil
society), continue to implement needed changes and ensure political will for
sustainable outcomes
Counterpart staff have the appropriate capacity to manage the system and the Activity Documentation
absorptive capacity to take on needed changes
Macroeconomic trends or other global considerations such as natural disasters Local News Sources and Activity
do not distract from priorities Documents
Staff turnover does not hamper implementation or uptake Activity Documentation
COVID-19 begins to recede allowing for normal Activity implementation Mexico’s COVID-19 Traffic Light
Monitoring System
Organized crime does not adversely affect the implementation process and Secretariado Ejecutivo del Sistema
impact overall security Nacional de Seguridad Pública
(SESNSP) Monthly Crime Reports,
Local news sources and Mexico
Mission guidelines
IR 1. Individual justice sector institutions prioritize and fully prosecute higher-level serious
criminal cases
Intermediate Result (IR) 1 will focus on building the capacity of FGEs and courts through five key
interventions. These five interventions comprise the sub-IRs of this IR and include:
IR 1.1: Improved capacity of FGEs to prioritize cases based on criminal prosecution prioritization
frameworks
IR 1.2: Internal processes and management of FGEs and courts strengthened
IR 1.3: Capacity of FGEs to investigate and prosecute high-priority crimes strengthened
IR 1.4: Improved data tracking and analytics capacity of FGE and courts to better manage and resolve
high-priority cases
IR 1.5: Improved communication, transparency, and accountability of justice sector institutions
through proactive engagement with users and the public
The foundation of this IR (IR 1.1) is the development and implementation of comprehensive prioritization
frameworks. Together, these results will ensure that FGEs and courts have the capabilities, systems,
processes, and tools to prosecute high-priority crimes (those identified in the prioritization frameworks)
that can make a marked impact on citizen satisfaction with the justice system.
As part of IR 1.2, ConJusticia will help improve the overall management of justice institutions to ensure
resources and systems within FGEs and courts are aligned to enable prosecutors and judges to focus on the
resolution of high-priority cases.
Through its work on IR 1.3, ConJusticia will help strengthen the operational capacity of justice actors to
conduct effective investigations, with a focus on the applied tools and techniques required to increase the
likelihood of successful prosecution.
IR 1.4 will include crosscutting interventions to improve the use of data for decision making throughout the
investigation process.
Lastly, IR 1.5 will help strengthen the capability of justice sector institutions to communicate more effectively
with the public, increasing awareness of justice sector reforms, and developing an improved user-centered
focus in the justice process.
ConJusticia will work with FGEs and courts in each focus state to conduct self-assessments to determine
where they fall on the Institutional Maturity Model (IMM). This will inform development of tailored
performance improvement plans for each, aligned to the level of resources, political will, and existing
capacities of counterparts. The activity will respond with heavy- touch or light-touch support depending on
the results of the self-assessments, engaging grantees and subcontractors to build capacity through
experiential learning such as peer learning, mentorships, practical application of training and capacity building
from Mexican institutes and promote sustainability of the local system.
Throughout the activity, work on IR 1 will incorporate gender and other vulnerable populations’
perspectives into criminal investigations and case resolution.
IR 2. Justice sector actors within the various institutions collaborate across institutions
resulting in improved prosecutions and reductions in impunity
IR 2 focuses on facilitating partnerships to assist prosecutors, judges, investigative police, and other justice
sector and non-state actors, including private sector and civil society organizations, to collaborate to apply
the frameworks and tools identified in IR 1 correctly under our work within IR 2.
To that end, IR 2 interventions will help institutions advance toward higher levels in the ConJusticia IMM.
Consistent with a local systems approach, ConJusticia will primarily help local organizations collaborate to
prioritize and develop their own solutions to justice sector problems.
IR 2.2: Enhanced collaboration among prosecutors, police, and investigators to improve the speed and
quality of investigations and prosecutions for high-priority crimes
The development of criminal prosecution frameworks with multi-stakeholder groups (IR 1) will promote
institutional alignment regarding where to focus collective efforts to improve prosecutions of high-priority
cases. From here, ConJusticia will diagnose the specific causes that underpin the lack of stakeholder
collaboration in target states. ConJusticia will simultaneously conduct a 100-Day Challenges (100-DC) at
the beginning of the activity. Through these facilitated events, the activity will bring multi-stakeholder groups
to generate together a common vision for desired results and to solve system bottlenecks affecting
prosecution and justice adjudication processes including key institutional and operational obstacles limiting
access of women, girls, and other vulnerable populations to justice.
As a result of work under this IR, pressing short-term problems will be solved through the creation of inter-
institutional leadership and operational groups that will work to implement identified solutions. ConJusticia
will provide continued facilitation support to the inter-institutional leadership groups to continue meeting
regularly to develop more medium-term plans and agreements to address performance issues that occur
throughout the prosecution process, including investigations, handling of evidence, witness testimony, and
alternative disposition. Together, these interventions will strengthen inter-institutional collaboration to
improve prosecutions and reduce impunity, laying the foundation for durable partnerships (IR 3).
IR 3. Durable partnerships among key local stakeholders in the justice sector strengthened
IR 3.1: Networks of justice sector institutions, civil society, academia and private sector for developing
local solutions strengthened
Under this IR, ConJusticia will catalyze the co-ownership and responsibility of public and private sector and
civil society organizations of a responsive and results-driven Criminal Justice System, at the national and
state level with an eye on the long-term view. To this end, the activity will utilize a series of facilitative
techniques, including coaching and mentorship to cultivate networks supported by strategic use of the
ConJusticia grants fund to spark innovation and identify additional resources from other sources to amplify
results.
ConJusticia will also cultivate networks of influential civil society and private sector partners to play a major
role in dialogue regarding justice sector reform—both to promote upward accountability and to mobilize
additional resources to enhance financial sustainability of these initiatives in line with USAID’s Journey to
Self-Reliance objectives.
Lastly, ConJusticia will help institutionalize practices and mechanisms for institutional strengthening initiated
under IR 1 through the cultivation of local peer-to-peer professional networks. The activity will make
concerted efforts to ensure the networks have an impact across all target states through the fostering of
dialogue with other traditional actors, such as public defenders, as well as professional associations,
specialized CSOs and academics. These networks will enable professionals from across justice institutions
to continuously learn and hone their skills as they draw on their colleagues for support and ideas on how
to address common problems. In combination, these initiatives will enhance the likelihood that previous
investments in individual and collective capacity building to improve justice sector performance will sustain
beyond ConJusticia’s final year.
Interventions under IR 3 will help justice sector institutions advance to Level 4 on the IMM to ensure
sustainability of results.
2. MONITORING PLAN
The ConJusticia Activity will implement a multi-pronged MEL approach utilizing activities ranging from
reporting on quantitative-based USAID and custom indicators, to conducting surveys and qualitative studies
of the underlying issues around implementation in order to have a greater impact.
The activity MEL Plan includes 22 indicators that will be used to monitor progress and manage performance
through the LOA at the output, outcome, impact, and context levels.
In determining appropriate activity indicators, ConJusticia included five context indicators and 17 custom
indicators to enable straightforward reporting on activity progress and the context, as outlined in the RF
(Figure 1), and for USAID’s use on their Performance Plan and Report (PPR).
As part of ConJusticia’s efforts to collect and learn from data, monitoring will include collecting, reporting,
and responding to feedback from beneficiaries through participant surveys, sharing program performance
indicators with counterparts through participatory sessions, and other feedback mechanisms.
The activity MEL Plan includes five context indicators that will be used to monitor the country context as
well as activity context under which ConJusticia will be implemented. These context indicators are level of
perception of society's trust in Judges and Prosecutors (ENVIPE), citizen confidence that courts guarantee
a fair trial (Latin American Public Opinion Project-LAPOP), unrecorded crime rate, or cifra negra (ENVIPE),
and the Rule of Law Index for Mexico (World Justice Project). These indicators align to the USAID/Mexico
Mission’s own Results Framework.
In addition to its plans for monitoring ToC assumptions in Table 1, ConJusticia will monitor risks associated
with the activity. Table 2 below summarizes strategies to address identified challenges.
Data Collection
ConJusticia will use primary data as a means for reporting progress and results against activity indicators.
Where possible, the Activity will prioritize digital data collection using DAI Collect, a cloud-based platform
based on open-source code. DAI Collect allows users to design and deploy standardized data collection
forms. We will create standard operating procedures (SOPs) for each indicator and train program staff in
data collection to ensure data quality.
MONITORING, EVALUATION AND LEARNING PLAN 9
PROGRAMA PARA EL FORTALECIMIENTO DE INSTITUCIONES DE JUSTICIA PENAL ESTATAL (CONJUSTICIA)
Data Storage
ConJusticia will securely store all data collected. Digitally collected data will be stored on DAI’s central
server in the U.S. Any data that is collected using hard copies will be stored in locked file cabinets or rooms
in the ConJusticia’s office. Activity data will also be stored in ConJusticia’s internal information technology
systems, such as an online management information system that supports real-time analysis of data to inform
management decisions, collaboration, planning, reporting, and communication. Once data is entered into
the system, it automatically produces standardized summary views helping staff monitor progress. PowerBI,
Microsoft’s business analytics and data visualization platform, now embedded in DAI systems, will provide
DAI real-time reports and data for decision making. Importantly, this helps mitigate remote management
challenges by allowing users in dispersed geographic locations, such as the ConJusticia field offices, to share
data efficiently and transparently. Timely reporting from the Region Coordinators will also help the technical
and grant teams stay apprised of progress across the whole grant portfolio.
Through DAI platforms, the Mexico City-based technical leaders as well as grants and procurement staff
will be able to work seamlessly with Region Coordinators on the grants, subcontracts, and other resources
needed. The real time data and documentation features of these systems also enable DAI’s home office to
support the project team directly and conduct regular compliance checks.
With support from DAI’s home office team, ConJusticia will also seek to develop a web-based MEL
Management Information System (MIS) that will be accessible to the COR or other USAID personnel.
For audit purposes, copies of all data collected for indicator reporting will be available for review at the
ConJusticia office in Mexico City.
Data Security
ConJusticia will follow DAI institutional data security protocols to ensure that information is appropriately
safeguarded during storage. Any information deemed sensitive or proprietary will be accessible by invitation
of activity leads and USAID.
In line with USAID reporting requirements, data from the activity MEL Plan will be analyzed regularly and
used to determine progress toward expected results. In addition, ConJusticia MEL staff and other designated
activity staff will prepare relevant graphs and charts of indicator disaggregates for annual reports.
Baseline data will be used to measure change throughout the LOA as well as to determine the starting point
of the ConJusticia indicators. Upon approval of ConJusticia MEL Plan, the ConJusticia Baseline Study planning
will begin.
During year 1, the activity will conduct the ConJusticia Perception Survey to measure citizens' trust in justice
institutions and to set targets for the goal-level indicator. This will be a statistically significant sample-based
perception survey on which respondents will be asked, among other things, to respond via a Likert even-
point scale regarding the extent to which they trust justice institutions. Data from this survey will be used
to determine the baseline value for the goal indicator as well as to determine appropriate targets for this
indicator.
In order to implement the IMM, the Knowledge Management (KM) and CLA Director and Senior M&E
Manager will work closely with the Deputy Chief of Party (DCOP). This effort will entail developing specific
metrics to measure IMM’s milestones and the activity’s five technical elements – Prioritization, Data and
Analysis, Investigations, Court Efficiency, Information Sharing and Transparency – that enable successful
prosecution of high-priority cases. The team will also develop self-assessment tools to facilitate the
collection of data in each target institution and facilitate the application of these tools in each target
institution (FGE and Courts) once target states are confirmed and ConJusticia is authorized to initiate
activities in these states. To apply the IMM, ConJusticia will: 1) facilitate self-assessments with target state
institutions based on the technical elements and levels of the model; 2) facilitate commitments within each
individual institution (objective 1) and across institutions (objective 2), based on the result of the self-
assessments, in order to establish specific targets to move across the institutional capacity continuum (level
1-4) and generate specific capacity building plans; 3) learn and adapt through constant monitoring and
evaluation efforts to update level of commitment and adjust programming periodically as needed; and 4)
document and communicate results.
As part of the Baseline Study, the activity will also assess the capacity of FGE and Courts in the area of
communication.
Evidence-based performance management is only as good as the data that is collected. The primary
determinants of data quality are clear definitions of the required data that are also well understood by all
concerned, and a careful process for collecting and handling the data. More specifically, ConJusticia will
ensure that the performance data meets the USAID required five data quality standards that follow. If
performance data does not fully meet all five standards, the activity will document the known data limitations
in the PIRS in Annex A.
In order to ensure the quality of the data collected, activity staff will conduct quarterly reviews of all
monitoring and evaluation (M&E) data in order to review completeness, accuracy, and relevance to the
activity’s goal and objectives. The Senior M&E Manager will also conduct spot-checks of data quarterly and
during field visits.
For spot-checks, data collected for specific, pre-determined indicators and the documents supporting the
data will be thoroughly reviewed using tailored assessment. Findings from the spot-checks will be reported
to ensure that they inform management decisions. Note that all salient data quality review results will also
be included in regular reporting to USAID and others, as appropriate. The activity will address any issues
with the data quality in reporting and make clear and actionable recommendations to improve data quality.
ConJusticia will use the following procedures to ensure data quality throughout the LOA:
• Staff training: To promote data consistency, staff and grantees involved in data collection,
management, and/or reporting will be trained in SOPs.
• Validity is how well the data measures the intended result, and whether the data reflect a bias such
as interviewer bias, unrepresentative sampling, or transcription bias.
• Integrity stems from established mechanisms that eliminate or reduce the possibility that they are
manipulated for political or personal reasons.
• Precision ensures that the data present a fair picture of performance and enable decision-making.
Thus, data are required to be disaggregated at an appropriate level of detail.
• Reliability stems from stable and consistent data collection processes and analysis methods over
time.
• Timeliness is a critical aspect of data collection and reporting to USAID. Data should be timely
enough (and current enough when they are available) to support decision-making.
ConJusticia will contribute toward and actively participate in any external Data Quality Assessments (DQA)
as directed by USAID.
ConJusticia will report regularly to USAID, as appropriate, to ensure shared understanding of progress
toward objectives and learning associated with implementation. Any deviations from the schedule will be
agreed to in advance and documented between the COR and activity. A complete reporting schedule is
presented in Annex 4.
Under this activity, there will be three regular reports submitted to USAID that will include MEL input.
These include:
1. Quarterly Reports
2. Annual Reports
3. Final Report
All Quarterly, Annual, and Final activity reports submitted to USAID will be in accordance with contract
requirements and adhere to USAID’s Branding Implementation and Marking Plan.
Quarterly Reports
ConJusticia will submit performance progress reports on a quarterly basis within 30 days of the end of each
fiscal year quarter reflecting results and interventions of the preceding quarter. The format for these reports
follows the Mission’s Quarterly Progress Report template provided by the COR. These reports will be
concise and present the following information:
MONITORING, EVALUATION AND LEARNING PLAN 12
PROGRAMA PARA EL FORTALECIMIENTO DE INSTITUCIONES DE JUSTICIA PENAL ESTATAL (CONJUSTICIA)
• Executive Summary
• Progress to date for MEL indicators for that quarter, depending on data availability
• The specific accomplishments of the activity as well as any short-term technical assistance (STTA),
including information on all interventions, both ongoing and completed, by component, and
geographically by state and/or judicial district
• Highlights of any issues or problems that are affecting the delivery or timing of services
• Summary of activity progress against tasks and benchmarks, including tasks assigned through
technical directives and identify implementation issues that may inhibit or enhance performance
• Discussion on interactions with counterparts, and any necessary alterations to the work plan and
initial timetable
• Success stories, providing information that demonstrates the impact that the activity has had during
the reporting period through materials such as stories, quotes and photos (These success stories
will also be submitted separately via the Agency’s Telling Our Story website
(http://www.usaid.gov/stories/) after a review by the Mission’s Development and Outreach
Communications (DOC) team
• Reporting specifically on gender activities will be provided in the table format provided by USAID
ConJusticia will also submit an electronic copy of each quarterly progress report to the USAID Development
Experience Clearinghouse (DEC) in which politically sensitive or proprietary information is eliminated or
redacted.
Annual Reports
ConJusticia will prepare and submit to the COR an Annual Report for each year of activity implementation
no later than October 31st of each year. The Annual Report will reflect the structure of the annual work
plan and will report overall performance against MEL indicators during the USG fiscal year (FY), which runs
from October 1st to September 30th. The report will include explanations as to why targets were not
achieved or were exceeded, as applicable, and will describe any relevant analytical work, evaluations and
assessments over the year, along with any corresponding recommendations detailing how they are being
applied.
The Annual Report will highlight specific accomplishments and summarize results and interventions for the
year, both ongoing and completed, by component and geographically. The report will also identify any
problems, obstacles or challenges to performance that arose and proposed or applied solutions.
Final Report
The Final Report for the ConJusticia Activity, the draft of which will be submitted 30 days before contract
completion, will summarize the accomplishments and impact of ConJusticia in relation to expected results,
in accordance with the approved activity MEL Plan. Not exceeding 25 pages (with no more than 50 pages of
annexes), it will contain a three-page executive summary, an index of all reports and information products
produced under the ConJusticia contract and at a minimum will include:
• Incorporation of any additional/available evaluative data compared to activity results and any
explanatory background.
The final report may suggest ways to resolve identified constraints and provide recommendations for follow-
on work that might complement the work completed under ConJusticia.
The COR will provide written comments, and the Contracting Officer may likewise add written comments,
which the Contractor must address in revising the draft and submitting a final completion report no later
than 30 days past the end-date of the contract.
With COR approval, the final quarterly report can be combined with the Annual Report.
The COVID-19 pandemic presents innumerable challenges to implementation and subsequently MEL. To
that end, ConJusticia will monitor conditions in target states via Mexico’s COVID-19 Traffic Light Monitoring
System and will collaborate with stakeholders to effectively manage adaptively when and where necessary.
ConJusticia will conform to all DAI and USAID COVID-19 protocols and will employ social distancing and
appropriate protective measures to ensure neither staff nor stakeholders are put at risk through the work
of ConJusticia. If the pandemic persists into 2021, the MEL team may have to utilize technology platforms
such as Zoom, Microsoft Teams, among others, to interface with stakeholders and monitor from afar, since
there may be limitations to going to the field. The MEL team may need to conduct adaptations to the baseline
if, for example, collecting perception survey data is deemed too risky at the time. ConJusticia will work with
USAID and stakeholders to collectively determine the best path forward.
3. EVALUATION PLAN
Effective monitoring and analysis will help in evaluating the relevance, effectiveness, efficiency, and
sustainability of activities. The following section provides an illustrative list of evaluation questions that will
be informed and updated in consultation with USAID and its partners.
Throughout the life of the activity, ConJusticia will utilize a CLA Approach to continually review and revise
activities, in consultation with the COR.
To date, no formal internal evaluations are planned. Any undertaken in future though will be designed in a
way that meet the principles of USAID’s evaluation policy. This means that they will be unbiased, relevant,
based on the best methods, transparent, and planned for high utility, and will endeavor to address the most
important questions on our impact. Any internal evaluations will also be shared with key counterparts and
beneficiaries to garner feedback.
• Relevance: To what extent are activity objectives and methods still appropriate to strengthening
Mexico’s local criminal justice system on the state-level?
• Effectiveness: What are the major factors that have contributed to or prevented progress to date?
• Efficiency: Are project resources being used efficiently or could the same results have been achieved
with fewer resources or alternative approaches?
• Sustainability: To what extent is the program bringing about sustainable changes? To what extent are
the approaches being integrated into GoM systems? To what extent do the approaches have government
buy-in to continue their operation beyond the life of the program? To what extent have beneficiary
agencies collaborated in the development of program approaches? What are the key risks to longer-
term sustainability and what can be done to reduce these risks over the remainder of the program?
In accordance with USAID’s Evaluation Policy, ConJusticia will use evaluation methodologies with the dual
purposes of accountability to USAID, government partners and other stakeholders, and learning about key
results to improve effectiveness. In the simplest terms, evaluations planned for the activity will answer three
questions: What? So what? Now what? Answers to these questions will not only aim to understand the
activity’s effectiveness but also to generate new knowledge for how best the USG can support the GoM.
Regular monitoring of activity performance indicators will provide the answers to what questions as well as
demonstrate accountability. Evaluation questions will be used to answer the so what question and track
changes over time. Now what questions will be answered through our CLA work.
The ConJusticia Activity will cooperate fully with any USAID supported evaluations. This includes providing
feedback on draft evaluation designs, draft evaluation data collection instruments, and the draft evaluation
report, meeting with the evaluators, providing access to activity files and data, providing information as
requested, making staff available to answer questions related to our activities, and assisting with logistics and
meetings, where appropriate.
4.1 Collaboration
ConJusticia will collaborate with a multitude of stakeholders including USAID, the GoM, individual states,
civil society, the private sector, justice sector experts, and representatives from justice sector institutions
such as the FGEs, courts and public defense. In addition, ConJusticia will consult and collaborate regularly
with other USAID Activities such as the Justice Access for Victims and the Accused (JAVA) Activity, the
Bureau of International Narcotics and Law Enforcement Affairs (INL)-funded projects, and the Alliances for
Analysis and Communications (AA&C) Activity, among others.
ConJusticia will host annual Strategy Review Sessions (SRS) to enable ConJusticia activity leadership, key
local justice sector stakeholders, senior leaders from USAID’s other justice sector projects, and other USG
programs to discuss progress toward achievement of results and to learn from experience to adapt our
support appropriately. The SRS is an opportunity to collaborate and reflect on progress, and for local justice
sector stakeholders to provide feedback regarding their experience, identify priorities, and co-develop
strategies for future ConJusticia engagement. The SRS is not a directive approach but a facilitated dialogue
that enables local stakeholders to provide necessary feedback to project leadership so that adaptation can
occur.
4.2 Learning
The ConJusticia Activity’s learning agenda includes a set of questions that address critical knowledge gaps
that impede informed management decisions and therefore help to a) ensure relevance of the activity’s ToC
and RF, b) foster adaptation of activities as evidence emerges, and c) identify and focus on solutions that
contribute to short- and long-term priorities.
• How can we best support the GoM and individual states to reduce impunity, increase
accountability and improve citizen perceptions of the justice sector?
• What are the main limitations, positive and perverse incentives faced by justice sector institutions
and their operators?
MONITORING, EVALUATION AND LEARNING PLAN 16
PROGRAMA PARA EL FORTALECIMIENTO DE INSTITUCIONES DE JUSTICIA PENAL ESTATAL (CONJUSTICIA)
• How are civil society and the private sector engaged with public justice sector institutions?
• What are the priorities of each local criminal justice system we work with? Why?
• How can we improve and adapt our activities, and can these lessons apply to other USAID-funded
activities?
• How does the justice sector in Mexico impact women and marginalized people differently from men?
The ConJusticia Activity will use a range of methods, as appropriate, to implement the activity learning
agenda and facilitate an environment for adaptive management, including:
• Conducting ongoing situational analyses, including Political Economic Analyses, of the national and
state-level implementation context
• Working with designated partners to conduct internal and partner group discussion sessions
focusing on solutions and lessons learned
• Reviewing and synthesizing performance data and incorporating regular feedback loops with key
stakeholders before, during, and after implementation
• Convening regular staff meetings and field visits to review activities and identify points of success
and failure, obstacles and opportunities
The senior leadership team of ConJusticia will use a collection of structured communication, information
sharing procedures, and events to inform cross-functional team learning and identify and address bottlenecks
or challenges. Table 3, below, summarizes the CLA events ConJusticia will use to inform adaptive
management responses.
The KM and CLA and M&E Teams will play a critical role in capturing lessons from activities in each state
and working with the technical team to transform lessons learned into replicable models and approaches
that can be transferred to stakeholders in other states. The Senior M&E Manager will be responsible for
overseeing the project’s MEL Plan while the KM and CLA Director will facilitating the project’s CLA-based
adaptive management events described in this MEL Plan.
The Senior M&E Manager, in close coordination with the KM and CLA Director, will develop and maintain
the ConJusticia MEL system, ensure effective, timely, and accurate data collection/quality. She/he will track
activity performance to inform adaptive management and analyze data for input into contractual reports,
overseeing learning and collaboration across project staff, partners, and offices.
6. CHANGE LOG
The activity MEL Plan will be updated when significant adjustments are made to the activity in response to
new information and changes in context. This section includes Table 4, which will be used to describe and
document the changes that are made to the activity MEL Plan over time.
Senior M&E 1. % of justice system Originally “% of citizens expressing trust in justice institutions,”
Manager users expressing the indicator was modified in consultation with USAID to focus
trust in justice solely on justice system users. This change was made so as not
institutions to be repetitive with Context Indicators A and B, which report
data from an extensive national survey, ENVIPE, that can be
disaggregated by state and adequately reflect changes in public
perception of key justice sector actors. ConJusticia will
implement a brief user survey that measures both perception of
justice institutions and actors, as well as level of satisfaction with
services received, particularly updates on cases (Indicator 1.5.1).
The survey will be administered annually.
1.2.1 # of USG- This Standard Indicator DR.1.5-1 was added and is linked to
assisted courts with ConJusticia Sub-IR 1.2, “Internal processes and management of
improved case FGEs and courts strengthened.”
management systems
1.2.2 # if improved This indicator was added at USAID’s request and is linked to
management systems ConJusticia Sub-IR 1.2, “Internal processes and management of
and tools adopted by FGEs and courts strengthened.”
criminal justice
institutions
1.3.1 % of cases with Indicator name and description changed to measure cases with
an investigation plan an investigation plan. The change from “cases using admissible
forensic evidence” to “cases with an investigation plan” was
made for increased clarity. The changed was based primarily on
the fact that only evidence already deemed admissible in the
intermediate hearing can be “used” in a criminal case. Likewise,
of the many pieces of evidence submitted for a given case, some
but not all may be deemed admissible and this information is only
found by reviewing individual hearing transcripts, thus
complicating data collection and measurement. The use of an
investigation plan for a case, however, both includes admissible
forensic evidence and also broadens the definition to include the
work of a wider, interdisciplinary investigation team, including
data analytics and the strategic investigation and prosecution
process as a whole and is thus considered a more appropriate
indicator of improved investigation quality. Data collection will
consist of reviewing a representative sample of open case files
and FGE records to assess a set of quality components and
criteria, including the use of an investigation plan, the use of data
analytics, integration of a GESI perspective generally for all cases
as well as for specific GBV cases.
1.4.1 # of intelligence Changes made to clarify that crime analysis units produce data
products produced and analysis but do not investigate crimes. Rather, these units
by crime analysis produce intelligence products for specialized investigation units.
units The use of data analytics for criminal investigations will be
measured as a sub-component of indicator 1.3.1 % of cases with
MONITORING, EVALUATION AND LEARNING PLAN 22
PROGRAMA PARA EL FORTALECIMIENTO DE INSTITUCIONES DE JUSTICIA PENAL ESTATAL (CONJUSTICIA)
7. ANNEXES
1.2.2 # of improved Output New 2020 0 TBD TBD TBD TBD TBD State Annual Activity Geographic
management systems records ___location;
and tools adopted by type of
criminal justice system or
institutions tool,
institution
1.3.1 % of cases with an Outcome New 2020 TBD TBD TBD TBD TBD TBD State Annual FGE office Type of
investigation plan records crime;
geographic
___location;
inclusion of
GESI
perspective
1.4.1 # of intelligence Outcome New 2020 0 TBD TBD TBD TBD TBD State Annual FGE office Geographic
products produced by records ___location;
crime analysis units inclusion of
GESI
perspective
1.4.2 % decrease in Outcome New 2021 TBD TBD TBD TBD TBD TBD State Annual Court Geographic
deferred court records ___location
hearings for high-
priority cases
1.5.1 % of users receiving Outcome Active 2021 TBD TBD TBD TBD TBD TBD State Annual ConJusticia Type of
updates on case status survey user; sex;
geographic
___location
2.1 # of agreements, Outcome Active 2020 0 TBD TBD TBD TBD TBD State Annual Activity Geographic
protocols and systems records ___location;
implemented resulting inclusion of
from collaboration GESI
among justice actors perspective
2.1.1 % decrease in average Outcome Active 2020 TBD TBD TBD TBD TBD TBD State Annual State Type of
time for all case Court crime;
resolutions in State records resolution
Courts type;
Geographic
___location
2.2.1 % decrease in average Outcome New 2021 TBD TBD TBD TBD TBD TBD State Annual FGE office Type of
case resolution time and State crime;
for high-priority cases Courts geographic
records ___location
1.2.2 # of improved management systems and tools adopted by criminal justice institutions
State Courts
(TSJ) 1.4.2 % decrease in deferred court hearings for high-priority cases
2.1.1 % decrease in average time for all case resolutions in State Courts
CC3 # of training and capacity building activities conducted with USG assistance that are designed to
promote the participation of women or the integration of gender perspectives in security sector
institutions or activities
Name of Relevant Result(s) (Goal, DO, IR, sub-IR, Project Purpose, Project Output, etc.): Activity Goal: Increased
effectiveness of the Mexican criminal justice system, primarily at the state level, in order to reduce impunity, increase
accountability and improve citizen perceptions of the justice sector
DESCRIPTION
Precise Definition(s): The purpose of this survey is to generate information at the national level, by federal entity and
metropolitan areas of interest on the phenomenon of criminal victimization, as well as the social perception regarding public
safety and the performance of the authorities, to provide information to society and those who make public policy decisions in
these matters.
The ENVIPE survey question that is relevant to this indicator is: Nivel de percepción de confianza de la sociedad en autoridades
– Jueces
Method of data collection and construction: Selection of the sample - Probabilistic: three-stage, stratified and by
conglomerates. Observation units - Selected dwellings, households, household residents and the selected person in the
household. Study population - Population aged 18 years and over. National sample size 102,043 households. Geographic
Coverage - At the National, Urban National, Rural National, federal entity and metropolitan areas of interest.
Reporting Frequency: Annual
Individual(s) responsible at USAID: COR on ConJusticia contract
Trigger: TBD
Name of Context Indicator: B. Level of perception of society's trust in Attorneys General Offices
Name of Relevant Result(s) (Goal, DO, IR, sub-IR, Project Purpose, Project Output, etc.): Activity Goal: Increased
effectiveness of the Mexican criminal justice system, primarily at the state level, in order to reduce impunity, increase
accountability and improve citizen perceptions of the justice sector
DESCRIPTION
Precise Definition(s): The purpose of this survey is to generate information at the national level, by federal entity and
metropolitan areas of interest on the phenomenon of criminal victimization, as well as the social perception regarding public
safety and the performance of the authorities, to provide information to society and those who make public policy decisions in
these matters.
The ENVIPE survey question that is relevant to this indicator is: Nivel de percepción de confianza de la sociedad en autoridades
– Ministerio Público (MP) y Fiscalías Estatales
Method of data collection and construction: Selection of the sample - Probabilistic: three-stage, stratified and by
conglomerates. Observation units - Selected dwellings, households, household residents and the selected person in the
household. Study population - Population aged 18 years and over. National sample size 102,043 households. Geographic
Coverage - At the National, Urban National, Rural National, federal entity and metropolitan areas of interest.
Reporting Frequency: Annual
Individual(s) responsible at USAID: COR on ConJusticia contract
Trigger: TBD
DATA QUALITY
Known Data Limitations: None to date
CHANGES TO CONTEXT INDICATOR
Changes to Indicator: Baseline timeframe updated to 2020. Disaggregated by sex and geographic ___location. Indicator name
and description updated to align to the ENVIPE categorization of “Attorneys General Offices” as opposed to
“Prosecutors.”
Other Notes:
THIS SHEET LAST UPDATED ON: May 6, 2021
Name of Context Indicator: C. Average citizen confidence that courts guarantee a fair trial
Name of Relevant Result(s) (Goal, DO, IR, sub-IR, Project Purpose, Project Output, etc.): Activity Goal: Increased
effectiveness of the Mexican criminal justice system, primarily at the state level, in order to reduce impunity, increase
accountability and improve citizen perceptions of the justice sector
DESCRIPTION
Precise Definition(s): This indicator reflects the average citizen confidence that courts will guarantee a fair trial. This
survey question is part of the “AmericasBarometer” survey by the Latin American Public Opinion Project (LAPOP). The
survey provides a tool for assessing the public’s experiences with democratic governance and assess the extent to which
citizens experience the rule of law, among other topics. The LAPOP survey question relevant to this indicator is: ¿Hasta qué
punto cree usted que los tribunales de justicia de México garantizan un juicio justo?
Method of data collection and construction: The LAPOP survey was conducted using a national probability sample
design of voting-age adults, with a sample size of 1,580 people involving face-to-face interviews conducted in Spanish and using
the Survey To Go software.
Reporting Frequency: Annual
Individual(s) responsible at USAID: COR on ConJusticia contract
DATA QUALITY
Known Data Limitations: None to date
CHANGES TO CONTEXT INDICATOR
Changes to Indicator:
Other Notes:
THIS SHEET LAST UPDATED ON: February 8, 2021
Name of Relevant Result(s) (Goal, DO, IR, sub-IR, Project Purpose, Project Output, etc.): Activity Goal: Increased
effectiveness of the Mexican criminal justice system, primarily at the state level, in order to reduce impunity, increase
accountability and improve citizen perceptions of the justice sector
DESCRIPTION
Precise Definition(s): The purpose of this survey is to generate information at the national level, by federal entity and
metropolitan areas of interest on the phenomenon of criminal victimization, as well as the social perception regarding public
safety and the performance of the authorities, to provide information to society and those who make public policy decisions in
these matters.
The ENVIPE survey question relevant to this indicator is: percentage of crimes committed in which there was no complaint or
an investigation folder was not initiated during 2019.
Method of data collection and construction: Selection of the sample - Probabilistic: three-stage, stratified and by
conglomerates. Observation units - Selected dwellings, households, household residents and the selected person in the
household. Study population - Population aged 18 years and over. National sample size 102,043 households. Geographic
Coverage - At the National, Urban National, Rural National, federal entity and metropolitan areas of interest.
Reporting Frequency: Annual
Individual(s) responsible at USAID: COR on ConJusticia contract
Trigger: TBD
DATA QUALITY
Known Data Limitations: None to date
CHANGES TO CONTEXT INDICATOR
Changes to Indicator:
Other Notes:
THIS SHEET LAST UPDATED ON: February 8, 2021
Name of Context Indicator: E. Rule of Law Index for Mexico – Criminal Justice Factor
Name of Relevant Result(s) (Goal, DO, IR, sub-IR, Project Purpose, Project Output, etc.): Activity Goal: Increased
effectiveness of the Mexican criminal justice system, primarily at the state level, in order to reduce impunity, increase
accountability and improve citizen perceptions of the justice sector
DESCRIPTION
Precise Definition(s): The World Justice Project (WJP) Rule of Law Index measures the rule of law based on the experiences
and perceptions of the general public and in-country legal practitioners and experts worldwide. The Index provides scores and
rankings based on eight factors: Constraints on Government Powers, Absence of Corruption, Open Government, Fundamental
Rights, Order and Security, Regulatory Enforcement, Civil Justice, and Criminal Justice. Scores range from 0 to 1, with 1
indicating the strongest adherence to the rule of law. This context indicator will focus on the criminal justice factor of this index
for Mexican States.
Method of data collection and construction: Index scores range from 0 to 1, with 1 indicating the strongest adherence
to the rule of law. The scores and rankings of the eight factors and 44 sub-factors of the Index draw from two sources of
data collected by the WJP: 1. A General Population Poll (GPP) using a representative sample of 1,0001 respondents in each
country and jurisdiction; 2. Qualified Respondents’ Questionnaires (QRQs) consisting of closed-ended questions completed
by in-country legal practitioners, experts, and academics.
Reporting Frequency: Annual
Individual(s) responsible at USAID: COR on ConJusticia contract
Trigger: TBD
Rationale for Trigger: TBD
DATA QUALITY
Known Data Limitations: None to date
CHANGES TO CONTEXT INDICATOR
Changes to Indicator:
Other Notes:
THIS SHEET LAST UPDATED ON: February 8, 2021
Number and Name of Indicator: 1. % of justice system users expressing trust in justice institutions
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): Activity Goal: Increased effectiveness of the
Mexican criminal justice system, primarily at the state level, in order to reduce impunity, increase accountability and improve
citizen perceptions of the justice sector.
DESCRIPTION
Precise Definition(s): This indicator measures the percent of justice system users in target Mexican states who express trust
in the justice system via the ConJusticia sample-based survey. On the survey, respondents will be asked ‘to what extent do you
trust justice institutions?’ and will be asked to respond via a Likert even-point scale. Specific questions on user perceptions of
Attorneys General Offices and State Courts will also be asked.
Numerator: Number of justice system users responding that they trust justice institutions
Denominator: Total number of users surveyed
Method of data collection and construction: ConJusticia will conduct annual sample-based user surveys.
Reporting Frequency: Annual
Baseline Timeframe: The baseline for this indicator is identified as to-be-determined (TBD) as ConJusticia will need to
conduct original research to establish these figures. This will take place in 2021
CHANGES TO INDICATOR
Changes to indicator: Indicator modified to focus solely on justice system users as opposed to the general public.
Reporting frequency changed to annual and disaggregation added to track sex, applicable vulnerable populations, and
geographic ___location.
Number and Name of Indicator: 1.1 Percent increase in prosecution rates for high priority cases
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): IR 1 Individual justice sector institutions
prioritize and fully prosecute higher-level serious criminal cases
DESCRIPTION
Precise Definition(s): This indicator measures the percent increase over baseline value in prosecution rates specifically for
high priority cases. ‘High-priority cases’ are in this case defined as those cases that if properly addressed, can have the largest
impact on citizen satisfaction with the justice system. They include serious and high-impact cases as well as less serious activities
due to public concern as determined by prioritization processes.
Annual prosecution rates for serious crimes (such as homicides) are calculated by obtaining the total number of indictments
divided by the total number of investigations conducted by targeted investigation and prosecution units, or for priority cases as
defined in state prioritization frameworks. For serious crimes, indictments will be calculated as vinculación al proceso, although
the program will collect data on the following additional data points: judicialización; formulación de imputación; and acusación, to
provide an integral analysis of the prosecutorial process. For other types of crimes, such as robbery or domestic violence, the
calculation is the number of cases disposed through alternative resolutions (i.e., agreements or pre-trial diversion) plus those
that reach indictments divided by the total number of investigations conducted for the given priority cases. In order to determine
percent change in prosecution rates, the following calculation will be used:
Numerator: (prosecution rate for high priority cases in current year) – (Baseline value of prosecution rate for high priority
cases)
Denominator: Baseline value of prosecution rate for high priority cases
The baseline value will be calculated using all open investigations of priority cases in a given calendar year regardless of the year
the case was opened.
Unit of Measure: Percent increase in prosecution rates
Disaggregated by: Type of crime (homicide, rape, kidnapping, aggravated robbery, domestic violence, other); Geographic
___location
Method of data collection and construction: Activity staff will undertake a desk review of FGE office and State Courts
records, then content analysis and physical verification.
Baseline Timeframe: The baseline for this indicator is identified as to-be-determined (TBD) as ConJusticia will need to
conduct original research to establish these figures. This will take place in 2021
CHANGES TO INDICATOR
Changes to indicator: Description updated to clarify at what point indictments will be calculated and that all open
investigations will be counted regardless of the year the case was opened.
Number and Name of Indicator: 1.1.1 Number of state-level prosecution prioritization frameworks developed
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): Sub-IR 1.1: Improved capacity of FGEs to
prioritize cases based on criminal prosecution prioritization frameworks
DESCRIPTION
Precise Definition(s): This indicator measures the number of prosecution prioritization frameworks developed on the state-
level. Prosecution prioritization frameworks refer to frameworks that order criminal cases based on prosecution strategies that
include factors such as incidence, urgency for resolution, connection to known past offenders or criminal structures and type
of victim. This may include but not be limited to strategic criminal prosecution policies and will consider only state-level
frameworks.
Prioritization is conducted with public participation and based on citizen perceptions. Priority rankings determine how justice
sector entities should apportion their limited resources. By building the internal capacity of FGE and Courts to prioritize and
fully prosecute high-priority crimes and improving coordination and collaboration of various justice sector institutions on policy,
operations, resource allocations, information sharing, tools and process around this priority, the justice system will improve
prosecutions and reduce impunity. This indicator will also consider the inclusion of a GESI perspective by tracking the
prioritization frameworks that prioritize or provide differentiated treatment for individuals from groups who, due to historical
and social contexts, have been systematically and structurally discriminated against. These include women, girls and other
vulnerable populations such as LGBTQI+, people with disabilities, indigenous populations, and other marginalized groups. A
prioritization framework may be designed specifically for Gender Based Violence or may integrate a GESI perspective into the
prioritization of other types of cases. This prioritization emphasis elevates the relevance of working with FGEs and the rest of
the justice system and local system stakeholders to develop effective participatory prioritization frameworks. A framework will
be counted once it has been finalized
CHANGES TO INDICATOR
Changes to indicator: Change in Definition for added clarity. Change to indicator description, data collection plan and
reporting frequency. Disaggregation added regarding whether frameworks include consideration of GESI perspective,
whether that be an explicit focus on Gender Based Violence or the integration of GESI considerations throughout a
framework for other types of crime.
Other Notes (optional): Description modified to clarify that prioritization frameworks may include but are not limited to
strategic criminal prosecution policies.
DESCRIPTION
Precise Definition(s): Improved is defined as a case management system that has reduced the number of days required for a
case to be dealt with by the appropriate actor within the system, whether it be going to trial or otherwise resolved.
Types of functional areas within case management systems include: controlling forms; establishing record control; case
processing and record updating; scheduling case events; controlling and storing final records; and reporting management
information.
Without reliable data, courts cannot deliver timely justice, control or monitor their own operations, or explain their operations
to citizens. The lack of information on court operations makes citizens suspicious about the fairness, transparency, and integrity
of the rule of law. Closed, secretive justice systems create the perception and often the reality of favoritism, malfeasance, and
denial of basic rights. Thus, the introduction of high-quality court management information systems affects not only efficiency,
but also effectiveness. It can have a significant impact on central ROL issues, such as human rights, access to justice, transparency,
and development of democratic institutions and society. USG assistance for an improved case management system will lead to
confidence in the judicial system which leads to increased confidence in the government; It can also increase confidence in the
economic environment.
Unit of Measure: Number of State Courts
MONITORING, EVALUATION AND LEARNING PLAN 37
PROGRAMA PARA EL FORTALECIMIENTO DE INSTITUCIONES DE JUSTICIA PENAL ESTATAL (CONJUSTICIA)
Data Type: Integer
Rationale or Justification for indicator (optional): USG Standard Indicator DR.1.5-1. The number of improved case
management systems could provide information useful in project planning because it indicates the capacity of a given court
system. It is also useful in reporting purposes to show level of effort to improve case management systems.
DESCRIPTION
Precise Definition(s): This indicator measures the total number of improved management systems and tools with
demonstrated adoption by target justice institutions. Systems and tools are defined as actionable elements towards the
improvement of institutional performance, such as new or reformed laws, policy changes, and/or procedures, protocols,
methodologies or information technology that enhance organizational models, streamline processes, and/or promote data-
driven decision making and the implementation of best practices and innovations.
Adoption means any management system or tool, at any institutional level, that is newly drafted or revised and has received
official approval (legislation/decree) by the relevant institutional authority, even if not yet implemented.
Disaggregated by: Geographic ___location, type of system or tool, inclusion of GESI perspective, institution
Data Source: FGE office and State Courts records, ConJusticia activity records
Method of data collection and construction: ConJusticia will work closely with State Courts and FGEs to track the
development, approval and adoption of improved case management systems and tools.
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): Sub-IR 2.2: Enhanced collaboration among
prosecutors, police, and investigators to improve the speed and quality of investigations and prosecutions for high-priority
crimes
DESCRIPTION
Disaggregated by: Type of crime (homicide, rape, kidnapping, aggravated robbery, domestic violence, other); Geographic
___location, inclusion of GESI perspective.
Method of data collection and construction: Activity staff will undertake a desk review of FGE office records to
randomly select representative sample of active case files, then content analysis and physical verification. Regarding GESI
integration, both investigation plans that incorporate a gender perspective and/or use of gender-related tools regardless of
type of crime, as well as investigations specifically for GBV-related cases will be counted.
Baseline Timeframe: The baseline for this indicator is identified as to-be-determined (TBD) as ConJusticia will need to
conduct original research to establish these figures. This will take place in 2021.
CHANGES TO INDICATOR
Changes to indicator: Indicator name and description changed to measure cases with an investigation plan, with
consideration for the use of data analytics and incorporation of a GESI perspective. Data source updated to reflect only
FGE office records and data collection plan updated for clarity.
Number and Name of Indicator: 1.4.1 # of intelligence products produced by crime analysis units
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): Sub-IR 1.4 Improved data tracking and analytics
capacity of FGE and courts to better manage and resolve high-priority cases
DESCRIPTION
Precise Definition(s): This indicator measures the number of intelligence products created by crime analysis units for use
in crime investigations. Intelligence products are those reports, data visualizations, and other information pieces created by
crime analysis units using data, information and intelligence to identify trends, criminal patterns, hotspots, criminal
organizations, etc. in an effort to identify key players who should be prosecuted. FGEs vary in their capacity to make proper
use of data to enhance their performance. Technology systems implementation varies widely throughout Mexico and there is
variable capacity of local stakeholders to understand which data is important to collect, process, and use to make decisions. It
is important to note that crime analysis units produce data and intelligence products to inform investigations but do not
conduct investigations, as that is the role of specialized investigation units for which the intelligence products are designed.
Method of data collection and construction: ConJusticia will assess the level of existing capacity and commitment of
each target analysis unit to use data analytics to inform the investigation and prosecution of high-priority cases and track the
creation of intelligence products as well as their use under indicator 2.2.1.
CHANGES TO INDICATOR
Changes to indicator: Change to indicator name, description, and data collection plan.
Other Notes (optional): Changes made to clarify that it is the specialized investigation units or teams (including task
forces), not the crime analysis unit, that conducts investigations using data analytics. The crime analysis unit produces data
and intelligence products but does not investigate crimes.
Number and Name of Indicator: 1.4.2 % decrease in deferred court hearings of high-priority cases
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): Sub-IR 1.4 Improved data tracking and analytics
capacity of FGE and courts to better manage and resolve high-priority cases
DESCRIPTION
Precise Definition(s): This indicator measures the percent decrease from the baseline value of court hearings of high-priority
cases deferred. In this case, a court hearing is a dispute between two parties that is decided in a court of law. Deferred means
that the hearing was postponed. Deferrals can be attributable to any of the parties involved and this indicator will seek to
disaggregate to the extent possible the cause for deferrals so as to identify and analyze those that are unjustified, aiming to
reduce these instances through program technical assistance and other court management interventions.
Numerator: (number of court hearings of high-priority cases deferred in current year) – (Baseline value of court hearings of
high-priority cases deferred)
Denominator: Baseline value of court hearings of high-priority cases deferred
Method of data collection and construction: Activity staff will review Courts records to determine
CHANGES TO INDICATOR
Changes to indicator: Changes to indicator name and description. Added sub-intermediate result measured.
Other Notes (optional): The original indicator was framed to seek an increase in the number of hearings conducted,
however more hearings do not indicate improved capacity by the State Court to manage and resolve high-priority cases.
Deferred hearings are a primary cause of rising numbers in hearings, and also represent bottlenecks in criminal justice
proceedings that negatively affect case resolution times. The changes to measure a decrease in hearings deferred seeks to
measure a key factor in criminal justice effectiveness as well as improved capacity by the institution to process high-
priority cases. ConJusticia’s work aims to reduce is the unjustified or preventable deferrals, such as those requested by
judges due to personal preferences, or those caused by failed court notifications (i.e. when parties do not present at a
hearing because they were improperly notified of their court date).
Number and Name of Indicator: 1.5.1 % of users receiving updates on case status
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): Sub-IR 1.5: Improved communication,
transparency, & accountability of justice sector institutions through proactive engagement with users and the public
DESCRIPTION
Precise Definition(s): This indicator measures the percentage of users of the criminal justice system who know about their
cases from direct communication originating from the FGE or Courts. Direct users of the system include the accused, victims,
and their families.
Numerator: Number of users surveyed who indicate they received updates on the status of their case via direct
communication originating from the FGE or Courts
Denominator: Total number of users of the criminal justice system surveyed
Baseline Timeframe: The baseline for this indicator is identified as to-be-determined (TBD) as ConJusticia will need to
conduct original research to establish these figures. This will take place in 2021
CHANGES TO INDICATOR
Number and Name of Indicator: 2.1 # of agreements, protocols and systems implemented resulting from collaboration
among justice actors
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): IR2 Justice sector actors within the various
institutions collaborate across institutions resulting in improved prosecutions and reductions in impunity
DESCRIPTION
Precise Definition(s): This indicator measures the number of agreements or protocols or systems implemented resulting
from collaboration among justice actors. Justice actors include but are not limited to judges, police officers, prosecutors. Some
examples could include protocols for evidence collection, protocols for investigation of crimes against female victims, protocols
that help in the collection of evidence, agreements reached under 100-DC. Agreements, protocols and systems will only be
counted once they have been put into place and acted upon or used and those related to the incorporation or mainstreaming
of a GESI perspective will be identified and highlighted.
Disaggregated by: Type (agreement, protocol, system), Geographic ___location, inclusion of GESI perspective
Method of data collection and construction: ConJusticia staff will review Activity records collected to determine which
agreements, protocols and systems were planned and follow up with justice sector actors to confirm which have been
implemented and how. GESI-related agreements, protocols and systems will also be counted and reported.
CHANGES TO INDICATOR
Changes to indicator: Reporting frequency changed from quarterly to annually. Disaggregation added regarding
consideration of GESI perspective in agreements, protocols and systems implemented.
Number and Name of Indicator: 2.1.1. % decrease in average time for all case resolutions in State Courts
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): Sub-IR 2.1: Mechanisms for inter-institutional
collaboration strengthened
DESCRIPTION
Precise Definition(s): This indicator measures the percent change from baseline values of average time in days/months for
case resolutions within the State Court for all types of crimes. This indicator particularly focuses on the conviction process
within the judicial system, or the final resolution determined by the judge of what happens with a case. Final resolution could
be conviction or alternative dispute resolution, among others. The indicator seeks to measure structural and systemic
improvements that are reflected in the Court overall, and thus they local justice system more widely. If a case is well prepared
and focused and worked on collaboratively with other actors involved, such as the victims, defense council, police, etc. then the
resolution should be streamlined, and frivolity eliminated. This indicator will measure the process beginning from when the case
has entered the judiciary stage, i.e., has been filed with the court, until resolution.
Numerator: (average time for case resolution during the current year) – (Baseline value of average time for case resolution)
Denominator: Baseline value of average time for case resolution
Unit of Measure: Percent reduction in average time
Baseline Timeframe: The baseline for this indicator is identified as to-be-determined (TBD) as ConJusticia will need to
conduct original research to establish these figures. This will take place in 2021
Rationale for Targets (optional):
DESCRIPTION
Precise Definition(s): This indicator measures the reduction in average case resolution time for high-priority cases from
baseline values collected at the start of the Activity. Resolution time in this case means the average amount of time that a high-
priority case spends, in days, within the internal pipelines of both the FGE and State Court, beginning with the apertura de
carpeta de investigación. It is the speed at which an institution processes a case from the initial date when it first enters the
system, i.e., the crime has been assigned an investigative casefile number by the FGE, until the final date when it reaches an
appropriate resolution in the State Court. The legal definition of what constitutes a resolution will be determined by type of
crime or criminal phenomenon. ‘High-priority cases’ are in this case defined as those cases that if properly addressed, can have
the largest impact on citizen satisfaction with the justice system. They include serious and high-impact cases as well as less
serious activities due to public concern as determined by prioritization processes, which will vary in each target state.
Numerator: (Average time for case resolution in high-priority cases during the current year) – (Baseline value of average time
for case resolution in high-priority cases)
Denominator: Baseline value of average time for case resolution in high-priority cases
MONITORING, EVALUATION AND LEARNING PLAN 46
PROGRAMA PARA EL FORTALECIMIENTO DE INSTITUCIONES DE JUSTICIA PENAL ESTATAL (CONJUSTICIA)
Unit of Measure: Percent decrease in average case resolution time
Number and Name of Indicator: 3.1 # of multi-sector networks related to justice sector operating
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): IR 3: Durable partnerships among key local
stakeholders in the justice sector strengthened
DESCRIPTION
Method of data collection and construction: ConJusticia staff will review Activity records collected to determine which
networks have been organized or planned and follow up to confirm which are operating. The sectors represented within each
network and the number of members of professional networks supporting justice system strengthening efforts within these
networks will also be tracked.
Baseline Timeframe: The baseline for this indicator is identified as to-be-determined (TBD) as ConJusticia will need to
conduct original research to establish these figures. This will take place in 2021.
CHANGES TO INDICATOR
Changes to indicator: Indicator description modified to include virtual communications given that networks may be
operating under remote working conditions due to the COVID-19 pandemic. Reporting frequency changed from
quarterly to annual. Data collection plan updated to consider sector representation. Disaggregation added to track sector
representation.
Number and Name of Indicator: 3.1.1 # of innovations supported through USG assistance with demonstrated uptake by
the public and/or private sector
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): Sub-IR 3.1: Networks of justice sector
institutions, civil society, academia, and private sector for developing local solutions strengthened
DESCRIPTION
Precise Definition(s): This indicator will measure the number of innovations, both technology-based and those which do not
include technology, that support justice sector effectiveness. For the purposes of this indicator, innovations should also include
only those that are developed and adopted through collaboration between different players. These innovations can come in
many forms including collaborative problem solving, solutions design, and different types of implementation. Innovations will be
counted once they have been developed and adopted. Adoption, or uptake, means any innovation at any government level, that
is newly developed and has received official approval (legislation/decree/internal regulations/standard operating procedures) by
the relevant authority (institutional leadership).
Unit of Measure: Number of innovations
Rationale or Justification for indicator (optional): This is a USG standard indicator (IRS_Cross-cutting - STIR-11)
Method of data collection and construction: ConJusticia staff will review Activity records to determine. Before the end
of ConJusticia, these innovations should be maintained at the MJIN. Once this happens, this should be the data source
Changes to indicator: Indicator name and description changed to align with USG Standard Indicator IRS_Cross-cutting -
STIR-11. Reporting frequency changed from quarterly to annually. Disaggregation added to consider whether innovations
include GESI perspective.
Number and Name of Indicator: CC1. # of judicial personnel trained with USAID assistance (DR 1.3-1)
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): Crosscutting - all Activity IRs and sub-IRs
Is this a Performance Plan and Report Indicator? Yes, DR 1.3-1. For years 2021, 2022, 2023, 2024, 2025
DESCRIPTION
USAID’s Precise Definition(s): Judicial personnel includes judges, magistrates, prosecutors, advocates, inspectors and court
staff. Training refers to all training or education events whether short-term or long-term, in-country or abroad.
People attending the same type of training, but on different subjects can be counted twice. Narrative reports should indicate
the type of training, who the training is for, level of training, duration of training, what constitutes completion. It is required that
trainings follow a documented curriculum with stated objectives and/or expected competencies; all data should be sex-
disaggregated; and where possible, training should meet national or international standards.
Method of data collection and construction: Attendance records and training materials are collected for all Activity
training courses
CHANGES TO INDICATOR
Number and Name of Indicator: CC2. # of people reached by a USG-funded intervention providing GBV services (e.g.,
health, legal, psycho-social counseling, shelters, hotlines, other)
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): Crosscutting - all Activity IRs and sub-IRs
DESCRIPTION
USAID’s Precise Definition(s): This indicator is a count of the individuals served by GBV services.
Gender-based violence (GBV) is an umbrella term for any harmful act that is perpetrated against a person’s will, and that is
based on socially ascribed (gender) differences between males and females. Forms of gender-based violence include, but are
not limited to, domestic or intimate partner violence; rape as a weapon of war; sexual violence and abuse; female infanticide;
psychological or emotional abuse; sexual harassment or violence in the workplace or in educational institutions; and harmful
traditional practices including female genital mutilation/cutting, honor crimes, early marriage, forced marriage, bride kidnapping,
and dowry-related violence; and violence based on sexual orientation or gender identity (SOGI).
Rationale or Justification for indicator (optional): USG Standard Indicator GNDR 6. Information generated by this
indicator will be used to monitor and report on achievements linked to broader outcomes of gender equality and female
empowerment and will be used for planning and reporting purposes by Agency-level, bureau-level and in-country program
managers. Specifically, this indicator will inform required annual reporting or reviews of the USAID Gender Equality and
Female Empowerment Policy; Women, Peace, and Security Act of 2017; and the U.S. Strategy to Prevent and Respond to
Gender-Based Violence Globally, as well as Joint Strategic Plan reporting in the APP/APR, and Bureau or Office portfolio
reviews. Additionally, the information will inform a wide range of gender-related public reporting and communications
products, and facilitate responses to gender-related inquiries from internal and external stakeholders such as Congress,
NGOs, and international organizations.
Method of data collection and construction: Activity records such as attendance lists will be maintained for all relevant
gender activities.
CHANGES TO INDICATOR
Number and Name of Indicator: CC3. # of training and capacity building activities conducted with USG assistance that
are designed to promote the participation of women or the integration of gender perspectives in security sector
institutions or activities
Name of Result Measured (DO, IR, sub-IR, Project Purpose, etc.): Crosscutting - all Activity IRs and sub-IRs
Is this an Outcome of Output? Output
Is this a Performance Plan and Report Indicator? Yes, GNDR 9. This indicator is a standard gender indicator and links
primarily to Program Areas PS.9 (Citizen Security and Law Enforcement) and DR.2.5 (Executive Authority - Security
Sector-Civilian).
DESCRIPTION
USAID’s Precise Definition(s): This indicator counts the number of USG-funded activities that promote: the participation
of women in security sector institutions and activities; the integration of gender perspectives, needs, and priorities in security
sector initiatives or activities; or, the increased ability of individuals or institutions in the security sector to address the distinct
needs and priorities of males and females.
The activity will count under this indicator if the activity’s primary objective is to accomplish the above objectives or if the
activity contains the above objectives as a secondary objective (e.g., peacekeeping pre-deployment training event with a gender
needs/gender-based violence (GBV) block of instruction). Security sector institutions in this case include the FGE and Courts.
In addition, the training initiatives include but are not limited to training events (i.e., workshops, courses, and seminars) as well
as projects that produce tangible training documents (i.e., program of instruction (POI), manuals & publications).
Examples of training activities:
• Instructional workshop for police units on appropriate methods for engaging with survivors of gender-based violence
• Development of manual or action plan for engaging women in a national security sector reform agenda or initiative
• Community outreach campaigns focused on improving women’s access to security sector services (e.g., radio, television,
newspaper or other outlets, including community meetings
Examples of capacity building initiatives:
• Professional development or mentoring program for new female police or military personnel
• Establishing procedures to assess and improve working conditions for female police officers
Method of data collection and construction: Activity records including agendas, presentations, and training materials will
be maintained for all relevant gender activities.
CHANGES TO INDICATOR