Measurement Plan and Analytic Strategies for Evaluating the Mayor’s Action Plan for Neighborhood Safety

This second in a series of reports about the evaluation of the New York City Mayor’s Action Plan for Neighborhood Safety (MAP). This Evaluation Update: summarizes the goals and methods used to evaluate the Mayor’s Action Plan; describes the quasi-experimental design used to test the outcomes and impacts of MAP as well as the data sources assembled by the research team and how they are used; and portrays a logical framework the research team used initially to identify causal pathways through which various elements of MAP were intended to achieve their desired effect. Continue reading Measurement Plan and Analytic Strategies for Evaluating the Mayor’s Action Plan for Neighborhood Safety

Quasi-Experimental Comparison Design for Evaluating the Mayor’s Action Plan for Neighborhood Safety

To evaluate the New York City Mayor’s Action Plan for Neighborhood Safety (MAP), an initiative to improve the safety of public housing developments, researchers estimated the counterfactual (no intervention) by selecting a set of comparison housing developments not involved in the initiative. The study relied on the statistical method known as propensity score analysis (PSA) to select the comparison group. Continue reading Quasi-Experimental Comparison Design for Evaluating the Mayor’s Action Plan for Neighborhood Safety

Recidivism Reconsidered

Recidivism is not a comprehensive measure of success for criminal justice in general or for community corrections specifically. When used to judge the effects of justice interventions on behavior, the concept of recidivism may even be harmful, as it often reinforces the racial and class biases underlying much of the justice system. We encourage justice systems to rely on more flexible and more responsive outcome measures. Community corrections agencies should encourage policymakers to rely on outcomes related to criminal desistance and the social integration of people on probation or parole. Measures focused on social development and community wellbeing are more useful for evaluating the effects of justice interventions, and they are less likely to distort policy discussions. Continue reading Recidivism Reconsidered

Positive Outcomes

Measuring positive outcomes in youth justice requires a shift away from recidivism as the sole indicator of program effectiveness. A youth justice system embracing the PYD approach would gauge its success by tracking positive youth outcomes, such as the formation of strong and supportive relationships, academic engagement, labor market readiness, and improved socio-emotional skills. Continue reading Positive Outcomes