Easily Overstated

Policymakers, advocates, and even some researchers claim that youth confinement rates across the United States dropped in recent years due to changes in policy and practice. Such claims remain unproven, but voters and elected officials are inclined to accept them as factual because they are offered by reputable agencies and repeated in news media sources. Without reliable evidence, however, the notion that state-level youth confinement rates fall primarily in response to progressive policy reforms is merely appealing rhetoric.

Public Safety Trends in MAP Communities and Matched Comparison Areas

Was the presence of the MAP initiative in some NYCHA developments associated with greater improvements in crime and victimization outcomes compared with the same outcomes in NYCHA developments not involved in MAP? The results presented here do not answer the question in full, but they offer an early look at efforts by the research team to generate more precise answers. Additional analyses are needed to rule out competing explanations and to examine the complex series of relationships among all the study’s variables. Based on the preliminary findings in this report, however, the results of MAP to date may be considered promising.

Measurement Plan and Analytic Strategies for Evaluating the Mayor’s Action Plan for Neighborhood Safety

This second in a series of reports about the evaluation of the New York City Mayor’s Action Plan for Neighborhood Safety (MAP). This Evaluation Update: summarizes the goals and methods used to evaluate the Mayor’s Action Plan; describes the quasi-experimental design used to test the outcomes and impacts of MAP as well as the data sources assembled by the research team and how they are used; and portrays a logical framework the research team used initially to identify causal pathways through which various elements of MAP were intended to achieve their desired effect.

Quasi-Experimental Comparison Design for Evaluating the Mayor’s Action Plan for Neighborhood Safety

To evaluate the New York City Mayor’s Action Plan for Neighborhood Safety (MAP), an initiative to improve the safety of public housing developments, researchers estimated the counterfactual (no intervention) by selecting a set of comparison housing developments not involved in the initiative. The study relied on the statistical method known as propensity score analysis (PSA) to select the comparison group.

Recidivism Reconsidered

Recidivism is not a comprehensive measure of success for criminal justice in general or for community corrections specifically. When used to judge the effects of justice interventions on behavior, the concept of recidivism may even be harmful, as it often reinforces the racial and class biases underlying much of the justice system. We encourage justice systems to rely on more flexible and more responsive outcome measures. Community corrections agencies should encourage policymakers to rely on outcomes related to criminal desistance and the social integration of people on probation or parole. Measures focused on social development and community wellbeing are more useful for evaluating the effects of justice interventions, and they are less likely to distort policy discussions.

Positive Outcomes

Measuring positive outcomes in youth justice requires a shift away from recidivism as the sole indicator of program effectiveness. A youth justice system embracing the PYD approach would gauge its success by tracking positive youth outcomes, such as the formation of strong and supportive relationships, academic engagement, labor market readiness, and improved socio-emotional skills.