BRAIN CONNECTS: A Scalable Automated Proofreading Framework for Connectomics
Project Number1U01NS137250-01
Contact PI/Project LeaderRIVLIN, PATRICIA K Other PIs
Awardee OrganizationJOHNS HOPKINS UNIVERSITY
Description
Abstract Text
Summary
Generating synapse-resolution maps or connectomes of the brain are crucial to understanding the neural basis
of behavior, and can provide key insights into the onset, progression, and treatment of neurological disease and
injury. Towards this goal, major advances in electron microscopy imaging and automated image segmentation
have enabled researchers to produce millimeter-scale connectomic datasets, and forge a path towards an even
larger whole mouse brain volume. Despite the high quality of automated segmentation at this scale, the
enormous extent of axon and dendrite “wiring” in the brain unavoidably leads to errors in neuronal connectivity
that require correction with post-hoc proofreading. Although a variety of approaches have been developed to
enable faster manual proofreading, the number of human hours needed to correct errors are prohibitive, and
prevent us from realizing the full potential of valuable datasets such as the cubic millimeter MICrONS (mouse
cortex) and H01 (human cortex) volumes. To enable even larger connectomes, we must develop cost-effective
and time-saving automated methods to replace labor-intensive human proofreading where possible and allow
human resources to focus on other connectomic tasks that include generating training data and validating
automated correction. The goal of this proposal is to build capabilities for scalable automated proofreading,
leveraging and extending software tools built during our previous IARPA MICrONS activities: NEURD (short for
NEURal Decomposition), an automated error detection and correction framework built by Baylor College of
Medicine, and NeuVue, a scalable manual proofreading platform built by the Johns Hopkins University Applied
Physics Laboratory. Both tools are deeply integrated and complementary to the existing ecosystem of open-
source connectomics tools and resources from the community such as Neuroglancer, PyChunkedGraph (PCG),
and Connectomics Annotation Versioning Engine (CAVE). Building on the foundation of these tools and our
existing collaboration, we will add capabilities for machine learning enabled error detection of a wider range of
error types including both merge and split errors. We will implement an active learning approach that focuses
valuable human validation effort on the most informative error examples, with the goal of statistically validating
entire classes of edits that can be applied in automated batches to the segmentation. Finally, we will develop a
workflow for applying these automated edits to the segmentation in an optimized way that also does not conflict
with existing manual proofreading and retains a confidence metric for each edit that can be used for downstream
analysis. The successful completion of this project, “Connects-Proof: A Scalable Automated Proofreading
Framework for Connectomics” will yield a mature workflow that is validated across multiple data sets and that
can support existing and future work in the BRAIN-CONNECTS program.
Public Health Relevance Statement
Project Narrative
Despite the high performance of automated segmentation, substantial proofreading is required
to correct reconstruction errors within large-scale connectomic datasets. To enable auto-
corrections at scale in existing and emerging large datasets, we propose to develop “Connects-
Proof, a scalable automated proofreading framework for connectomics”, that leverages,
integrates, and extends software tools initially developed for the cubic millimeter MICrONS
dataset: NEURD (short for NEURal Decomposition), an automated error detection and
correction framework, and NeuVue, a scalable manual proofreading platform. Enabled by
automated proofreading, accurate large-scale connectomes can provide unprecedented
insights to understand brain function.
NIH Spending Category
No NIH Spending Category available.
Project Terms
Active LearningAlgorithmsAreaAxonBehaviorBindingBrainCellsCollaborationsCommunitiesComputersDataData SetDendritesDetectionEcosystemElectron MicroscopyFoundationsFutureGoalsGroupingHourHumanHuman ResourcesImageIndividualIngestionInterneuronsInterventionLaboratoriesLibrariesMachine LearningManualsMapsMedicineMethodsMotivationMusNervous System DisorderNervous System TraumaNeuronsOutputPerformancePhysicsResearchResearch PersonnelResolutionResourcesServicesSoftware ToolsSpeedSuggestionSynapsesSystemTimeUniversitiesValidationVisualizationWorkWritingautomated segmentationbrain volumecollegeconnectomeconnectome datacost effectivedeep learning algorithmdensityexperienceforginggraph neural networkhuman datahuman-in-the-loopimaging Segmentationimprovedinsightlarge datasetsmicroscopic imagingmillimetermultiple datasetsneuralopen sourcepreventprogramsreconstructiontooltraining data
National Institute of Neurological Disorders and Stroke
CFDA Code
853
DUNS Number
001910777
UEI
FTMTDMBR29C7
Project Start Date
15-August-2024
Project End Date
31-July-2027
Budget Start Date
15-August-2024
Budget End Date
31-July-2025
Project Funding Information for 2024
Total Funding
$1,705,580
Direct Costs
$1,264,786
Indirect Costs
$440,794
Year
Funding IC
FY Total Cost by IC
2024
National Institute of Biomedical Imaging and Bioengineering
$1,364,251
2024
National Institute of Neurological Disorders and Stroke
$341,329
Year
Funding IC
FY Total Cost by IC
Sub Projects
No Sub Projects information available for 1U01NS137250-01
Publications
Publications are associated with projects, but cannot be identified with any particular year of the project or fiscal year of funding. This is due to the continuous and cumulative nature of knowledge generation across the life of a project and the sometimes long and variable publishing timeline. Similarly, for multi-component projects, publications are associated with the parent core project and not with individual sub-projects.
No Publications available for 1U01NS137250-01
Patents
No Patents information available for 1U01NS137250-01
Outcomes
The Project Outcomes shown here are displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed are those of the PI and do not necessarily reflect the views of the National Institutes of Health. NIH has not endorsed the content below.
No Outcomes available for 1U01NS137250-01
Clinical Studies
No Clinical Studies information available for 1U01NS137250-01
News and More
Related News Releases
No news release information available for 1U01NS137250-01
History
No Historical information available for 1U01NS137250-01
Similar Projects
No Similar Projects information available for 1U01NS137250-01