Local governments hold a lot of meetings which are meant to allow the public to observe and comment on policy and legislation. But local news organizations are cutting back and often can’t cover them. Chicago’s City Bureau has developed a program called Documenters, which trains citizens and pays them to cover those meetings. Along the way, they have developed software which grabs not just the schedule of these meetings but the agendas, handouts, and other documents -- documents which may have important information about future plans and laws, but which usually go unread.
What if we could make software which reads the documents for us, looking for patterns or telling humans which ones are worth their time? For this project, we’ll work closely with City Bureau to take advantage of their system for collecting the documents, and their knowledge of public meetings and processes. Together, we’ll look for the “signal in the noise”. We’re hoping to build a mixed team including coders with at least a little experience in natural language and document analysis, as well as people who are interested in civics and government, who can help identify what’s interesting and think about how humans would be best served by any software we might create.
Joe runs Knight Lab’s technology, professional staff and student fellows. Before joining us, Joe was on the Chicago Tribune News Apps team. Also, he hosts a weekly radio show on WNUR-FM – Conference of the Birds.
What information can be pulled from local government records?
Are there notable trends in local government records? Do they cut across types of agencies or jurisdictions?
How can text analysis/machine learning be used to augment capacity in smaller newsrooms?
Week 1-2: Meet with City Bureau, learn about meetings and documents; work with journalists and activists to begin developing questions about what’s in the documents; initial experiments with writing programs to analyze documents.
Week 3-5: Go deeper on software-based document analysis; generalize interviews with specialists into one or more personas who need a way to make use of information discovered by the software. Generate ideas for an effective interface for those people to make use of information.
Weeks 6-8: Further iteration on analysis software; further iteration on user interface for analysis
Weeks 9-10: Write up the project; work with City Bureau to transfer knowledge for ongoing development.
Students who join this project will help solve real world problems about how journalists and citizens monitor government. They will also get a better understanding of how city governments really function. And they’ll help City Bureau chart a path forward for helping journalists and citizens in Chicago and other Documenters cities to better understand and get involved in local civic life.