Skip to content

CensusACS5YearSurvey_SubjectTables_S2201 | Data refresh - #2266

Merged
Ashwani725 merged 12 commits into
datacommonsorg:masterfrom
Ashwani725:s2201_table
Oct 23, 2026
Merged

Ashwani725 merged 12 commits into
datacommonsorg:masterfrom
Ashwani725:s2201_table

Conversation

@Ashwani725

@Ashwani725 Ashwani725 commented Oct 13, 2026 •

Copy link
Copy Markdown
Contributor

CensusACS5YearSurvey_SubjectTables_S2201- 2024 observation year is fully ingested; all 15 historical years (2010 -2024) are present.

@Ashwani725
Ashwani725 requested a review from saanikaaa October 13, 2026 10:46
@Ashwani725 Ashwani725 self-assigned this Oct 13, 2026

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the ACS S2201 data processing pipeline to support processing local ZIP files as an alternative to downloading them, integrates a shared geo ID resolution helper, and improves CSV parsing robustness. Feedback on these changes highlights a hardcoded API key and incorrect table ID in the README, a directory mismatch in the execution instructions, a typo in the output filename, and a lack of exception handling and status checks for the network request and ZIP extraction in process.py.

Comment thread scripts/us_census/acs5yr/subject_tables/s2201/README.md Outdated
Comment thread scripts/us_census/acs5yr/subject_tables/s2201/README.md Outdated
Comment thread scripts/us_census/acs5yr/subject_tables/s2201/README.md Outdated
Comment thread scripts/us_census/acs5yr/subject_tables/s2201/process.py Outdated

@SandeepTuniki SandeepTuniki left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the update! The switch to the shared convert_to_place_dcid helper (fixing the missing dcid: prefix on school district GeoIDs), the deterministic sorting of multi-year ZIP entries, and the 2010–2024 data refresh all look good.

However, a few things around HTTP error handling, CSV/ZIP filtering, unit test coverage for the new code paths, and README.md paths need some changes. I've left inline comments with the details.

Comment thread scripts/us_census/acs5yr/subject_tables/s2201/process.py
Comment thread scripts/us_census/acs5yr/subject_tables/s2201/process.py
Comment thread scripts/us_census/acs5yr/subject_tables/s2201/process.py Outdated
Comment thread scripts/us_census/acs5yr/subject_tables/s2201/process.py Outdated
Comment thread scripts/us_census/acs5yr/subject_tables/s2201/README.md Outdated

@SandeepTuniki SandeepTuniki left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for addressing the comments! Can you please fix the failing unit tests? I've left an inline comment with the fix.

Comment thread scripts/us_census/acs5yr/subject_tables/s2201/process_test.py Outdated

@SandeepTuniki SandeepTuniki left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@Ashwani725
Ashwani725 merged commit 0778c96 into datacommonsorg:master Oct 23, 2026
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants