Skip to content

Commit

Permalink
Merge pull request #44 from ruralinnovation/dev/AHR-103-share
Browse files Browse the repository at this point in the history
fix strange build
  • Loading branch information
tech-team-rural-mda authored Jul 12, 2024
2 parents 8ef1f6f + a3e40ab commit 879bc09
Show file tree
Hide file tree
Showing 5 changed files with 79 additions and 49 deletions.
53 changes: 35 additions & 18 deletions CORI-Ontology.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -11,11 +11,13 @@ citation-location: margin

## General Terms

### The [American Community Survey (ACS)](https://www.census.gov/programs-surveys/acs/data.html)...
### The [American Community Survey (ACS)](https://www.census.gov/programs-surveys/acs/data.html) ...

- is an ongoing initiative within the United States Census Bureau
- releases a variety of data tables every year covering a wide range of social, economic, housing, and demographic data

### A **Block** ...

- is the smallest geographic area for which the Bureau of the Census collects and tabulates decennial census data
- is the smallest statistical unit of analysis of a single Community's economic participation, social impact, and inventory of tech ecosystem resources (?)
- is the smallest geospatial unit at which we can geographically place, filter or group Broadband Serviceable Location data
Expand All @@ -25,15 +27,15 @@ citation-location: margin
- is a constituent component of one and only one [tract](#a-tract)

### A **Block Group** ...
- is ...

### A **Tract** ...
- is ...

- Started being used in 1910 (NY city), **at first** should follow rivers and roads and contains around 400 peoples.
### A **Tract** ...

- if divided between two new tracts and should follow this kind of pattern[^census_tract]: Census Tract O3 (parent) is divided in Census Tract 03.01 (child 1) and Census Tract 03.02.
- Started being used in 1910 (NY city), **at first** should follow rivers and roads and contains around 400 peoples.
- if divided between two new tracts and should follow this kind of pattern[^census_tract]

[^census_tract]: https://www.youtube.com/watch?v=DOe4alPmjss
[^census_tract]: Census Tract O3 (parent) is divided in Census Tract 03.01 (child 1) and Census Tract 03.02. https://www.youtube.com/watch?v=DOe4alPmjss

::: {.column-margin}
Note Olivier 26-04-2024: still unclear how that translate in `geoid_tr` and how do they deal when we move from two "parents" to one "child"
Expand All @@ -43,49 +45,62 @@ Note Olivier 26-04-2024: still unclear how that translate in `geoid_tr` and how
- is often arbitrary, except for coinciding with political lines, in [unincorporated areas](#an-unincorporated-area) of the United States
- for some metrics, can be statistically described by the aggregation of statistics for each of its constituent blocks

### A **Rural Tract** ...

- is ...

### An **Unincorporated Area** ...

- is a region that is not governed by a local municipality, see also Census Designated Space (CDP)[^CDP]

[^CDP]: https://www.census.gov/programs-surveys/bas/information/cdp.html
[^CDP]: https://www.census.gov/programs-surveys/bas/information/cdp.html

### A **County** ...

- is ...

### A **Rural County** ...

- is ...

### A **CUD** ...

- is ...

### ZIP code / ZCTA
### A **ZIP ("Zone Improvment Plan") code / ZCTA** ...

ZIP ("Zone Improvment Plan") code were made to help deliver mails ("delivery routes"), they usually follow roads that were affected to a postman. At their smallest level they are tied to address (point). The Census Bureau is provisding a Zip Code Tabulation Area (ZCTA) that allow to link which is the dominant ZIP code in a census tabulation blocks[^zcta].
- is a designation for a mail delivery route, they usually follow roads that ware assigned to a postman.
- is, at the smallest level, tied to an address (point).
- can be linked to a census tabulation blocks by Zip Code Tabulation Areas (ZCTA) provided by the Census Bureau.[^zcta]

[^zcta]: https://www.census.gov/programs-surveys/geography/guidance/geo-areas/zctas.html
[^zcta]: https://www.census.gov/programs-surveys/geography/guidance/geo-areas/zctas.html

### A **Broadband Serviceable Location** (BSL) ...

- is “a business or residential location in the United States at which mass-market fixed broadband Internet access service is, or can be, installed.”[^bslsource]

[^bslsource]: source: https://help.bdc.fcc.gov/hc/en-us/articles/16842264428059-About-the-Fabric-What-a-Broadband-Serviceable-Location-BSL-Is-and-Is-Not
[^bslsource]: source: https://help.bdc.fcc.gov/hc/en-us/articles/16842264428059-About-the-Fabric-What-a-Broadband-Serviceable-Location-BSL-Is-and-Is-Not

- is a location that can have access to multiple ISPs, each offering different services (technologies, upload, download speed).
- can be split into residential and business locations but this distinction does not seem very effective in the [National Broadband Map](#the-national-broadband-map) dataset.
- is not geographically represented with exact latitude and longitude, but only by [census block](#a-block) geoid and H3 index in the NBM dataset (MDA references this data as the National Broadband Map; officially the dataset is released as [BDC (Broadband Data Collection) Public Data](https://broadbandmap.fcc.gov/data-download/nationwide-data)).

### The [National Broadband Map](https://broadbandmap.fcc.gov/) ...

- is an ongoing initiative within the Federal Communications Commission
- provides information about the internet services available to individual locations across the country, along with new maps of mobile coverage, as reported by Internet Service Providers (ISPs) in the FCC’s ongoing Broadband Data Collection.

### An **Internet Service Provider (ISP)** ...
- is a FCC provider (with a provider ID)?

In the FCC Broadband Map they are defined by a `frn`, `provider_id` and `brand_name`. We are mostly working with the one who are providing "fixed" services.
- is a FCC provider (with a provider ID)?[^ispid]

[^ispid]:In the FCC Broadband Map they are defined by a `frn`, `provider_id` and `brand_name`. We are mostly working with the one who are providing "fixed" services.

### An **Eligibility Requirement** ...

### An **Eligibility Requirement**
- is ...

### A **Geographic Eligibility Requirement**
### A **Geographic Eligibility Requirement** ...

- is ...

### A **Community** ...
Expand All @@ -103,11 +118,13 @@ ZIP ("Zone Improvment Plan") code were made to help deliver mails ("delivery rou
### A **Tech Startup** ...
- is ...

### A **Data Archive**
### A **Data Archive** ...

- is a remote store for one or more _immutable_ artifacts of source data or outputs of product data
- is a system for storing, documenting, and indexing versions of data artifacts

### A **Data Cache**
### A **Data Cache** ...

- is a remote store for one or more _mutable_ representations or views of a data product

> ~~Rural ...~~
Expand Down
35 changes: 22 additions & 13 deletions Metadata.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,27 @@
# How ?
---
title: "Metadata"
execute:
echo: true
output: true
message: false
warning: false
reference-location: margin
citation-location: margin
---

# TODO: How ?

First steps...

- we should focus first on:

* tables in DB

* bucket in s3

- setup automation for that (write db)

- see what we do when pull metadata is writing to temp/disk


## What is Metadata?
Expand Down Expand Up @@ -91,15 +112,3 @@ present in 3 tables and save a 3 csv for them with select row
- cori.utils check
- side not unsure if dplyr::add_rows should be added here

First steps:

- we should focus first on:

* tables in DB

* bucket in s3

- setup automation for that (write db)

- see what we do with pull data that is writing to temp/disk

4 changes: 3 additions & 1 deletion README.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -10,8 +10,10 @@ format:
toc: false
---


::: {.callout-tip}
_Note: DO NOT EDIT THIS README IN THE [`coriverse`](https://github.com/ruralinnovation/coriverse.git) REPO. It is derived from [`README.qmd`](https://github.com/ruralinnovation/wiki/edit/main/README.qmd) in the [`wiki`](https://github.com/ruralinnovation/wiki.git) repo._
:::


Enter the coriverse!
====================
Expand Down
31 changes: 15 additions & 16 deletions _quarto.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,24 +21,23 @@ website:
- CORI-Ontology.qmd
- section: "Infrastructure"
contents:
- MDA-Data-Infrastructure-Overview.qmd
- Ansible.md
- CORI-Data-API.md
# - section: "CORI Data API"
# contents:
# - CORI-Data-API.md
## - Adding-New-Endpoints-&-Services-to-the-Python-RESTApi.md
## - Apollo-Studio-Setup.md
## - Configuring-our-AWS-CLI-(CDK-and-SAM)-Credentials.md
## - Example-React-Map-Container-with-REACT-MAP-GL-Package.md
## - Migrating-from-CDK-V1-=--V2.md
## - Postman-Workspace-Setup-and-Configuration.md
## - R-and-Python-API-Usage.md
## - React,-AWS-Amplify-and-API-Usage.md
## - SAML-User-Pool-IdP-Authentication-Flow.md
## - Session-2-‐-2023‐10‐23.md
## - Support-Sessions.md
## - Working-with-the-GraphQL-Schemas.md
# - section: "CORI Data API"
# contents:
# - CORI-Data-API.md
## - Adding-New-Endpoints-&-Services-to-the-Python-RESTApi.md
## - Apollo-Studio-Setup.md
## - Configuring-our-AWS-CLI-(CDK-and-SAM)-Credentials.md
## - Example-React-Map-Container-with-REACT-MAP-GL-Package.md
## - Migrating-from-CDK-V1-=--V2.md
## - Postman-Workspace-Setup-and-Configuration.md
## - R-and-Python-API-Usage.md
## - React,-AWS-Amplify-and-API-Usage.md
## - SAML-User-Pool-IdP-Authentication-Flow.md
## - Session-2-‐-2023‐10‐23.md
## - Support-Sessions.md
## - Working-with-the-GraphQL-Schemas.md
- Data-Security.qmd
- duckDB.qmd
- PostgreSQL-RDS-Managment.md
Expand Down
5 changes: 4 additions & 1 deletion index.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,10 @@ We are building a one-of-a-kind, data-driven platform that can provide the whole

As the Mapping and Data Analytics team, we are responsible for the foundational data and methodology that underlies any explanatory model that is produced or data product that is delivered and/or published by the [Center on Rural Innovation](https://ruralinnovation.us/) and [Rural Innovation Strategies, Inc.](https://ruralinnovationstrategies.com/), respectively. Inherit in engaging with this responsibility is an ongoing need to map the knowledge that is generated and/or captured by our work to the basic terms of which that knowledge is composed. The collective and individual professional experience of the MDA team provides a wide breadth of analytical insights into the data that we use, but much of this value is implicit in the final output of our work product, rather than intentionally and continuously integrated into the system on which our work is occurring. As much as possible, we should aim to build a system or a _platform_ for our work that maximizes our ability to sustain and improve our models, as well as the organization's ability to intelligently utilize our models in pursuit of our mission.

> Note: See [CORI/RISI Ontology](CORI-Ontology.qmd) to follow/contribute to our refinement of the relevant terms of our analysis.
::: {.callout-tip}
_Note: See [CORI/RISI Ontology](CORI-Ontology.qmd) to follow/contribute to our refinement of the relevant terms of our analysis._
:::


<hr />

Expand Down

0 comments on commit 879bc09

Please sign in to comment.