cisagov / dotgov-data Goto Github PK

View Code? Open in Web Editor NEW

167.0 19.0 51.0 54.73 MB

Official list of .gov domains

Home Page: https://get.gov/about/data/

License: Creative Commons Zero v1.0 Universal

Shell 100.00%

gov dotgov

dotgov-data's Introduction

.gov data

The .gov top-level domain is operated so that the online services of US-based government organizations are easy to identify on the internet. In support of that aim, we publish .gov domain data publicly.

This repository contains the official, full list of registered domains in the .gov zone. The US Government's executive, legislative, and judicial branches are represented, as are US-based state, territory, tribal, city, and county governments.

Two files are updated daily (when there is activity):

current-full.csv – a CSV of all domains, including federal domains
current-federal.csv – a CSV of only federal domains

These files list the "second-level domains" (e.g., cisa.gov) that are actively registered in the .gov zone; they do not list every hostname (e.g., presidentscup.cisa.gov) in use in the .gov namespace. Note that not all registered domains offer an online service (e.g., a website, an email server) at the domain.

This repo hosts several other files that include .gov hostnames, though they are not complete.

Spot an issue?

This repo doesn't accept pull requests on current-{full,federal}. If you manage a domain in these files and you:

notice that metadata about it is incorrect, log in to the .gov registrar to correct it.
want to transfer it to a different agency, step through the domain ownership transfer process.

If you use any of this data or just have a question, let us know by opening an issue.

Find a security or privacy issue on one of these domains? Review our security policy.

Unofficial uses

Accept the Risk and Continue: Measuring the Long Tail of Government https Adoption. Sudheesh Singanamalla, Esther Han Beol Jang, Richard Anderson, Tadayoshi Kohno, and Kurtis Heimerl. 2020. In Proceedings of the ACM Internet Measurement Conference (IMC '20). Association for Computing Machinery, New York, NY, USA, 577–597. DOI
Lauren Ancona made a geocoded map of .gov domains:

dotgov-data's People

Contributors

Stargazers

Watchers

dotgov-data's Issues

DNS Issues With Latest Repo Additions

Let me give one example. Why does the State of Wyoming have 9 different .gov TLDs?

Why does this exist? I read the Amy Sebring piece from DHS in 2005 as well. https://helicoptersofdc.com/

Just double checking some things. Thank you so much guys!

Update gov.txt directly from zone

In #107, we updated gov.txt (a copy of the zone file) each day from the version we publish each day to CZDS. Instead of pulling once daily from a copy, we should pull from our DNS provider, Cloudflare.

Acceptance criteria

Get read-only API token from Cameron
Decide if we want to strip the zone file's comment header (the order of this file is also slightly different than CZDS)
gov.txt is updated daily via this new source
- Merge every 24 hours
ADR is updated with any necessary changes based on this work

Additional Context

It's recommended that you fork the dotgov-data repo for this work.

We intend to eventually poll more frequently than 24 hours since the provenance of the data is the real source. In this issue, the goal is to simply replace where we're sourcing.

whois link in `SECURITY.md` file returns `404`

The SECURITY.md file link to a "whois" page is broken. Details below.

Source

dotgov-data/.github/SECURITY.md

Line 1 in c456fbf

If you see a security or privacy issue on a .gov service, check [current-full.csv](https://github.com/cisagov/dotgov-data/blob/main/current-full.csv) or [whois](https://domains.dotgov.gov/dotgov-web/registration/whois.xhtml) (same data) to see if the domain has a security contact. Most federal (executive branch) agencies also have a [vulnerability disclosure policy](https://github.com/cisagov/vdp-in-fceb). If you are unable to find a contact or receive no response from the security contact, you may email <[email protected]>.

Fetch results

➤ curl --head --location https://domains.dotgov.gov/dotgov-web/registration/whois.xhtml
HTTP/2 301 
date: Tue, 12 Dec 2023 16:23:45 GMT
location: https://get.gov/dotgov-web/registration/whois.xhtml
cache-control: max-age=3600
expires: Tue, 12 Dec 2023 17:23:45 GMT
server: cloudflare
cf-ray: 8347504db846205e-IAD

HTTP/2 404 
date: Tue, 12 Dec 2023 16:23:45 GMT
content-type: text/html; charset=utf-8
access-control-allow-methods: GET, HEAD
cache-control: max-age=60
last-modified: Thu, 15 Sep 2022 16:03:06 GMT
strict-transport-security: max-age=31536000; preload
x-amz-server-side-encryption: AES256
x-robots-tag: all
x-server: Cloud.gov Pages
x-vcap-request-id: a94d8d13-7e82-4646-485e-95f7ff15daa9
x-frame-options: SAMEORIGIN
x-content-type-options: nosniff
x-xss-protection: 1; mode=block
vary: Accept-Encoding
x-cache: Error from cloudfront
via: 1.1 9bba1485ff47cf63bc393925f38d12fc.cloudfront.net (CloudFront)
x-amz-cf-pop: IAD61-P1
x-amz-cf-id: zFRQjkGkF4aFLipOd9nIAgZ30NYggMm_zidg6g-7luBS-txWg7bvmg==
cf-cache-status: DYNAMIC
server: cloudflare
cf-ray: 8347504dfa230593-IAD

OIG entries should mark OIG as the Organization, not Agency

The Agency field for stateoig.gov is listed as Department of State, Office of Inspector General, and it seems like this should match other agency OIG domains and use Department of State as the Agency and Office of Inspector General as the Office.

Mark Department of Defense component domains as DoD

intelligencecareers.gov and lps.gov are marked as NSA, rather than DoD. Is that intended? It seems like NSA should be the Organization field with DoD as the Agency.

Clarification for anything USCG related whether .mil or .gov

Hi All:

As you know the US Coast Guard, since Katrina, has always been tasked with Homeland Security missions. Part of it is under DHS, part of it is the Military. Can we get clarity who works with what part for an USCS contacts? This is especially important for foreign naval officers who are trying to determine how to legally follow US law. Thank you so much!

Process for updating domain metadata

What's the right method for suggesting or requesting an edit to the agency or organization field of the domain exports?

In particular, there's two scenarios:

Simple normalizing. In these cases, there's just some various in formatting or trivial naming differences that would be good to make consistent so that the data is cleaner. Here's two examples. I would think that these edits could be made without needing to bother the domain owner.
An agency or organization field is incorrect and should be changed. There's some items where we'll come across mistakes in the data and it would be good to send in the corrected info and there be some means by which it can be run by the domain owner for an okay, and then updated.

StatDNS uses this dataset for statistical purposes

StatDNS is a DNS research project publishing monthly TLD zone files statistics highlighting the deployment of DNSSEC and IPv6 within the top-level domains.

Since .gov data has been made public, I have been processing the zone file dump to include the results in our monthly reports.

However, I noticed that despite the CSV files being updated on a regular basis, the gov.txt file hasn't been updated in 6+ months now. Is there any plan to update it on a more regular basis, or to publish it on ICANN's CZDS service?

.gov certificates to be revoked by LetsEncrypt on 01/28/2022

See: https://letsencrypt.org/tlsalpnrevocation/

.gov domains in data:

"regID","serial","notBefore","names"
32691021,"0311c85320ff1bdb1faeaac9708ee4351b48","2022-01-25T18:16:41Z","onboard.amarillo.gov"
32691021,"03e7ff7ba6584eff89edb6e71913e040452b","2022-01-25T23:06:59Z","onboard.cabq.gov"
32691021,"041cca617b4167e8917c7e0f452ba831ef8b","2022-01-30T22:38:03Z","onboard.chatham-ma.gov"
32691021,"042de434f686ce8ab37a4f864c3fcad8c7a5","2022-01-26T08:40:46Z","onboard.nantucket-ma.gov"
42404235,"03a56b8d8869d32c67e69f3682baa135246c","2022-02-09T13:30:07Z","mail.ashland.oh.gov"
42404235,"03b853e07923d9a29b7cd5f5dd90c97daca2","2022-04-10T19:03:29Z","mail.ashland.oh.gov"
42404235,"04e120fd9785aefe5591c982ec58087edcab","2022-01-31T13:30:06Z","ashland.oh.gov"
42404235,"04f01c7a5fc9ca857f95475b17ec6d29ca2f","2022-04-02T02:08:46Z","ashland.oh.gov"
61128867,"04b284a0a3f50995a444eb2016c56aa18fb1","2022-03-06T18:32:40Z","metexpress.nws.noaa.gov"
70181878,"048a29497a42589f5b1fd7a393d78d6f5cf5","2022-03-02T05:26:52Z","signatures.indy.gov"
70787861,"033efd5b2d654561e0ac4859dcfcc4cd61e9","2022-02-18T01:16:34Z","cdndev.ncbi.nlm.nih.gov"
78970012,"0366e70c74ad4180eb456fbc8db4a3943ec2","2022-02-06T17:43:02Z","carp.imca.aps.anl.gov","ispyb.imca.aps.anl.gov"
78970012,"0381e023c278bc46fcc51a5e06047028e600","2022-01-30T16:00:19Z","carp.imca.aps.anl.gov","ispyb.imca.aps.anl.gov"
78970012,"04515d8f406afb53b19b4c603420e96d9bf9","2022-04-10T17:00:16Z","carp.imca.aps.anl.gov","ispyb.imca.aps.anl.gov"
78973419,"0333dc7d348fbf8f6bc3b07a2dc5add46503","2022-04-10T17:01:31Z","www.imca.aps.anl.gov"
78973419,"03e15d3e3652f7383b242b75808789804366","2022-01-30T16:01:42Z","www.imca.aps.anl.gov"
78973419,"045f75b1cf23a9fbc07ff17fd6c9706b6c08","2022-02-06T17:56:26Z","www.imca.aps.anl.gov"
79654902,"043756251780b3d869c8b8810c8a56730715","2022-02-21T00:20:58Z","linden-nj.gov","www.linden-nj.gov"
79654902,"04e5407589325299ce724f812dc4268738a6","2022-03-29T17:42:23Z","linden-nj.gov","www.linden-nj.gov"
82325476,"034412236478f583fd279cd46709b1bb4fbb","2022-04-01T04:00:18Z","esa.tnedu.gov","familymembers.esa.tnedu.gov","school.esa.tnedu.gov"
82325476,"03b17e939d6fc57e5a79213724511360e724","2022-03-01T04:00:27Z","esa.tnedu.gov","familymembers.esa.tnedu.gov","school.esa.tnedu.gov"
82325476,"0462f34a07586fd82c8ab8a759ff64129639","2022-01-30T04:00:18Z","esa.tnedu.gov","familymembers.esa.tnedu.gov","school.esa.tnedu.gov"
84278755,"03750019e7c5cab78f5c2e530014628839b7","2022-02-01T04:01:38Z","palisade-dtn-test.cels.anl.gov"
84278755,"04821570e05669d890f809425f6ca27fd0b7","2022-04-02T05:01:52Z","palisade-dtn-test.cels.anl.gov"
84287417,"03bfa09973257afc29f38c3717a98fc02b1d","2022-02-27T19:43:26Z","hyperion-test.ornl.gov","wa-service-ext.ornl.gov"
84287417,"046228906609b180e0299b0a6b7109a0e62c","2022-02-03T19:43:24Z","wa-service-ext.ornl.gov"
84287417,"047eeb3df96513ec59504c5b5415e7c88aaf","2022-03-18T19:43:27Z","hyperion-stage.ornl.gov"
84287417,"0497e4db676184b0c4bdb1c63785902285ac","2022-04-05T18:29:02Z","wa-service-ext.ornl.gov"
91264585,"04c78601bcdee34a3d1805ae399c8efe859a","2022-03-29T17:40:19Z","lrsa-nj.gov","www.lrsa-nj.gov"
92633698,"030bad268db212edd8bac38586ec40e6e6b5","2022-03-21T14:27:18Z","mypvl-d.dcca.hawaii.gov"
92633698,"042e7e4abc62c8b77024f5bb38ba25200202","2022-03-31T23:00:34Z","mypvl-d.dcca.hawaii.gov"
97953569,"03ca1e32e228cb673ffe8ff7cf1807d70d3e","2022-02-20T18:56:48Z","cdn.ncbi.nlm.nih.gov"
97953569,"041b8d4d3a1122dd32b5ddb3ca0a58b9298c","2022-04-18T22:03:13Z","cdndev.ncbi.nlm.nih.gov"
97953569,"04af0a9012703c6e36e5d336c0de26cb98b4","2022-04-19T02:54:47Z","cdn.ncbi.nlm.nih.gov"
98352057,"03056db29f2996d53f10aad6ece56a22bc8c","2022-03-13T07:21:19Z","boards.greenvillesc.gov"
98352057,"0312648e56442fa7238f540bde0219c48aed","2022-03-13T07:19:50Z","onboard.glastonbury-ct.gov"
98352057,"0375497a4c6f1972628da4976dc0aee2273b","2022-03-05T19:18:07Z","onboard.bristolri.gov"
98352057,"038c55fa14bb4605a0b9fbab8f95016a0ee5","2022-04-07T07:18:09Z","onboard.rahwaynj.gov"
98352057,"03a00ec4d456dafb01bc85d984887a89da7f","2022-03-13T07:22:00Z","onboard.westerlyri.gov"
98352057,"03c14f4baf156410869bc210513988983d3d","2022-03-13T07:18:49Z","commissions.gilbertaz.gov"
98352057,"03c15317dcd26177c4a5e20a5008b43eefc3","2022-04-24T19:18:03Z","onboard.berlinct.gov"
98352057,"03f6261b0a9cb481a6492decd223ea9c3f41","2022-03-13T07:21:42Z","onboard.narragansettri.gov"
98352057,"041a6c97a4301e80c17291a3fa4ac8ac62c7","2022-03-13T19:18:05Z","onboard.pleasantprairiewi.gov"
98352057,"0442ff21593240b37d53d5332c797b92aedf","2022-02-23T19:18:06Z","onboard.berlinct.gov"
98352057,"04767cab49dc6c5188e800cad074870ced6b","2022-03-13T19:18:49Z","onboard.davidsoncountync.gov"
98352057,"04962774d3a22c9f47913b3ad25a4246a918","2022-01-28T19:18:06Z","onboard.loudoun.gov"
98352057,"04a2ec16116c632f9beaa937c478ad7cfd27","2022-03-13T19:19:15Z","onboard.reedsburgwi.gov"
98352057,"04bcb6a85d951c6de103f8c50bc3e54ea9fa","2022-03-14T07:18:14Z","onboard.rowancountync.gov"
98352057,"04c9eff26ee859f787134600aece77abb6ec","2022-02-17T07:18:06Z","onboard.gahanna.gov"
98352057,"04d9397e0ed9f3a8644518ad85ec5e81be7e","2022-03-13T19:19:24Z","onboard.trumbull-ct.gov"
98352057,"04e07339e74039fb2ed5484b419603f65cc6","2022-03-13T19:18:21Z","onboard.cravencountync.gov"
98352057,"04f35b6911e3fdf490d3d5308ef7d22e3741","2022-03-13T07:21:00Z","onboard.milwaukieoregon.gov"
98352057,"04fa6b289e2b23ad54ee2ab792137ad42c88","2022-03-19T19:18:04Z","onboard.brentwoodtn.gov"
104259038,"03d68c3aad6f9d79a8aebe6ac215d4739bb3","2022-02-24T11:01:57Z","r.cad.roswell-nm.gov"
104385253,"03e4725e38c4b51300fc043d6bfd47ed1480","2022-04-20T10:20:09Z","r.bulkmail.flhealthsource.gov"
104385265,"045056c90502f9038eb4500adca853b70c24","2022-01-30T11:18:06Z","r.bulkmail.flhealthsource.gov"
107072498,"03eb9441f7c317a9a9b844bad9e029fb0481","2022-02-28T23:00:29Z","pvlins-t.dcca.hawaii.gov"
107072498,"0404ceba38b63b2c31439df429e7db9f65b2","2022-03-31T23:00:31Z","pvlins-t.dcca.hawaii.gov"
107259644,"0438c4f98f161baf67f14f41f94adaff592d","2022-04-06T17:37:16Z","myce-t.dcca.hawaii.gov"
107262004,"036c318734a69f4c92bcc61e622e27871f2c","2022-03-31T23:00:32Z","myce-d.dcca.hawaii.gov"
108337197,"0470ebed8570563c07da847b2cf231666a42","2022-04-14T13:17:58Z","dtn11.cit.nih.gov"
109425768,"0349859844f314422fdb70de785693694ad8","2022-02-28T23:00:20Z","myce.dcca.hawaii.gov"
109425768,"03c649aca68a8913c995d2a9c246691d1313","2022-03-31T23:00:23Z","myce.dcca.hawaii.gov"
109425768,"04e2bfe237ff9370a525c4728e1322c8d0ff","2022-02-06T21:45:27Z","myce.dcca.hawaii.gov"
109429133,"03c6ff58ab2fa983346b4a7e2d9ea7ef3809","2022-03-31T23:00:14Z","mypvl.dcca.hawaii.gov"
109429133,"03dcdbb15730e78a50d033ccca53fba6f20a","2022-03-21T14:38:53Z","mypvl.dcca.hawaii.gov"
112184889,"031dd0c8feee499bb2b029e6119c51e96d67","2022-02-10T19:56:59Z","dtn16.cit.nih.gov"
112192128,"04cd908a49666cc17a1832bd2a25698385a0","2022-02-10T19:38:11Z","dtn12.cit.nih.gov"
112192761,"04aa7af60b2d556b718590bd2df3538eded0","2022-02-10T19:45:10Z","dtn13.cit.nih.gov"
112193984,"04246e65c9796f98e7fffecc458d5c54aab8","2022-02-10T19:51:43Z","dtn14.cit.nih.gov"
112194747,"03a0050752ad5d19bf7f17d8990bfd78a3c6","2022-02-10T19:55:10Z","dtn15.cit.nih.gov"
113250629,"039abaaac1350e8507413b7e163dd0616474","2022-03-05T12:16:08Z","uptime.prospertx.gov"
113250629,"049810db07b1d9dbc0a092868e804f6a9f0c","2022-03-02T21:16:05Z","status.mrp.usda.gov"
113250629,"04ad52d4d72b18f865ede04eb87fb0760db7","2022-01-26T04:10:41Z","uptime.winnebagocountyiowa.gov"
113250629,"04fb5a8600bbd5299ecb7cf97975bb33a2f1","2022-02-21T02:41:20Z","sitestatus.its.idaho.gov"
114230204,"03e4ccab4632975beaaa3dfaaf1b83a9f2df","2022-02-28T23:04:14Z","doc-sso-dev.csp.noaa.gov"
114230204,"04d633128381f9107e2478d8ceab01f9939f","2022-01-29T23:04:09Z","doc-sso-dev.csp.noaa.gov"
114230204,"04e709fcc27c0d827a2e95cbfb4fc68cc6fd","2022-03-31T23:04:09Z","doc-sso-dev.csp.noaa.gov"
118499298,"037fca934e66e5a134188c552c0715a9aa72","2022-03-04T12:20:39Z","gitlab.teleport.tooling.identitysandbox.gov"
118499298,"03b9c8dca1d04c310c4bdf1d07d689401900","2022-03-04T10:11:06Z","teleport.tooling.identitysandbox.gov"
118499298,"040e5bbadb36241b399c28f228481b4bef27","2022-03-04T10:21:52Z","teleport.tooling.identitysandbox.gov"
118499298,"04166d1980bde11d84a895565155c390d227","2022-03-04T11:56:59Z","gitlab.teleport.tooling.identitysandbox.gov"
120465363,"046c8b542bab1995bae3b95218412e370337","2022-04-03T14:20:55Z","sdms.ornl.gov"
120701599,"03c6cc1b0f1e58bf16267106866747fb09c3","2022-04-11T12:25:53Z","datafed.ornl.gov"
124031072,"03a756eead2ae307229a6b5afa6512fa0bcf","2022-04-23T22:52:14Z","nycrules.cityhall.nyc.gov"
124031072,"04694e6063e026d90285438748ad2f5b2475","2022-02-22T22:41:16Z","nycrules.cityhall.nyc.gov"
124039570,"0420e79d4b4d3e4a11bc4f14dafd6a0b7df4","2022-02-12T08:58:51Z","teleport-doomlab.gitlab.identitysandbox.gov"
124039570,"045bb8948b2b4f2906c132ba0debc206c33e","2022-02-17T11:10:32Z","gitlab.teleport-doomlab.gitlab.identitysandbox.gov"
124039570,"045f211833c20507412238ca06038c539750","2022-02-17T10:56:21Z","gitlab.teleport-doomlab.gitlab.identitysandbox.gov"
124521578,"04deaf971736e99a2bd78c18b37983de22b7","2022-02-17T01:29:27Z","wlresources.dpi.wi.gov"
125631259,"03c173b0293447c234f8823dc78ee93b351b","2022-03-21T21:24:13Z","benhillcounty-ga.gov","benhillcountyema.com","bhc.asystyoutech.net","developfitzgeraldbenhill.com","fitzgeraldchamber.org","wildchickenfestival.com","www.benhillcounty-ga.gov","www.benhillcountyema.com","www.developfitzgeraldbenhill.com","www.fitzgeraldchamber.org","www.wildchickenfestival.com"
127084194,"04babe6274a08a841ae0858b62bff8ba5b0e","2022-03-11T13:01:43Z","sba.gov"
130103161,"0411b5df15305d4750508b7149e54efb89f3","2022-03-21T14:24:21Z","captive.dcca.hawaii.gov"
134211761,"03f1bcae030c194ccfa74d2000c11b7ba9ac","2022-02-20T23:09:23Z","www.fultonpd.ny.gov"
134211761,"04090f23fd8c03c1d650d520839ab29cfd64","2022-02-16T10:59:57Z","fultonpd.ny.gov"
134211761,"0439587508bdc52fb13a6a552a01471ca5c5","2022-04-17T11:35:33Z","fultonpd.ny.gov"
157776830,"035ed227e436fa93d060768090162eee8e0f","2022-02-01T18:02:03Z","helixweb.nih.gov","hpcwebapps.cit.nih.gov"
200912310,"035e38237ca17b92fc0a92e57e0fefb9c5d3","2022-03-22T15:10:24Z","datafed-server-test.ornl.gov"
227617710,"031143c044c7fbf7f8dc7e2588e90a87048f","2022-04-11T11:02:21Z","mta-sts.hiawasseega.gov"
248173430,"047c5ed45d00a82e766e77da9f1eb826d540","2022-02-13T17:07:41Z","n8n.westjordan.utah.gov"
256072090,"04a725e7ab8a02a3eb133f3c8ee0397a86fc","2022-01-24T17:37:28Z","test.newlexingtonohio.gov"
256072090,"04f31cb089f8e5f23542a8733cb33d81c814","2022-01-24T20:01:00Z","newlexington.org","newlexingtonohio.gov","www.newlexington.org","www.newlexingtonohio.gov"
266717450,"034bfa04a3beedc962c96dfa483c49adf3d9","2022-02-01T17:39:26Z","decaturil.gov","www.decaturil.gov"
300780950,"0381990c7d96bc3f569df94e92c5954673ce","2022-02-27T20:36:44Z","scim.surpriseaz.gov"
320100280,"04ce4341ee6287419ddc528b6025980cb1a4","2022-03-13T22:27:42Z","scim.cdh.idaho.gov"
320152260,"04267af96ea528e2c6cf2911eeb597982374","2022-03-13T23:32:42Z","scim.cdh.idaho.gov"
321232480,"0381609b30940f554e72ba814fbdcaa1a19f","2022-03-14T17:07:52Z","scim.cdh.idaho.gov"
321449320,"03cb33b41b8767de2c16f49da892ce4edbe1","2022-03-14T20:50:58Z","scim.cdh.idaho.gov"
340265460,"03c2ea9a4696810ffc76c33ffb0cedf9d58c","2022-03-28T22:22:29Z","ukb-rtr-02.ukb-nsn.gov"
359736940,"041b95c2073d0727c3bc9b1ec39552de3f23","2022-04-11T19:30:30Z","pvlins-d.dcca.hawaii.gov"
374409600,"043f2f6083210aecc97d2671d7d23120233b","2022-04-22T06:13:54Z","www.fultonpd.ny.gov"

License for this dataset

Thanks for keeping the dataset updated, it has been useful for my personal projects.

Adding a CC0 license (or any other license you deem appropriate) can help prevent copyright issues when using this dataset.

peacecorpsoig.gov has an incorrect agency field

peacecorpsoig.gov has the wrong Agency field:

I had originally filed this in #62 in June but apparently I mistyped the issue name and added an extra ., leading to confusion.

I recommend in #78 that this be corrected to use the parent agency as the Agency field and the OIG component name as the Organization.

Is SI.EDU a US Government domain?

I see you have some .US domains (maybe just FED.US). Can you say whether SI.EDU is a US Government domain and, if so, include it in your CSV?

Thanks, Peter

Re-enable Action once hostname has been updated

Once cisagov/manage.get.gov#1075 is completed and the data is accurate, make some manual commits that show the small formatting changes and then turn the flat data action back on and update the http_url values.

peacecorps.oig.gov has incorrect agency field

It's listed as the USPS OIG for the Agency field (the Organization field is correct).

The directory "dotgov-websites" is poorly named

While it's true that many of the hostnames in that folder are web-centric, not everything is, and we generally want to be technically accurate on the difference between .gov domains/hostname and .gov sites.

Look through cisagov projects that hardcode the path and update them.

Update gov.txt daily from CZDS

This repo is a public version of some of .gov's data. The zone file is in CZDS (Centralized Zone Data Service), but we should house a daily copy here. Use https://github.com/icann/czds-api-client-python.

Acceptance Criteria:

add an ADR on our approach
an automated process is created thru which the .gov text file is updated daily, in the dotgov-data repository, from CZDS.

.gov OCSP & CRL Data issues

The data for .gov OCSP and CRL locations was to document exceptions to the HSTS Compliance Guide.

There are some issues with the current list, broken down to two categories/issues:

Not a .gov Domain

convergeoperations.com

crl.rk.convergeoperations.com

Top Level Domain is HSTS Preloaded

dhhs.gov

ocsp.dhhs.gov

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.