Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NodeSecure Database #3

Open
fraxken opened this issue Jul 22, 2022 · 2 comments
Open

NodeSecure Database #3

fraxken opened this issue Jul 22, 2022 · 2 comments
Labels
idea need champion Extra attention is needed new project

Comments

@fraxken
Copy link
Member

fraxken commented Jul 22, 2022

The goal of this project would be a create our own databases that contain packument and manifest from NPM registry.

We could integrate our tools with this database to store data that would be relevant to us:

  • From scanner
  • From vulnera
  • From js-x-ray

We can start this project by using a replicate of NPM

// Import Node.js Dependencies
import fs from "fs";

// Import Third-party Dependencies
import * as httpie from "@myunisoft/httpie";

// CONSTANTS
const kNpmReplicateDB = "https://replicate.npmjs.com/_all_docs?include_docs=true";

httpie.stream("GET", kNpmReplicateDB)(fs.createWriteStream("./npmdb.json"));

Then this database can be used for project like Preview (or for our own research).

@Kawacrepe
Copy link
Member

Kawacrepe commented Aug 7, 2022

We may want to add information about domains inside our database.

Since whois.iana looks like having a rate limit

@fraxken
Copy link
Member Author

fraxken commented Aug 9, 2022

After discussion in the last meeting, we should clarify:

  • Why do we need a database project in NodeSecure ?

Actions to take to work on the subject:

  • Initiate a Github repository.
  • Let the collaborators open issues and discuss on what and where they want to go.
  • Work toward minimal delivery goals.

@Rossb0b was interested to be the champion on this project.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
idea need champion Extra attention is needed new project
Projects
None yet
Development

No branches or pull requests

2 participants