Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retrieval tool : ND Storagestats #1838

Open
NDLABS-Leo opened this issue Dec 13, 2024 · 2 comments
Open

Retrieval tool : ND Storagestats #1838

NDLABS-Leo opened this issue Dec 13, 2024 · 2 comments
Assignees

Comments

@NDLABS-Leo
Copy link

Grant Proposal: ND Storagestats

Project Name:

Storagestats

Proposal Category: Choose one of Developer and data tooling, Integrations, Storage, Retrieval, Technical Content Creation, or Other. Learn what these categories are here.

Retrieval

Individual or Entity Name: Is the proposal on behalf of an individual, or an entity/organization? Please note that the agreement and any payments must be completed by the same entity, either individual or organization.

NDLabs

Proposer: replace with your GitHub username

NDLABS-Leo

Project Repo(s) Please list Github repos used for this project work.

https://github.com/NDLABS-Leo/storagestats

Filecoin ecosystem affiliations: Please disclose any existing work relationships, including investors and beneficial owners, with organizations in the Protocol Labs Network, including Protocol Labs, Filecoin Foundation, Filecoin Foundation for the Decentralized Web, and any others.

N/A

(Optional) Technical Sponsor: If you have previously discussed this project with a member of the IPFS or Filecoin project teams and they have agreed to be a technical sponsor, include their name and/or github handle here

N/A

Do you agree to open source all work you do on behalf of this RFP under the MIT/Apache-2 dual-license?: Please respond with "Yes" or "No".

YES

1. What is your project and what problem does it solve? (max 100 words)

Storagestats is an efficient deal management and retrieval performance evaluation tool designed to process large-scale Filecoin deal data. Through an automated logic system, this tool optimizes the sampling, and retrieval processes of order data, providing key metrics that support data storage efficiency and node retrieval performance.

2. a) How is Filecoin used in this project?

Number Grant Deliverable Briefly describe how you will meet deliverable objectives Timeframe (within 3 months)
1. Data Extraction and Enhancement Module Enhance the accuracy and timeliness of data extraction from the Glif data source, supporting incremental updates and anomaly filtering, while expanding to more Filecoin data sources to improve data diversity and integrity. Month 1
2. Dynamic Sampling and Stratified Logic Development Develop dynamic sampling logic based on order importance weighting, adding stratified sampling functionality to prioritize retrieval of high-value orders. Implement distributed sample processing to improve the efficiency of data sampling and sorting, supporting datasets of millions of deals. Month 1-2
3. Visualization Performance Monitoring and Analysis Dashboard Build an extensible dashboard that displays key metrics such as retrieval success rates, failure reason statistics, and node latency. Support real-time data refresh, and historical data trend analysis, and provide JSON/API export functionality for easy integration with other tools Month 2-3
4. User Experience and Community Integration Optimization Integrate user feedback from the Filecoin+ community, enhancing usability through UI/UX adjustments. Introduce multilingual support (Chinese, English, Korean, etc.) to cater to global community needs, and provide simple tutorials and user manuals. Month 3

4. Adoption, Reach, and Growth Strategies

Adoption Strategy:
• Promote within the Filecoin community by offering a free trial version to attract storage providers and developers.
• Integrate with Filecoin Slack and GitHub to gather user feedback and facilitate continuous iteration.
Coverage Strategy:
• Collaborate with well-known storage providers for case studies that demonstrate the system’s value in optimizing retrieval performance.
• Provide API interfaces for users, enabling integration with other Filecoin tools or platforms.
Growth Strategy:
• Introduce multilingual support (such as English, Chinese, Korean, etc.) to increase coverage of international users.
• Publish technical blogs and participate in Filecoin series events to showcase project results.
• Promote to enterprises in the data storage industry, particularly those dealing with high-value storage orders, such as AI dataset providers and data distribution platforms.

5. If accepted, do you agree to share monthly project updates in this Github Issue until the project described here is complete?

YES

6. Does your proposal comply with our Community Code of Conduct?

YES

7. Links and submissions

  • If your project began at an event or hackathon, have you submitted it for relevant prizes in the ecosystem? If so, please share the event name and a link to your hackathon submission(s)

Not yet

Additional questions:

  • For each team member(s), please list name, email, Github account, and role in the project.

Stoiber(Engineer),[email protected]
John(Engineer) [email protected]
Serein(Maintaner ), [email protected]
Leo (PM) [email protected]
Irma(PM) [email protected]

  • How did you learn about this grant type program?

Filecoin Foundation X

@ErinOCon
Copy link
Collaborator

ErinOCon commented Dec 16, 2024

Hi @NDLABS-Leo, thank you for your interest in our grants program! We will review your proposal and will contact you with any questions on this thread.

To review details regarding our program process and timeline, please refer to the “How to Apply and Review Timeline” section of our ReadMe.

If you have specific updates or questions for our team in the meantime, please contact [email protected].

@ErinOCon
Copy link
Collaborator

Hi @NDLABS-Leo, it looks like the timeline for this project falls outside of our current criteria. Projects for this grant type should generally take 1 to 3 months. Would you like to adjust the scope of work?

Also can you confirm the requested grant amount for this proposal?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants