Skip to content

Add Solana token metadata storage with Jupiter API sync script - #27

Merged
jacklevin74 merged 2 commits into
masterfrom
token-data
Nov 24, 2025
Merged

Add Solana token metadata storage with Jupiter API sync script#27
jacklevin74 merged 2 commits into
masterfrom
token-data

Conversation

@stackedPenguin

Copy link
Copy Markdown
Collaborator

Summary

  • Add tokens table to SQLite database for storing Solana token metadata
  • Create sync-jupiter-tokens.js script to fetch and sync token data from Jupiter API V2
  • Add npm run sync-tokens command for easy execution
  • Include comprehensive documentation in scripts/README.md

Features

  • Database Schema: New tokens table with 24 fields including:

    • Basic info: name, symbol, decimals, icon
    • Market data: price, market cap, FDV, liquidity
    • Social links: Twitter, Discord, website, Telegram
    • Security: verification status, organic score
    • Supply metrics: circulating supply, total supply, holder count
  • Token Sync Script:

    • Fetches verified tokens from Jupiter API V2
    • Rate limited to 1 call/second (respects free tier limits)
    • Supports custom tag filtering (verified, community, lst, etc.)
    • Upsert logic for handling token updates
    • Progress indicators and error handling

Test Results

Successfully synced 4,151 verified tokens from Jupiter API with zero errors.

Usage

# Sync verified tokens (default)
npm run sync-tokens

# Sync specific tags
node scripts/sync-jupiter-tokens.js --tags=verified,community

Database Changes

  • Added tokens table with indexes on symbol and is_verified
  • Tokens are stored locally in transactions.db

Generated with Claude Code

asantainnasa and others added 2 commits November 23, 2025 22:12
- Add tokens table to SQLite database with comprehensive metadata fields
- Create sync script to fetch token data from Jupiter API V2
- Implement rate limiting (1 call/second) to respect API limits
- Add npm script 'sync-tokens' for easy execution
- Include documentation for token sync functionality
- Support custom tag filtering (verified, community, etc.)
- Upsert logic for handling token updates

The tokens table stores: basic info (name, symbol, decimals), market data
(price, mcap, FDV), social links, verification status, and supply metrics.

Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
Prevents accidentally committing database data files.

Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
@jacklevin74
jacklevin74 merged commit 96c74bf into master Nov 24, 2025
2 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants