Skip to content

luffy-yu/RealityCopilot-Backend

Repository files navigation

RealityCopilot-Backend

Server

Real Servers (Require Model Checkpoints)

FastVLM

# Under FastVLM root
python ../RealityCopilot-Backend/fastvlm/server.py

SAM3

# Under SAM3 root
export PYTHONPATH=. && python ../RealityCopilot-Backend/sam3/server.py

SAM3D

# Under SAM3D root
export PYTHONPATH=. && python ../RealityCopilot-Backend/sam-3d-objects/server.py

Environment setup reference

Fake Servers (Demo Mode - No Models Required)

For testing without downloading large model checkpoints, use the fake servers that return pre-recorded results from the assets/ folder.

FastVLM Fake Server

# From RealityCopilot-Backend/fastvlm
python server_fake.py

SAM3 Fake Server

# From RealityCopilot-Backend/sam3
python server_fake.py

SAM3D Fake Server

# From RealityCopilot-Backend/sam-3d-objects
python server_fake.py

All fake servers:

  • Use the same API as real servers
  • Return consistent pre-recorded results from assets/
  • Run on the same default ports (8000, 8001, 8002)
  • No GPU or model checkpoints required
  • Identified by "fake_server": true in /status response

Client Test

FastVLM

# Under fastvlm
python test_client.py --image-file ../assets/image.png --prompt "Describe the bear in this image"

SAM3

# Under sam3
python test_client.py --image ../assets/image.png --text "bear" --top-n 1 --return-image --save-result ../assets/bear.png

python test_client.py --image ../assets/image.png --text "bear" --top-n 1 --clip --return-image --save-result ../assets/bear-clip.png

SAM3D

# Under sam-3d-objects
python test_client.py --image-file ../assets/image.png --mask-file ../assets/bear.png --format glb --save-result ../assets/bear.glb

Online viewer: https://gltf-viewer.donmccurdy.com/

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages