Skip to content

taco-group/MapBench

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MapBench

📦 Installation

Create the environment with the provided dependencies:

conda env create -f environment.yml

🚀 Inference with GPT

Run inference using your selected GPT model:

python infer_gpt.py \
    --save-dir ./outputs \               # Directory to save results
    --api-key <your-api-key> \           # Your OpenAI API key
    --gpt-model gpt-4o-mini-2024-07-18   # GPT model to use

💡 Replace with your actual OpenAI API key.

📊 Evaluation

Evaluate the model-generated results:

python eval.py \
    --result-file ./outputs/google_map.jsonl \  # Path to the result file
    --log-dir ./logs                            # Directory to save evaluation logs

📝 The log file will have the same name as the result file.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages