Technical Resources
While using Databricks is not necessary and will not impact how your project is reviewed, If you’d like to use Databricks and don’t already have an account, you may create a Databricks Community Edition account to get started. If you need more resources, you may also set up a full-platform Databricks account with our free 14-day trial in the last two weeks of competition.
Additional resources from our public cloud partners:
https://cloud.google.com/free
https://azure.microsoft.com/en-us/free/
https://aws.amazon.com/free
- Dolly resources:
- Databricks Lab Dolly GitHub repo: https://github.com/databrickslabs/dolly
- Hugging Face > Databricks where you can work with pre-existing models as well as ask questions
- Helpful blogs including:
- Spark Connect resources
Tutorials
- Getting Started with Databricks Playlist
- How to fine-tune and deploy your custom LLM
- Get Data Into Databricks - How to use AutoML to develop ML models
-
Get Data Into Databricks - Simple ETL Pipeline
Brainstorming and Project Ideas
Coming up with an idea is sometimes the hardest part of a project, but don’t let this get you down. Here is a quick brainstorming exercise that can help you mix topics and datasets to build something new. Try it out if you would like:
- Identify 3 - 5 common or relatable problems or topics.
- Research existing applications related to those 5 themes you identified.
- Research datasets or data models that might be relevant to each theme.
- Jot down how you could potentially show off that data or model to help others understand the theme.
- Start designing the layout and flow for someone to get the most out of the data.
- Choose a project and start a draft submission on Devpost (you can edit this as often as you like before the deadline!)
Here are a few example projects:
- Help someone plan a party based on budget and other constraints
- Guide a new developer to build a data model based on their previous knowledge
- Point out great travel locations based on vacation time and budget
Get Connected
- Join the Databricks hackathon community for support and general motivation.
