FusionCue - My project combining Projection with Live Ball Tracking

dreamache

New member
Hey all,

Designer/developer of 3 decades here + pool player. I've been building out a system that combines live ball tracking via mounted camera and projection.

This unlocks interactive drills and games.

I demo'd it a couple weeks ago on my channel:

Note: Since that video, I've solved the issue of ball tracking. You won't have to train your own models, I was able to create a universal model that detects balls by generating 10k+ synthetic renders of layouts and trained the model on that.

Obviously, the biggest pain point of this project is hardware setup. Not just a projector, but a camera and PC as well. I have this system working here in my studio, but also my brother's house.

I am very close to recruiting some more beta testers. You can check out FusionCue for more videos. There's also the drill editor there that you can use, to see what it's like to create drills that are instantly playable on your table:
1780416810776.png


There's also an interactive hardware configurator to help you determine if a given projector/camera will work in your environment (not fully tested just yet):
1780416881731.png


Some of the features:

- 3D Drill Editor for creating unique and dynamic drills types.
- "Snapshot" feature where it captures all ball locations on the table so you can easily respot
- Target Pool game
- Instant Recall game - Break a rack of balls (or throw them out), and it takes a snap shot of every layout after each shot, enabling you to reverse/rewind until you can run them out. Good for being able to "replay" layouts to fine-tune your way to a full run-out.
- Ability to request cue ball path (show me stun/neutral/draw/follow, add/remove right english, left english, 'extend path 4 rails')
- Ability to play offline or online.
- Online access to drills other people created, ability to share your own.
- Community stats per drill, individual stats per drill that track your success over time.
- Optional voice control with a microphone
- "Start recording" will record a video from your overhead camera, and attach stats to the video and include system audio

Price point will likely be $299 to own the software, and a $15 optional monthly subscription to access online features.

I will have recommendations shortly for projectors and cameras that will work.
 
Hey all,

Designer/developer of 3 decades here + pool player. I've been building out a system that combines live ball tracking via mounted camera and projection.

This unlocks interactive drills and games.

I demo'd it a couple weeks ago on my channel:

Note: Since that video, I've solved the issue of ball tracking. You won't have to train your own models, I was able to create a universal model that detects balls by generating 10k+ synthetic renders of layouts and trained the model on that.

Obviously, the biggest pain point of this project is hardware setup. Not just a projector, but a camera and PC as well. I have this system working here in my studio, but also my brother's house.

I am very close to recruiting some more beta testers. You can check out FusionCue for more videos. There's also the drill editor there that you can use, to see what it's like to create drills that are instantly playable on your table:
View attachment 908120

There's also an interactive hardware configurator to help you determine if a given projector/camera will work in your environment (not fully tested just yet):
View attachment 908121

Some of the features:

- 3D Drill Editor for creating unique and dynamic drills types.
- "Snapshot" feature where it captures all ball locations on the table so you can easily respot
- Target Pool game
- Instant Recall game - Break a rack of balls (or throw them out), and it takes a snap shot of every layout after each shot, enabling you to reverse/rewind until you can run them out. Good for being able to "replay" layouts to fine-tune your way to a full run-out.
- Ability to request cue ball path (show me stun/neutral/draw/follow, add/remove right english, left english, 'extend path 4 rails')
- Ability to play offline or online.
- Online access to drills other people created, ability to share your own.
- Community stats per drill, individual stats per drill that track your success over time.
- Optional voice control with a microphone
- "Start recording" will record a video from your overhead camera, and attach stats to the video and include system audio

Price point will likely be $299 to own the software, and a $15 optional monthly subscription to access online features.

I will have recommendations shortly for projectors and cameras that will work.
Ball path request with english projection is the Bomb!!!👊🏻
 
Ball path request with english projection is the Bomb!!!👊🏻
Ty. Of course, it is an approximation. Accounting for CB hit speed / deflection / other nuances wouldn't be worth attempting to account for. You can request minimal english, moderate and max, same for follow/draw.
 
Back
Top