Feedback wise, it’s been about half-and-half: half said I should go through with my interactive storybook, the other half said I should go through with my interactive stitcher.
After contemplating for some time, I decided to go through with the idea of the interactive stitcher. I think it is something that will be able to be executed within the next 7 months and it excites me because I’ve never seen anything like my idea and I want to learn a new program to create this.
Being involved in the knitting/crocheting club here at TCNJ, I can ask my fellow club members about crocheting techniques and patterns to help me with this project. I feel that’s already a good start.
How might you make this real? Seems technically challenging, but still possible. Will depend a lot on what you try and learn during prototyping in a few weeks. Need to research what’s feasible and available, technically.
As we discussed in class, I’m not sure this is a question of individual motion sensors. I think it’s more a computer vision problem. Look through some of Shiffman’s videos about computer vision:
https://www.youtube.com/watch?v=h8tk0hmWB44
https://www.youtube.com/watch?v=nCVZHROb_dE
A Google search for Unity and color-tracking will also turn up some results.
I *think* something like the following *could* work, but it will take some testing to make sure:
– A camera mounted over the user’s hands.
– A uniformly flat-shaded surface (table) beneath the user’s hands to contrast with their hands and tools.
– Bright, distinctively colored markers on the user’s fingertips. Maybe gloves. Maybe tape rings near their fingertips.
– Bright, distinctively colored markers at each end of the hook (and any other tool).
– With a decent camera (a MS Kinect *might* be overkill, but then again it’s designed to track motion in 3D space) the computer can track the movement of the various colors, and therefore track the movement of the users hands and tools.
– The department also has some Leap Motion cameras, which were designed for hand tracking (but not really hands *with* tools in them):
https://www.roadtovr.com/leap-motion-releases-major-tracking-update-and-new-demos-to-show-it-off/