Difference between revisions of "Experiments/3D"

From Open Food Facts wiki
Jump to navigation Jump to search
(9 intermediate revisions by the same user not shown)
Line 1: Line 1:
 +
<<Back to [[Experiments]]<br><br>
 +
 
This project aims to prepare Open Food Facts for the advent of 3D and virtual/augmented reality.
 
This project aims to prepare Open Food Facts for the advent of 3D and virtual/augmented reality.
 +
 +
== Inspiration ==
 +
===3D models of food in a dystopian future===
 +
* [https://files.slack.com/files-pri/T02KVRT1Q-F2Y6DQBA5/capture_d___e__cran_2016-11-05_a___23.08.42.png 1]
 +
* [https://files.slack.com/files-pri/T02KVRT1Q-F2Y5GPKT2/pasted_image_at_2016_11_05_11_11_pm.png 2]
 +
* [https://files.slack.com/files-pri/T02KVRT1Q-F2ZGPPA3Y/pasted_image_at_2016_11_05_11_12_pm.png 3]
 +
 +
=== Google launches the tango phone - allows for 3D scanning ===
 +
* https://techcrunch.com/2016/11/01/google-finally-launches-tango/?sr_share=facebook
 +
 +
=== 3 models of food ===
 +
* a Supermarket to store everything: https://sketchfab.com/models/ca06a9061e2a4beb9b30aae5392fca26
 +
* Collection of cosmetics: https://sketchfab.com/teolemon/collections/open-beauty-facts
 +
* Collection of food: https://sketchfab.com/teolemon/collections/packaged-food
 +
*
 +
=== 3D scanner we could buy ===
 +
* https://www.artec3d.com/3d-scanner/artec-eva
 +
 +
=== Cool demo we could hide in the OFF app ===
 +
* With just spinning, you could make a Pepper's ghost: https://www.youtube.com/watch?v=zkgy-WcflWE (but that's silly)
 +
It works much better with cylinders like cans than with more complex shapes, because it's still just four images. @aleksejrs
 +
 +
===Photogrammetry===
 +
* Making 3D models out of photos is https://en.wikipedia.org/wiki/Photogrammetry
 +
* The only open source program for that I've seen was abandoned and so had annoyingly incomplete UI and crashed often.  Not a very popular activity.  http://insight3d.sourceforge.net/ (edited)
 +
* There was also a page about doing it using many different programs (IIRC, that included one used for making panoramas with Hugin), but that was complex (also, the most difficult part was removing the incorrect dots).  An example was making a 3D model of a part of the earth surface from ISS photos.
 +
 +
=== Augmented Reality ===
 +
* https://twitter.com/i/web/status/855753253312761856 (Aurelien is on the Slack - Demo)
 +
* https://openfoodfacts.slack.com/files/niwra/F31561NP2/hololens_read_the_ingredients.mp4 (Read the Ingredients for Windows and Hololens, niwra is on the Slack)
 +
 +
=== Virtual Reality ===
  
 
==Generating usable data==
 
==Generating usable data==
Line 5: Line 39:
 
==== Using photos from Daniel's machine ====
 
==== Using photos from Daniel's machine ====
 
=== Straightening existing photos to maps them onto models ===
 
=== Straightening existing photos to maps them onto models ===
 +
 +
=== Microsoft Tech ===
 +
Microsoft just made big 3D creation announcements making it easy to create 3D models from a phone or from MS Paint and share them to their platform
 +
https://www.youtube.com/watch?v=8M_-lSYqACo
  
 
== Storing the data ==
 
== Storing the data ==
Line 11: Line 49:
 
== Visualising data in 3D ==
 
== Visualising data in 3D ==
 
* http://demo.rickyh.co.uk/can-spin/
 
* http://demo.rickyh.co.uk/can-spin/
* https://github.com/rickyH/can-spin/blob/master/js/threejs/models/textures/gamma_ray.png
+
* [https://github.com/rickyH/can-spin/blob/master/js/threejs/models/textures/gamma_ray.png Source image]
 +
 
 
[[Category:Experiments]]
 
[[Category:Experiments]]

Revision as of 10:40, 15 June 2017

<<Back to Experiments

This project aims to prepare Open Food Facts for the advent of 3D and virtual/augmented reality.

Inspiration

3D models of food in a dystopian future

Google launches the tango phone - allows for 3D scanning

3 models of food

3D scanner we could buy

Cool demo we could hide in the OFF app

It works much better with cylinders like cans than with more complex shapes, because it's still just four images. @aleksejrs

Photogrammetry

  • Making 3D models out of photos is https://en.wikipedia.org/wiki/Photogrammetry
  • The only open source program for that I've seen was abandoned and so had annoyingly incomplete UI and crashed often. Not a very popular activity. http://insight3d.sourceforge.net/ (edited)
  • There was also a page about doing it using many different programs (IIRC, that included one used for making panoramas with Hugin), but that was complex (also, the most difficult part was removing the incorrect dots). An example was making a 3D model of a part of the earth surface from ISS photos.

Augmented Reality

Virtual Reality

Generating usable data

Getting flat photos of products we can map on preexisting standard models

Using photos from Daniel's machine

Straightening existing photos to maps them onto models

Microsoft Tech

Microsoft just made big 3D creation announcements making it easy to create 3D models from a phone or from MS Paint and share them to their platform https://www.youtube.com/watch?v=8M_-lSYqACo

Storing the data

We need to be able to differentiate 3D ready photos, photos that can be transformed on the fly, and unusable photos.

Visualising data in 3D