THE PRODUCT

New tools for viewing and interacting with three dimensional information are evolving at a rapid rate. Next gen veiwers such as Occulus' virtual reality goggles, used in conjunction with new input devices such as the Control VR Wearable Controller or an evolution of Leap Motion are ushering in an event horizon for Human-Computer Interactions that offer incredible possibilities for the near future.  

One area with tremendous potential for development is 3D modeling. The currently accepted computer modeling process is informed by analog drafting techniques, and slowed by the many procedural challenges associated with creating 3D shapes on a 2D monitor. A complex layer of view management - independent of construction - is integrated into workflow as users constantly translate from 2D to 3D. To further complicate matters, all of this work is usually orchestrated with inputs from devices which will seem shockingly behind the curve within a short period of time, and which only account for a fractional percent of the possible inputs that the average user can provide. 

This design attempts to look beyond the flat monitor, keyboard, and mouse that most users take for granted today, and consider how 3D modeling and CAD work could be enhanced by depth-aware mapping of hand position, 10 finger awareness, and three dimensional virtual reality workspaces.

THE EXPERIENCE

WORKFLOW

The platform allows users to reach a peak of intuitive flow and granular control with common actions triggered by finger and hand position.

Finger positioning  allows for selecting a variety of tools and operations on the fly.

Intuitive gestural control + familiar construction techniques from existing software allow for speed + flexibility without compromising precision.

Rapid tool changes with the lead hand and modifier gestures with the non-dominant hand speed construction.

Modifier gestures perform similarly to modifier keys in a traditional workflow. 

Shown here: 

Group selection (shift modify) holding a fist at the waist. 

Copy selection (alt modify) holding a pointed hand at the waist. 

Point selection is done by creating boxes based upon hand position.  Selection can correlate to exact hand position, or be relative to viewpoint + hand position.

UTILITIES + ACCOMIDATIONS

This next gen work space will not be without new challenges. User adjustable features will be developed, allowing for better precision and control.  

Anticipated features include:

GRID SNAPPING: Incremental grids in x,y,z directions can be toggled on and off inside the workspace, with variable increments. Default snapping behaviors can be adjusted to keep designs laid out to precise true lines, or along set increments, even if user's motor control waivers when placing a point or adjusting an angle.  

SINGLE/VARIABLE AXIS ADJUSTMENT: Similarly, users my choose to adjust values along a single axis, without disrupting other measurements. 

GESTURAL AMPLIFICATION: Although scale is infinitely adjustable, some users may not be comfortable performing extended periods of elevated arm motion and dynamic movement.  Sensitivity can be adjusted upward so that small motions (similar to the range of motion currently required to operate a keyboard and mouse) are amplified in the virtual space, allowing longer reaches and more amplified motion.  Users comfortable with a full range of motion can also employ this feature to work well outside the traditional physical bounds of their body in the virtual space. 

HAND DOMINANCE: The program should be entirely agnostic as regards dominant hand - single and two hand gestures are supported, and modifier gestures can be performed by either hand.  

SMOOTHING: Users working in freehand or sculptural modes may employ smoothing with varied adjustments to refine their strokes, eliminating wavering.

REFERENCE IMAGE INTEGRATION: 2D reference images may be desired when constructing a new model. These can be projected anywhere in the virtual space, usually along an axis line, and toggled, scaled, etc, as the user chooses. 

FLOOR vs FLOAT MODE:  In floor mode, users exist just above the center of a sphere bisected by a ground plane.  Models can snap to the floor to insure specific angles and to enable design for the physical world, and the floor resizes in conjunction with models when the user adjusts scale, but models cannot rotate or otherwise pass through the floor.  In float mode, users are placed in the center of a boundless volume, and may scale, rotate, or place models anywhere they desire.  

MEASUREMENT TOOLS: A variety of measurement tools can be employed, to determine and adjust angles and dimensions. 

USER PROFILES

RECOMMENDATIONS

After decades of speculation, technology is ready to implement these powerful innovations.  Users are excited by the possibilities and such intuitive and powerful workflows will quickly accelerate expressive potential.  New hardware tools will be on the market within a year that are affordable and reliable, and software augmentations sensitive to those developments will arise rapidly.  Building a 3D design suite from the ground up is a massive undertaking, and existing software platforms have a variety of specialized tools and operations, depending upon the use case.  For rapid development, the proposed product could come to life as a 3D API to merge with existing tools. Common operations within a given program would be mapped to the gestural parameters outlined here, and the existing 3D viewing capabilities of existing software suites could be ported to the user’s goggles for an immersive view. Working backwards from industry standard programs such as Rhino and Maya and adding software support on a program by program basis would be the most rapid and productive approach.  Additionally, more intuitive programs such as Sculptris could be adapted to the platform to promote and showcase the technology to general audiences at conventions and shows.