Hello Microsoft, welcome to the party?!

After some fail OS revisions and products, remember Windows ME the zune, I stopped seeing Microsoft as a real top tier entry in any of the tech that I use. Not even the XBox could sway me. Now thats not to say I didn't use any of their products, I mean who can really afford a new mac, iPad, iPhone and still eat in this economy, certainly not me. I only just recently picked up a MacBook Pro to add to my iPhone and I may have even missed the heyday of this incredible machine. Today there are options that exceed the specs on all accounts of my setup for half the price, however the feel of it is unbeatable, so until there is some product that can match that I will be on their side. Speaking of specs and features that beat the top tier entries I must get back to the Microsoft. They have announced a new entry into the immersive 3D category that may actually be worth a shot. 

HoloLens - This device seeks to offer users a dual layer, hologram and real world, visual output that would make for a great entry level 3D immersion experience. The whole device is contained in a goggle like form and from the looks of the press release is an all in one device that connects to your data via wireless connection.

Photo taken from www.microsoft.com

Photo taken from www.microsoft.com

The visuals look impressive as a press release would, but if it indeed can display the quality that they are depicting, TV manufactures all the way to decorators will need to take heed. Again, f you can wear the glasses all the time assuming power consumption allows, then there would be little need for a big screen flat panel or expensive decoration. Naturally virtual world decor would be bought and sold as well as features and add-on widgets, like skins to alarm clocks or DIY design and coding setups. Oculus and others need to be on watch their toes as Microsoft came to dance, and they look to be putting down some sick new moves.

Oculus DK2 and KOR-FX reviews part 1

I now have both Oculus DK2 and KOR-FX in hand. I haven't had the time to give them a full run-through but this is what I have so far.

First impressions are that they both are well made consumer ready products, even though the Oculus DK2 needs to be configured heavily to be plug and play. The KOR-FX starts right up and is needs no more setup than add batteries to the vest, plug the dongle and audio line in then pair with the included dongle. Thats it. 

The Oculus DK2 fits on the head nicely and is not too heavy for longer use. More testing will be needed to see if the unit can produce actual functioning 3D environments. The resolution was not bad from first glance and should be able to do what I need it to do for now. More on this when I get it all calibrated. 

The KOR-FX vest is the only one that I had time to really test out and it is still in its “8 hour break in period” The few games played with it reacted somewhat to the audio input as touted by the creators of KOR-FX but hardly immersive, to be fair I haven't tried it with a shooter or racing game yet. The claims are yet to be proven for this device but the fit and feel of the whole device is at least comfortable and if the breaking period and game selection play a part in the overall function of the vest then this could well be a great product. We shall see next time, if I can find 7 more hours of gaming and breaking in the unit.

Exciting time in the world of 3D immersion. Some competitors are coming out that have validated the Oculus DK2 as a new platform/environment to use for media. They have touted a stand alone setup that runs on a smartphone and drops into a goggle type holder that looks similar to Oculus. These are still in the infant stage but show great promise for reproducing the graphics needed and the sensors required to simulate The Game and all its layers. Only a matter of time before the development of beyond mobile tech is up to speed.

Up Next

​If you build it they will come

The last post had a basic description of the 1st Gen Haptic Rig, HR1. I left out a few components that should be considered as my version of the 2nd Gen Haptic Rig, HR2. These added components would be like butter cream frosting on a Fun-fetti cupcake. 

So far, the mobility of HR1 concept had been bothering me a bit. I mean phones are powerful these days and perhaps could allow for a decent HD video out and some mild 3D processing but that isn't going to do. Not for next level game immersion as the HR1 would be. I also wanted to add a basic starter edition that would be more inline with the early adopters market on a budget, like me, that could be added to along the way.

    The HR2 and HR2b, the HR1 with a few add ons and changes.

Some of the listed items are fresh off the press and have had no real world testing for this type of application, but the specs add up to fill needs in the set. 

HR2

    3D Visuals - Oculus Rift Dev Kit $350

    Haptic Chest Gear - KOR-FX $150

    Cognitive Controls - Emotiv Headgear - $499

    Stationary Motion - Virtuix Omni Platform $499+ Keyboard Tray $79

    Audio - Bose noise canceling headphones - $300

    ————————————————————————————

        The extras

    Haptic Gloves

    Advanced 3D mobile platform

    Mobile motion capture

    Mobile power capture and storage

    External cameras safe use 

    Directional mic upgrade

Haptic Gloves - v .10 designs and schematics in hand, ha, pun! $150

These glove designs fleshed themselves out just after posting last week. Inspired by a recent diy project that a friend of mine is having great success with, the design and actual build of the gloves look to be viable for general keyboard functions.  To get the grip feel and the 3D tracking much more research is needed but some great innovations out of xsens.com and others seem to be in the right path.

3D capable mobile device with display outputs running @ 120 hrz - $1000*

The latest and greatest from Nvidia, The Tegra X1 mobile super chip will likely run the next years smartphone market based on its performance, 4K video, 3D rendering and low power consumption, not to mention that looks to be smaller than an oyster cracker. This chip is slated to run the newest car kits to the market claiming to auto park and maybe even drive your car for you. In a completely custom aspect, this chip could be running the HR2 and all its components with full motion capture, in real time with decent power consumption.

Mobile motion capture. Suits by xsens.com - $$$

This is essential to mobile, as the user is tends to be disorientated by the changes in viewing angle without actually moving. A swivel chair and a head position tracking camera are good remedies at home but while moving about the landscape in 2 different planes of view a sync of motion would be without it multiplied by some crazy factor causing the user to fall down or other discomforts. 

A suit made of body sensors for mobile motion capture by xsens.com or something similar could solve some of this internal conflict with virtual movement display. The longer people work on it the less latency there will be in the suits and the detail would jump significantly along with the visual rendering and framerates.

Mobile power solutions: Good batteries, better with energy capture.

Energy capture from motion - Ampy - $125 each or $500 for a 4 pack.

Ampy is a small device that contains a 1,000 mAh battery and charges in under 30 mins while running, 1 hour while biking or walking the daily average of 10,000 steps. The mAh of a standard laptop these days is around 5,600, which is probably what you would have to have running this at the very least without needing to charge up every 2 hours. To that end the Ampy would have to be multiplied to handle the power needs of the suit and could even be used as replacement batteries of the devices in production on the list as an after market mod. $125 each (1,000 mAh) need much more for gaming applications say 8,000 mAh all depending on how much inactivity and devices being ran.  Given that most of the products have a power source of their own, 4X Ampy’s would be the starting point.

Energy capture from motion - SolePower - ~$35

SolePower shoe insoles $35 harvest power from any shoe with these insoles and power the rig further. The mAh generated from this device is not as flexible in its applications. Power is generated simply through the heel strike while walking or running. This is a simple add on to the power packs total punch but not a sole means of charging.

Dual real world and game world streams - Giroptic’s 360 camera - $499

The need to see your real world surrounds while immersed in gam world has its advantages, safety the biggest one. With a non transparent screen strapped to your face for long durations, theres no telling what might be right in front of you. This would solve that and give stunning real world visuals while wearing the headgear allowing for uninterrupted use. Adding to the mobility of the HR2, you can now just walk around and have both feeds up on your display and interact in-between them seamlessly. Plus a HUD for real world will be really slick, allowing the user to super zoom in with the camera increasing the long range vision of the user, for example. Or perhaps a night vision filter applied. Perhaps tracking your fitness progress while running through the park with a skin applied to the surface of the road that made it look like you were running on a beach on a sunny day no matter the weather conditions, and having a challenger being projected just in front or behind you in the sim layer to motivate, all while maintaining the real world layer as the base so you dont trip over something. I’m so siced

A great Mic upgrade - $100

The Bose audio should work as a decent mic if you have the earbud option but if not you'll need to pick up a good directional mic with noise cancellation functions to filter out the background noise.

It all adds up to one hell of a package and would likely be the touted by professional gamers and those who take immersive reality programing to the next level.


HR2b

    3D Visuals - Oculus Rift Dev Kit $350

    Haptic Chest Gear - KOR-FX $150

    3D capable computer or device - $800 - $1000

Just the basics, and not a bad start. You could do much of the immersion while in the living room or workplace while plugged in. The mobility of it would be reduced as would the functionality and features available, but hey, its still some great 3D experimentation.

With any of the choices between the HR1, HR2, and HR2b, the devices used in the custom set are subject to upgrade but having them be separate is an upgraders and customizers prefered setup. They can all play nice and to their strengths while allowing for fully customizable setups, from the most basic to the bleeding edge advanced.

Next up

  • Oculus first impressions
  • KOR-FX first impressions

Gen 1 Haptic "Suit"

The current tech for a fully immersive virtual experience is out there and this is a good start in building a Gen 1 haptic and 3D immersive rig.

 

3D Visuals - Oculus Rift Dev Kit $350

Haptic Chest Gear - KOR-FX $150

Cognitive Controls - Emotiv Headgear - $499

Stationary Motion - Virtuix Omni Platform - $499 + Keyboard Tray $79

Audio - Bose noise canceling headphones - $300

Haptic Gloves - not yet avl.

3D capable mobile device or computer - $800 - $1000

Total Gen 1 "Suit" will run you around $2600

This cost can be reduced with your existing equipment. For me the mobile and computer are covered as is the sound so it will run about $1600

The first half can be implemented for the mobile uses with no platform or cognitive controls for $500.

On to making a first run of the virtual world. I intend to make a virtual workspace that will allow me to test the environment and device configurations. Understanding the capabilities of the platform is the first step of making The Game and seeing what can be achieved. How will flying feel with the cognitive controls?!?

Skill Tree Basics

This is a very basic 1st run mockup of what the skill trees could be based on. Many will be added and this list is in no way final.

Perhaps having character classes and skills to level up, like those that are based on Diablo or other popular games, would give the platform a wider acceptance initially. World of Warcraft was no mistake. Improve your real world character through a game avatar with real world skill acquisition through gamification. The skill trees would be alluring in title and scope, available to all that have the achieved levels to unlock them, ultimately having their respective top tier skills and abilities compiled from the actual abilities obtained from leveling up.

Yes "Ultimate Cybernetic Wisp" is my dream final form. Sci-fi till the end.

The Game Overview

Character Selection

  • Avatar in game for personal representation
    • Can be anything other than clones of existing actual people to avoid fraud
  • Unique Screen Name and privacy modes
  • MMO styled stats and ranking for gaming modes

Skill Trees

  • User picked or created skill trees aided by default settings and completely customizable in nature allowing for massive variance and uniqueness for each player.
  • Life skills treated like a game and therefore quantifiable and trackable allowing for easier guided learning.
    • Physical activities like skiing to learning to paint and beyond
    • ex. cooking (eggs - omelets - hard boil - soft boil - poach - meringues etc.) low to high difficulty. 
    •  
  • Skills to be earned like merit badges and MMO points in each and every skill you could want.
    • ollege counselor meets long form life planning and skill development.

Quests

  • Long form egg hunts, that are completely fictional like a video game or real like finding a specific plant in the wild and taking a bio sample for analysis. Also completion tasks like "cook a feast for 30 people". Must learn the basic skills to cook several items and from that make multiple of them for the feast. Each step being a point of measurable data that can be aggregated and tagged to identify the synergies and intricacies that are involved in any task.
    • f at any point you forget what you just learned or need a refresher, a vidcap of your avatar will go back through it with you, or you can simply repeat the task in real time.
  • an be user generated to be completely custom set of variables to achieve or complete in order to finish quests.

Mini Quests

  • Like the above quests but shorter in nature and some to be time sensitive or easier to complete; ex. send out your daily gratitudes, or do your daily workout with a twist, as per the daily quest.
    • These will be tracked in the same fashion as the longer quests. 
    • Can be user generated to be completely custom set of variables to achieve or complete in order to finish  mini quests.

Items and magic properties

  • All your personal belongings and items received in the game.
    • eal world items can be scanned into system or loaded from system files for common items.
  • Positive and negative stats for all items
    • Weight, cost, size, theme, etc.
  • n game only magic properties
    • vailable in the pure gaming areas only

Potions / Power Ups

  • Health and cognitive reinforcements like vitamins and shakes
    • seudo-real time tracking based on what you eat and supplements taken to actual real time tracking and analysis of blood work, cardio, cognitive scan evaluations.
  • Learning skills that synergize to become stronger together
  • ex. "time management" skills with "cooking" skills.
    • This would give a plus to cooking allowing certain mini quests to open along with full quest lines to unlock.
    • Real world skills like cooking and yoga could receive benefits for game mechanics.
      • ex. "yoga" skill of breathing and stress management as an overall power up to a stat like lower cortisol levels would be an indication that health stats are boosted.

Mechanics

  • Real world physics but with special items and skills that unlock more sci-fi and untested physics in the gaming areas.

Data Logging and Backup

  • Full body, cognitive tracking and analytics that would show location and health along with mental backup in game with up and downstream information flow. Store or retrieve your memories within the game from real world and game world.
  • Real time across the network, anonymous data, creating base lines for these boosts, game quest line development and even used for medical purposes, refined teaching methods and more immersive functions .

Team Play

  • Play with friends or find in game groups to play with, or enter solo mode and personal zones within the game world. Super groups can be created to link up and beat super quests and challenges like global warming and extrasolar space travels and exploration.

Environment and World Selection

  • Real and fictional recreations of everything and multiple millions of worlds that would be created by users and curated by their inhabitants.

This is just a basic outline and will require many revisions and tweaks.

The Gear

In order to make this game the most interactive and comprehensive game it can be there will be some cutting edge tech that will need to be employed and perhaps invented like haptic suit and rig. 

Items needed for game world interaction.

  • Tech
    • OcculusRift Goggles or similar ~$300
    • Fitbit or similar ~$100
    • Powerful smartphone ~$600
    • O2 sensors ~$50
    • Emotiv headset or similar ~$300
    • Electrically enhancing cognitive electrodes (perhaps implants but have already as electrodes)*
    • 360 degree GoPro styled rig with multiple digital lenses for external monitoring*
    • Motion sphere for stationary walk and run*
    • Advanced motion capture suit*
    • Haptic gloves, suit, rig*
    • Internal blood screening for complete nutrient needs*
  • Software*
    • HUD for real world and sim world
    • Deep learning for pattern recognition
    • Real time motion capture
    • Realistic, 3D visual and audio, world recreation and vid capture
    • Mind and haptic suit capture for interaction
    • Filters for content and security
    • many more**

This is just a basic list to get started but for about $1500, less if you have a good smartphone, your full immersive game can be on your way. Next step is configuring the basic rig in a few weeks when all the parts arrive, then designing the basic HUD. 

*theses have not been invented or need to be heavily modified.

Welcome to the game

I have been living with the dreams of this game for decades and it is finally possible, so I decided to make it. This will be a fully immersive game with the newest array of virtual and mobile devices allowing you to feel like you're in the game and be able to control it in some very intuitive ways. 

Like the "Matrix", "Ready Player One", and every other immersive reality setting, this aims to bring the physical world and virtual world together for a great game and more. The details of "The Game" are to follow in future posts along with progress and vidcaps of early design successes and failures. 

Next up...

What is this game and what will be needed to make it?