Thoughts about the Metaverse

Metaverse is increasingly trending since Mark Zuckerberg announced (Oct 28th 2021) both the rebranding of Facebook to Meta and the next big thing, the “Metaverse”

As much as I enjoy seeing technology maturing, being democratized and becoming accessible, I also want to stay realistic at the same time. Some reflections about the current hype or the next evolutionary step in human interconnectedness.

Photo by Lucrezia Carnelos on Unsplash
  • The Metaverse emphasises on VR and AR as medium to immerse yourself. VR has seen several waves of adoption since 1970, growing from research lab exclusive use to a mass consumer product. But until today, the general adoption has not grown significantly outside the gaming and simulation niche.
  • While several expensive high-end headsets have been released and announced to enterprise customers (Varjo, Pimax, XTAL,..) there is not much in the consumer space, the Quest 2 was released in 2020 (overview). Though everyone suddenly is working on something (Apple,..). If the Metaverse is the next internet accessible by everyone, we need to have devices as cheap as mobile phones. And NO, Google Cardboard is not an option.
    AR has still long way to achieve mixed reality with seamless embedded information. In 2020 AR disappeared from the Gartner hypecycle in 2020, even predicting enterprise adoption in 2021 (didnt happen?).
  • The human bioware is not being updated. Newer VR devices are getting better, more lightweight, higher resolution, less latency etc., but VR fatigue and VR sickness are still an issue. Though you can get used to it but it still will affect the adoption. You choose the wrong environment or platform to get started into VR and it spoils your first experience, you might leave for good. I know few people being “in VR” for more than 1 hour regularly.
  • Believing this is the next step in the evolution, why should we solely rely on the company META, their potential influence on behaviour and opinion will grow further. Right now, the industry should discuss standards for seamless interopability, security and data exchange, ensuring the Metaverse will not become a separate, propietary internet, but an accessible communication and sharing platform, like the internet itself in its beginning. If we would had a proprietary approach in the 1990s, HTML would not be readable today, rather a binary blob to open in the browser, open source might not be as widespread as we see it today. The Metaverse must be open, no matter what hardware or platform is used to access it.
  • META has not yet released Horizon Home, the video material we see is conceptual work and visions (‘Not actual images. Images are strictly for illustrative purpose only.’), solely the Horizon Workrooms are available as beta (at the time of writing this post), and only compatible with the Quest 2 (don’t even works with Rift S). You can use flat screen access though, which makes little sense to me. The Quest 2 will not be able to render the illustrative concepts, except could stream hig-end rendered content.
  • The same time NVIDIA comes with their take of the Metaverse toolset, Omniverse, but with existing products and plugins and a tangible roadmap.

Conclusion:

  • Lets’s stay excited, but realistic. Embrace innovative ideas to come.
  • Ensure it will be the Open Metaverse.
  • Do good and avoid evil. Not implementing the dystopian future depicted in the referenced literature (Snow Crash and others)
  • I am eager to try, experiment and pilot. Especially in the enterprise context, there are use-cases for Digital Twin, Simulation and Collaboration which make sense and will benefit.

Recommended reading:

Google Trends

Podcasts on AI and Data Science

The interest in Artifical Intelligence has exploded over the last few years with hardware and software increasing performance massively, the same time we have data in abundance to work with. Deep Learning is certainly the number one looked for topic in Computer Science. Anyone can do ML/DL now at home, the whole field is both democratized and made accessible. With a regular laptop you can get started easily with a selection of online and local tools/resources, and a huge choice of data at hand (e.g. Kaggle and other datasources), you can scale to process larger datasets either by having more RAM and a GPU installed in your machine, or use paid resources from AWS, Google, Microsoft and others.

The learning curve is steep, many online courses and books are available, maybe too many to choose from. Beyond that, how to stay up-to-date or get more insights ? The good old Podcast (20 years since the term was coined) is a welcome alternative to reading. You can listen during you commute (who is commuting nowadays ?) or any other physical activities. Though I find it a bit hard to get complex technical stuff (algorithm) explained without any visual context but there are still many topics to be covered, ranging for legal and ethical aspects to interviews with practitioners in various fields and many more topics. It is impossible to follow all podcasts out there, but you can subscribe to a few and hand-select the episodes that are of interest or relevance for you.
Here a list of podcasts that I follow which I like to highlight, updated over time. Focus on podcasts that are produced in English language and actively maintained. (Last Update 2020-12-05)

Lex Fridman

Lex is a researcher at MIT, working on autonomous driving, human-robot interaction and all kind of machine learning topics. He appears as quite an introvert character allways wearing a black suite, speaking very calmly without fuzz and excitement but transporting lots of insights to his audience. His interviews cover topics from machine learning, mathematics, philosophy, ethics, astrophysics to plasma physics.

Since 2018 he produced more than 140 episodes of his podcast and it is amazing to listen to the high profile people he invites from the academic world in interviews between 60 to 90 minutes in length. Among his guests were Alex Filippenko, Michio Kaku, Andrew Ng, Ian Hutchison, Kai-Fu Lee, James Gosling, Richard Karp, Elon Musk and many more.

I also recommend to watch his presentation “Deep Learning State of the Art (2020)” from the MIT Deep Learning Series and the accompanying website deeplearning.mit.edu

Episodes: 140+ since August 2018

Podcast Website: lexfridman.com/podcast (all the episodes also available on YouTube)

In Machines We Trust

Running since Summer 2020 host Jennifer Strong and the MIT Technology Review team discuss the more ethical side of machine learning. I highly recommend the episodes about application face recognition and its implication for society.

Episodes: 15+ since July 2020

Podcast Website: forms.technologyreview.com/in-machines-we-trust

Eye On A.I.

Former New York Times correspondent Craig S. Smith runs the audience through a very divers of AI related topics by interviewing various experts.

Episodes: 61+ since October 2018

Podcast Website: www.eye-on.ai/podcast-archive

Practical AI: Machine Learning & Data Science

Chris Benson and Daniel Whitenack are discussing real usecases, datasets and setups of AI exploration. Unlike many other interview type podcasts this is rather hands-on.

Episodes: 115+ since July 2018

Podcast Website: changelog.com/practicalai

The TWIML AI Podcast

In this very actively maintained podcast with new episodes every few days, Sam Charrington is talking to various AI researchers, data scientists, engineers and tech-savvy business and IT leaders.

Episodes: 449+ since May 2016

Podcast Website: twimlai.com

The AI Podcast

This podcast is operated by NVIDIA, the biggest player in the GPU hardware manufacturer games, runs talks and interviews with leading experts in the field.

Episodes: 129+ since November 2016

Podcast Website: blogs.nvidia.com/ai-podcast

AI with AI

The podcast moderated by Andy Ilachinski and David Broyles from the Center for Autonomy and Artificial Intelligence, a group inside the CNA (Center for Naval Analyses, research for U.S. Navy and Marine Corps), discusses latest development in the field. The topics are sometimes related to military use of AI, but recent episodes also look into Covid-related topics.

Episodes: 15+ since July 2020

Podcast Website: www.cna.org/news/AI-Podcast

Photo by Austin Distel on Unsplash

Daily Tech Observations 8

Corona Tracing App Strategy Change

The German government moved away from the central data approach and the PEPP-PT initiative to a decentral solution. Seems they do not want to wait further on the non-commercial approach by a bigger group and hope the two huge companies SAP and Telekom can come up with an app. Looking forward to see the result, I doubt we will see anything released for another 8 weeks, being optimistic. A lot of countries have a head start here, see my overview post.

Questions I have:
The list of “infected ID’s” has to be updated regularly, potentially a growing list with many records need to be polled every hour ?!
How would you push the info to devices (in the case of infected contacts) ?
Use Google’s Firebase FCM ?

Reference:

Tracing Apps across the globe

There are about 40+ apps in various countries around the globe, adopting different protocols, some are open-source, some are propietary, most of them are in the Android Playstore, some are released as apk-files only.
In some countries we see multiple (contact tracing) solutions at the start, India with 4, Italy 3 and US 3. In the EU with have at least 10 different apps. There is no way to trace beyond the boundaries of individual countries. Have a look at my overview here.

Overview Covid-19 Tracing Apps and Protocols

Last Update: 2020 May 6th

Protocols and Initiatives

Open Source Apps, Code or Demo/POC

Mobile apps or projects with public accessible sourcecode.

Propietary Apps

Android Apps in the Google Playstore.
To notice quite a number of apps receive rather average reviews and quite some negative comments.
Not all apps are tracing apps, but information portals or self-checks.
[Average rating – number of ratings – installs] (As of April 29th)
Trac(k)ing apps are highlighted with * (Bluetooth) and ** (GPS). Specific contact tracing apps highlighted in bold.Other applications are general health, guidance, self-check or crisis apps.
Source: Respective app page in Google Play Store

Document References

Papers, articles, PhD Thesis, Research Documents. Focus on Wifi/Bluetooth/BLE technology.
No specific order, no attempt to be complete, quite a number of documents are discussing these topics.

(Image by Samuele Schirò from Pixabay)

Daily Tech Observations

Some technology related observations from the last few days in these exceptional times we are facing at the moment. A lot of positive actions and activities going on.

COVID-19 Apps

A number of organizations try to build apps that help to control the spread or inform affected people. Most ideas take personal data protection into consideration and allow transfer of data to authorities or servers only upon consent and approval. Though nothing has been releases yet at a larger scale.

  • CoEpi: Community Epidemiology In Action (link)
  • geoHealthApp: Spread the app not the virus (link)
  • ebolaApp: Its team tries to reuse an existing app (link)

Google Playstore and COVID-19 Apps

With hackers, malware and virus producers jumping on the train to misuse the situation (just to mention the ransomware that people behind coronavirusapp[.]site trying to spread an app that locks mobile phones), Google decided not to release any apps in this context until they find appropiate ones. Until a few days ago you did not find any app when searching for the term. By now you find only 1 app in the Germany Play Store with a app released by Singapore government funded app.

Hackathons

Put smart people together and let them work in short time on ideas, this time solely virtually.

  • #WirVsVirus Hackathon by the German government last weekend (link)
    Not less than 42.000 people attended in one way or another.
  • Hack the crisis – Accelerate Estonia (link)
  • AI for mankind hackathon (link)
  • Not to forget to mention the Kaggle Competition (link)

Transparent Prices for panic-buying products

While supermarkets run out of toiletpaper and a few other more important products, mainly due to distribution and logistic problems, the net revelead a whole universe of profiteers via the usual selling and market platforms or through self-created shop websites. Interesting to observe the price development, two weeks ago it was very much wild west with skyrocketing prices, by now the market platforms try to remove and ban any ridicolously priced offers and shops. The below screenshots from a local price tracking shows only samples of “reasonable” increased prices.
Good to see other companies like car manufacturers jumping in and trying to produce equipment in high demand (which hopefully can be produced b y non-medical companies). (Link)

Toiletpaper prices up 40%
Desinfection (hand sanitizer) price tripled

Still it need someone to buy these items and willing to pay the price or being very desperate. Open market physics..

Apps in Trend

Now communication apps like Zoom, Skype, Teams, etc are seeing more downloads. Also streaming apps like Netflix and Amazon Prime Video. But some trending apps are rather weird, like the game Plague Inc. in the current top 10 of games. The game was released in 2012 (not to blame the company) and was not updated since Feb 2019 but getting downloaded more often now. Not sure who wants to play this while we face it for real without a “restart game” button..

Quote description: “Can you infect the world? Plague Inc. is a unique mix of high strategy and terrifyingly realistic simulation. Your pathogen has just infected ‘Patient Zero’. Now you must bring about the end of human history by evolving a deadly, global Plague whilst adapting against everything humanity can do to defend itself.

Hands-On Amazon Echo Dot and Alexa

Amazon Echo, the voice-controlled and hands-free device/speaker was already launched in the US in November 2014, now 2 years later the Echo, and the Echo Dot second generation, is available in Europe. In Germany it was soft-launched in late October on an invitation base at Euro 59.99, the bigger Echo at Euro 179.-.

Amazon Echo Dot

Amazon Echo Dot

Curious enough about having a glimpse into our household and workplace (?) future I requested one and got it delivered last week Friday. At the size of a hockey puck, the device contains 7 microphones, a simple loudspeaker, WLAN and Bluetooth connectivity. No battery, so the Echo must be connected to a USB power adapter at all times. I must admit, the idea of having a “spy” device with microphones permanently listening into my room brings up some privacy concerns, though Amazon claims only the keyword (Alexa, Echo or Amazon) is activating the device, it’s LED ring starts to turn blue, and the spoken commands get transferred to the Amazon cloud, using the Alexa Voice Recognition Service, on which Amazon supposedly spend a 100 million dollars.

Amazon Echo Dot

Amazon Echo Dot

Here a first hands-on experience resume:

Being an Amazon user with a Prime account and already a Kindle and a Fire HD tablet at home, the setup takes less than 5 minutes, inclusive of setting up a WLAN connection from the Alexa App to the device, preparing the WLAN access from the device to your AP and connecting it via Bluetooth to the home theater system. The device is woken up with the keyword or by pressing one of the four buttons on top of it, followed by your question or command.

It does not run a conversational model in the basic use cases, though the skill sets support sessions ! You raise a question or trigger a command, that’s it. It wont ask back (yet). It will respond with the right answer or execute what you have asked for, or respond it if it does not understand you, sometimes it wont do anything at all after activation other than showing the blue ring (maybe due to noisy environment). The basic services available are rather simple or move around the Amazon product landscape, most prominently playing music on demand from the Amazon Prime Music offerings, ordering products from Amazon or responding with the weather info or respond to simple Wikipedia style questions. The power of the device is unfolding with the skill-sets that allow third parties to offer services based on the Alexa services. This can be house-automation, ordering pizzas and other consumer services. Being a regional feature there are about 3,000 skills available in the US but only about 2 dozens in Germany at the time of writing.

My kids had a Sunday afternoon fun time to play with it and trying to fool with it, though at this stage it wears out pretty fast after hearing “I don’t understand your request” and similar responses if you leave its pre-programmed comfort zone (it is interesting to observe how kids approach such a device). Be aware of the Eliza Effect using a device with a synthetic voice and human-like response.

What makes it particularly interesting to me is the evaluation of a completely voice based service and the platforms extensibility through the Alex Skill Set and the API’s that Amazon provides. You find lots of information at the Amazon developer portal and you can even join the Mashup Contest.

In short, right now it is still a toy but with lots of opportunities to come up in the near future. I will look at the potential use cases in a aviation environment, both operational and as passenger and keep you posted.

Amazon Echo Dot

Amazon Echo Dot

While using the Echo I feel a bit like talking to Hal 9000 in the 1968 film “2001: A Space Odyssey” directed by Stanley Kubrick. Echo does not yet have an attitude.

FB aquires WhatsApp – Bye and Thanks for the Fish

WhatsApp known for its massive security issues, still used by millions of people as a free replacement of SMS and MMS, was acquired by FB, one (maybe the) biggest data harvester in the internet. I dont use FB, the acquisition is a reason to finally move on to another more secure communication tool: Threema  (Made in Switzerland app with end-to-end encryption). Hope they wont sell privacy for money. Please help to spread the word.

It is NOT free, but is time to understand FREE comes at a price !

Android 2.3 released

Just noticed Gingerbread is coming to town since yesterday ! A bunch of new API stuff, such as SIP, NFC, multiple cameras and more. Read all the details here.
Now, the usual questions come up:

  • When we gonna see the first native 2.3 device ?
  • Will my device be supported / updated ? (Is Nexus One going to be updated ?)
  • Did you see a device with NCF reader ? (near-field communication)
  • and when we see Android 3.0 ? Will there be a Android 2.4 before ?

According to some news, Gingerbread will be “pushed” to Nexus One owners in the next few weeks.

The Nexus S is going to be the next official Google Phone (Samsung this time!), available after December 16 (doesnt seem to be available through shipping like the previous models)

AWS for free

Starting November 1st Amazon is giving a way cloud computer power for free. Of course it is limited, but way enough to get your feed wet and gather cloud experience at no cost. It only works for new subscribers, but no one stop you to create a second account (if you already have one). Read more at http://aws.amazon.com/free/. Happy cloud computing !

News from the Java World

As expected at JavaOne some news were released. Blogs and development portals are full of it. In short:

  • Netbeans 6.9 becomes 7.0 in order to be aligned with the Java platform itself. (more info here)
    I am fine with that, seems Oracle is still serious about Netbeans.
  • JavaFX Script is dead but the features will be available as API. (more info here)
    OK, the scripting was a bit cumbersome. But you could get used to it using Netbeans.