Mouse Control of 360 Video in Beamer?

Question

I am making a mesh of Games of Thrones video for 360 video, motivated by Zuckerberg's video today about GoT where you can move mouse 360 in the beginning, in Matlab. I am thinking where to show the output. I can generate any format from the code but not sure if the user interaction can be hold in any beamer's output formats, as I can understand in the discussion here about Beamer and JavaScript in a web browser.

I would like to embed such a 360 mouse control in my beamer presentation, stub here, for instance, in any format. HTML is sufficient and can be done with Beamer (here). There may be some elements missing in Beamer which does not allow the user interaction. In such a case, I would like to understand what.

Example of Mark's 360 GoT video

Pseudocode

%% Sources
% https://tex.stackexchange.com/q/98446/13173 for 2D animation
\documentclass{article}

\usepackage{pgfplots}
\usetikzlibrary{ocgx}
\tikzset{ocg button/.style={circle,inner sep=.25em,switch ocg with mark on={#1}{}}}
\tikzset{base/.style={baseline=-0.5ex}}

\newcommand{\function}{x ...}
\newcommand{\buttonUp}[2]{\tikz[base]\node[fill=#2!30,ocg button=#1]{};}
\newcommand{\buttonDown}[2]{\tikz[base]\node[fill=#2!30,ocg button=#2]{};}
\newcommand{\buttonLeft}[2]{\tikz[base]\node[fill=#2!30,ocg button=#3]{};}
\newcommand{\buttonRight}[2]{\tikz[base]\node[fill=#2!30,ocg button=#4]{};}

\begin{document}
\begin{minipage}[b][0.5\textheight][c]{0.2\textwidth}
...
\end{minipage}%

\end{document}

Planning Document

• Is Flash Flex sufficient?
• I like Java API. How well does Java Flex compare to it?
• Blender. [JohannesB]

2D Mesh and viewer on .tex Document

• Data. Panorama.
• Package. animate.
• Stepping by 1°. This would require only 180 frames, keeping PDF size small.

3D Mesh and Viewer on .tex Document

• Data. 3D Panorama. I think this can be only a picture. How to get/make such a data?
• Package. animate.
• Stepping by 10°. This would require only 36x18=648 frames, not expanding PDF size.

Thread about making the datatype here in Stackoverflow. [AlexG] The azimuth has a range of 0° to 360° while elevation ranges from -90° to +90° for a sphere and from 0° to +90° for the northern hemisphere. With 10° stepping in both coordinates this makes 36x18 for the whole sphere and 36x9 for the hemisphere. ASCII example of equispaced font where 9 (=18/2) panorama pictures of the hemisphere on top of each other for each angle; everything can be in one picture

1 2 3 4 ... 34 35 36
___2D-panorama #1__ 1
___2D-panorama #2__ 2
________etc________ 3
___________________ 4
___________________ ...
___________________ 8
___2D-panorama_ #9_ 9

Viewer's metadata

• stepping angle
• projection algorithm without loosing data
• .png lossless compression

---

How can you have mouse control of video element in Beamer?

Answer 1

A simple panorama viewer for panoramic images with a fixed z-axis can be built using the animate package. (AR required.)

The example uses a 360° image downloaded here.

Clicking the buttons changes the view by 10°, [shift]+click by 1°.

\documentclass{standalone}
\usepackage{animate}
\usepackage{media9}
\usepackage{MnSymbol}
\usepackage{graphicx}
\usepackage{xsavebox}

\begin{document}
\xsavebox{PanoramaImg}{\includegraphics[width=\linewidth]{potw1130a}}%
\xsavebox{PanoramaImg}{\thePanoramaImg\thePanoramaImg}%
\raisebox{-0.5\height}{\mediabutton[
  jsaction={
    var frm=anim['myPanorama'].frameNum;
    if(event.shift) frm--;
    else frm-=10;
    if(frm<0) frm+=360;
    anim['myPanorama'].frameNum=frm;
  }
]{\Huge$\triangleleft$}}%
\raisebox{-0.5\height}{%
  \begin{animateinline}[label=myPanorama,step,nomouse]{1}
    \multiframe{360}{dStep=0pt+\dimexpr\linewidth/360\relax}{
      \makebox[1.78\height][l]{\hspace{-\dStep}\makebox[0pt][l]{\thePanoramaImg}}
    }
  \end{animateinline}%
}%
\raisebox{-0.5\height}{\mediabutton[
  jsaction={
    var frm=anim['myPanorama'].frameNum;
    if(event.shift) frm++;
    else frm+=10;
    frm\%=360;
    anim['myPanorama'].frameNum=frm;
  }
]{\Huge$\triangleright$}}%
\end{document}