Here is one possibility using a \matrix. There are some comments in the code, ask if anything is unclear.
\documentclass[border=5mm]{standalone}
\usepackage{tikz}
\usetikzlibrary{matrix}
% hack for style of empty cells from https://tex.stackexchange.com/a/386805/
\tikzset{empty node/.style={coordinate}}
\makeatletter
\def\tikz@lib@matrix@empty@cell{\iftikz@lib@matrix@empty\node[name=\tikzmatrixname-\the\pgfmatrixcurrentrow-\the\pgfmatrixcurrentcolumn,empty node]{};\fi}
\makeatother
\begin{document}
\begin{tikzpicture}
\matrix [
% with the following option each cell becomes a node, set in math mode
% the nodes are named automatically as <matrix name>-<row number>-<column number>
matrix of math nodes,
nodes in empty cells, % add cells also to empty nodes
nodes={minimum width=1cm, minimum height=1cm, font=\strut} % set style of nodes
] (m) % give the matrix the name m
{
& \mu = 0 & 1 & 2 & 3 & \dots \\
\nu = 0 & & & & & \\
1 & & & & & \\
2 & & & & & \\
3 & & & & & \\
\vdots & & & & & \\
};
% for explanation of |- syntax: https://tex.stackexchange.com/a/401429/
% used to ensure horizontal/vertical lines
\draw (m-1-2.north west) -- (m-1-2.north west |- m-6-1.south east);
\draw (m-2-1.north west) -- (m-2-1.north west -| m-1-6.south east);
% due to the automatic node naming mentioned above, m-1-2 is the
% node in the first row, second column of the matrix
% a plot is an easy way of drawing a line with dots
\draw plot[mark=*] coordinates {(m-2-2)(m-2-3)(m-2-4)(m-3-4)(m-3-5)};
% for explanation of |- syntax: https://tex.stackexchange.com/a/401429/
% using that you only need to specify every other corner on the path
\draw (m-3-2) |- (m-4-3) |- (m-6-6);
% draw shifted, dotted line
% transform canvas idea from https://tex.stackexchange.com/a/180669/
\draw [dotted, transform canvas={shift={(5pt,5pt)}}] (m-3-2) |- (m-4-3) |- (m-6-6);
\end{tikzpicture}
\end{document}

tabular, a TikZ\matrixmight be useful. As an addendum, I know the following isn't that helpful, but at a basic level the diagrams are quite simple. If you know how to draw a line between points and how to place text at a specified point, you can do the bulk of them, so a lot of TikZ knowledge isn't needed. (Of course, some knowledge could make it easier to do.) – Torbjørn T. Sep 28 '19 at 10:57\documentclass[tikz,border=3mm]{standalone} \begin{document} \begin{tikzpicture} \draw (-2,1) -- (4.5,1) (-1,2) -- (-1,-4.5); \foreach \X [count=\Y starting from 0] in {\mu=0,1,2,3,\cdots} {\node[above=0.5ex] at (\Y,1) {$\X$};} \foreach \X [count=\Y starting from 0] in {\nu=0,1,2,3,\cdots} {\node[left=0.5ex] at (-1,-\Y) {$\X$};} \draw[mark=*] plot coordinates {(0,0) (1,0) (2,0) (2,-1) (3,-1) (3,-2) (4,-2) (4,-3)}; \end{tikzpicture} \end{document}... – Sep 28 '19 at 11:22