No possibility to delete a cell

The controls are only visible if the cell is focused. (In your screenshot, the cell is both pinned and focused.) You can blur the cell with the Escape key or by clicking outside the cell focusing another cell and the controls will hide.