Each contiguous combination of an insulating backside trench fill material portion 176 and at least one bridge structure 73B constitutes a backside trench fill structure (73B, 176). The insulating backside trench fill material portion 176 can contact widthwise sidewalls and a bottom surface of the at least one bridge structure 73B located in a same backside trench 79. Each backside trench fill structure (73B, 176) contacts a respective sidewall of each layer within a pair of alternating stacks of insulating layers (132, 232) and electrically conductive layers (146, 246). In one embodiment, a pair of lengthwise sidewalls of each insulating backside trench fill material portion 176 can contact a pair of lengthwise sidewalls of the backside trench 79 that laterally extends along the first horizontal direction hd1.