Acrylic
The basic designs would be similar to the large windows in modern seaquarium tanks. Such "sea homes" would have to be built in sheltered lagoons or other locations shielded from major storm and wave actions. I doubt something like that would withstand much hammering (not an issue in seaquariums). Fortunately, reef locations in shielded areas are also among the most spectacular.