how to make sprite of different game objects form together,how to make sprites from different objects be together

im making a roguelike game and have it so ever square is a new sprite is there a way to group them together so that way it will show a horizontal wall on a square above a room tile and vertical tile on a square to the left/right of a square tile like you can do with tile maps

tldr i want to make a tile map of a bunch of separate game objects