The Underwater Key Sigil can be found in Genshin Impact by entering a cave on the East side of Watatsumi Island.
Location
The entrance is located West of the Key Sigil waypoint that appears on your mini map during the The Still Water Flows – Look for the remaining Key Sigils quest.