Photos for Mac has been designed as a single user program.
Each user should maintain an own Photos Library and you occasionally share special photos that might be interesting for others.
Whenever a user opened a Photos library, even if you only want to browse it, the library will be modified and you need the read/write access to the internal files. The file ownership of the internal databases will change. That is why the library needs to be on an external volume or in a separate partition, where the "Ignore ownership on this volume" flag can be set.
Tony already pointed out, that only one of you should be logged in, if you are sharing a library. The reason for this is, that the System Photos Library is special and always in use by the Photos background processes, while you are logged into your account, even if you are not working with Photos.
if another user wants to open the library, the user who previously used it needs to log off, so the library is no longer in use. You cannot use "fast user switching", when you are sharing the system Photos Library.
You may want to consider to share a separate library in a separate partition, a joint archive of curated, shared photos, that is not your system photos library and keep your system photo libraries private in your accounts. That will make it less complicated.