Choosing letter/physical address not possible
With local Outlook it is posible to mark the letter address from existing addresses. It is possible to set and read the value over EWS API. There should be the possibility to set the option too im MS Graph with the values: business, home, other and none. In EWS the property is called PhysicalAddressIndex.