The following steps will add a new alias to given emails. It will not make the new alias as primary.

  1. Open a persistent session to the Exchange.
    $Session = New-PSSession -ConfigurationName Microsoft.Exchange -ConnectionUri https://outlook.office365.com/powershell-liveid/ -Credential $UserCredential -Authentication Basic -AllowRedirection

02. Import the session to your PowerShell:
Import-PSSession $Session

03. Login to Microsoft 365 admin account
Connect-Msolservice

  1. Download Global address list.
    get-user -resultsize unlimited |select * |export-csv c:\M365\users.csv
  2. Delete all columns except "Identity".
  3. Add a new column named "Alias".
  4. After updating the sheet, run the following script.

$Recipients = Import-Csv C:\M365\users.csv
Foreach ($Item in $Recipients)
{
Set-Mailbox -Identity $Item.Identity -EmailAddresses @{Add=$Item.Alias}
}

(This note is based on what I did today. I have very little understanding of PowerShell. If you are going to try these steps, please do your research first.)