Members of the President's Committee on the Arts and Humanities announced their resignation from the group in a letter Friday.
The White House says Trump and Bannon "mutually agreed" on Bannon's last day as chief strategist.
The Supreme Court justice will be the keynote speaker at an event next month at Trump International Hotel in Washington, D.C.
State Sen. Maria Chappelle-Nadal told local media she was upset about President Trump's controversial comments on the violence in Charlottesville.
The White House strategist said North Korea, Charlottesville and identity politics are just distractions to him.