The approach is the same as always.
Create a formatted cell in excel, save it, unzip it, analyze the content and replicate with the xlsx helpers.
The only trick, in this case, is that excel expects specific order of xml nodes that you need to change. See the demo here:
https://playground.jsreport.net/w/anon/N05jyaXo