If you have a big enough infestation of leaf-eating ... where they receive at least 8 hours of direct sun. Without this, leaves will yellow, and fruit will not set well.
I have tried to cover my Sicilian lemon tree, which is growing in a pot on my roof terrace, in fleece, but it is too large to do it properly. The leaves are going yellow, but it still has 10 or so ...