No I'm not worried, he is close to his best. What people forget is that the Vuelta was an exception, and he just barely scraped the top 10 there in the toughest mountain stages. So in Romandie, with a lot more climbers on form then a late season Vuelta, a 10th place would have been good already. He was 16th in the end so, not so far behind. But still behind.
He is no Giro winning material. Never was. Hell, until last year he wasn't even a real stage-racer.
His goal in the Giro is winning the time trials, everything else is bonus. There is no GC focus this year