I would do what you’re doing, then twat the side of the frame with a sledgehammer, preferably with a bit of thick plate in between so you don’t dent the frame. If you get any movement, put a bar behind the idler, then try to lever it forward. As soon as you see movement in either direction, stop and try it the other way. If you can, move the jack to the inside, then try to hit where you currently have the jack with a sledgehammer and drift. Don’t go mad and dent the frame though, or you’ve got another headache.
No easy way round this one, but as soon as it moves a bit, you’ve got it. I wouldn’t be putting heat to it.
on edit, after another look at the drawing, it’s probably no. 4 that’s jammed in the track frame, not the idler bearing supports. Is it possible to get a long bar in to hit the plate where bolt no.6 pushes it? Possibly tap the frame around where n.4 sits while trying to turn the adjuster screw in?
I am wondering if the square plate on no.4 has sat in the same place so long that it’s sitting in a wear groove at the bottom. If this is the case, and there’s access from underneath, see if you can wedge no.4 upwards while trying to move it. I know this is a lot of words, but best I can do from here in civilisation.