A new national report finds that 4.5 million Canadians who are middle aged and older have had trouble accessing specialist care — a problem that could only get worse as the country's population ages.