Aldi has overtaken Morrisons to become the fourth-largest UK supermarket for the first time, according to data from research firm Kantar.
Discounters are grabbing more market share as shoppers take steps to manage their budgets, Kantar said.
Food prices are rising quickly as energy and fuel costs soar, and the war in Ukraine squeezes grain production and pushes up fertiliser costs.
Kantar said food price inflation hit a record 12.4% in August.
Milk, butter and dog food prices were rising especially quickly.
Inflation in the UK has been soaring as food prices rise, with living costs eating into household budgets.
"It seems there's no end in sight to grocery inflation as the rate at which food and drink prices are increasing continues to accelerate," said Kantar head of retail and consumer insight Fraser McKevitt.
"Shoppers are taking steps to manage their budgets including broadening the range of stores they visit, with the discount grocers benefiting."
Shoppers are also cutting back on spending by buying more own-brand products, with sales of the very cheapest value own-label products up by a third compared to last year.
Nevertheless, Kantar said food price rises will push up the average annual grocery bill by £571 to £5,181.
Kantar said Aldi's sales rose by almost a fifth in the 12 weeks to 4 September compared with a year earlier, giving it a market share of 9.3%.
In contrast, Morrisons' sales dropped by 4.1%, with its market share falling to 9.1%.
Morrisons said market share was "partly a function of new store openings".
"Although Morrisons has not put on any significant new space for a while, some competitors are still opening many new stores," it said.
However, it added that "customers don't really care about market share statistics - they care about value, quality, provenance and service and that is where our focus is going to remain."
Sales at discounter Lidl rose by more than a fifth, and it increased its market share to 7.1%.
Mr McKevitt said: "Back at the start of the 2010s, Tesco, Sainsbury's, Asda and Morrisons together accounted for over three quarters of the sector but that traditional big four is no more.
"The discounters have seen dramatic sales increases in recent months, bringing more and more customers through their doors."
He said Aldi had consistently been opening stores, and that 14.2 million people had shopped at the grocer in the past three months.
Aldi and Lidl have been expanding and growing their market share in the UK over the past decade.
However, online grocer Ocado, which has also been growing, said it expected to see a small drop in sales this year as customers buy less and and look for cheaper items.
Previously the company, which is a joint venture between Ocado Group and Marks & Spencer, had predicted a small increase in sales.
In a trading update, Ocado said it expected earnings to be "close to break-even" this year as rising costs, including energy and dry ice, and the lower average value of people's shopping baskets offset a growth in the number of customers.
Source: BBC