Lines Matching refs:populated
177 * The number of empty populated pages, protected by pcpu_lock.
183 * The number of populated pages in use by the allocator, protected by
192 * try to keep the number of populated free pages between
918 * populated with pages, while we account it here. The number
1061 * pcpu_is_populated - determines if the region is populated
1067 * For atomic allocations, check if the backing pages are populated.
1070 * Bool if the backing pages are populated.
1081 start = find_next_zero_bit(chunk->populated, end, start);
1085 end = find_next_bit(chunk->populated, end, start + 1);
1096 * @pop_only: use populated regions only
1360 alloc_size = struct_size(chunk, populated,
1401 /* manage populated page bitmap */
1403 bitmap_fill(chunk->populated, chunk->nr_pages);
1512 * @chunk: pcpu_chunk which got populated
1516 * Pages in [@page_start,@page_end) have been populated to @chunk. Update
1527 bitmap_set(chunk->populated, page_start, nr);
1551 bitmap_clear(chunk->populated, page_start, nr);
1852 for_each_clear_bitrange_from(rs, re, chunk->populated, page_end) {
1972 * @empty_only: free chunks only if there are no populated pages
1975 * number of populated pages. Otherwise, only reclaim chunks that have no
1976 * populated pages.
2011 for_each_set_bitrange(rs, re, chunk->populated, chunk->nr_pages) {
2024 * pcpu_balance_populated - manage the amount of populated pages
2026 * Maintain a certain amount of populated pages to satisfy atomic allocations.
2045 * Ensure there are certain number of free populated pages for
2081 for_each_clear_bitrange(rs, re, chunk->populated, chunk->nr_pages) {
2116 * Scan over chunks in the depopulate list and try to release unused populated
2120 * populated pages threshold, reintegrate the chunk if it has empty free pages.
2121 * Each chunk is scanned in the reverse order to keep populated pages close to
2142 * allocator not touching the populated bitmap.
2150 * Scan chunk's pages in the reverse order to keep populated
2168 * If the page is empty and populated, start or
2175 test_bit(i, chunk->populated)) {
2219 * pcpu_balance_workfn - manage the amount of free chunks and populated pages
2223 * populated pages. An important thing to consider is when pages are freed and
2700 pcpu_chunk_struct_size = struct_size((struct pcpu_chunk *)0, populated,
3303 /* pte already populated, the following shouldn't fail */
3409 * pcpu_nr_pages - calculate total number of populated backing pages
3411 * This reflects the number of pages populated to back chunks. Metadata is
3417 * Total number of populated backing pages in use by the allocator.