Talk:Advanced Format

From Wikipedia, the free encyclopedia

Operating system for native 4K

Would it be a good idea to list / tabulate which operating systems and virtualization environments support 4K native ? Windows 2012, 8, 8.1, Hyper V 3.0, Linux 2.6.31 onwards, FreeBSD 8.x, 9.x etc Pent2013 (talk) 06:48, 26 December 2013 (UTC)

Developed by Western Digital ?

Is this really *developed* by WD ?
The websites linked to express it differently: "As a result, the industry has decided to transition to a 4KB sector size dubbed Advanced Format."

Is it more accurate to say that the hard drive industry has collectively agreed on this changeover... and WD, as the first to incorporate it into products, is using the phrase "Advanced Format" for their implementation of this industry-agreed changeover ?
Or is this a format that WD did actually *develop* then convinced the rest of the industry to adopt ?
86.25.122.135 (talk) 14:35, 7 March 2010 (UTC)

Doesn't look like it: http://www.idema.org/_smartsite/external/bigsector/ 129.101.174.6 (talk) 22:16, 5 November 2010 (UTC)
That link is only showing a 404; a relevant page on idema.org that is available is: http://www.idema.org/?page_id=98
86.25.122.251 (talk) 12:52, 29 January 2011 (UTC)
I believe that WD invented the marketing term. Because it's just an arbitrary number. Not exactly breathtakingly hard to think of. Optical drives have been 2048 bytes-per-sector for years. 2601:1:9500:6D5:8C25:E9D9:1588:7BC6 (talk) 08:44, 19 January 2014 (UTC)
WD and Seagate are producing "Advanced Format" drives. Samsung's tool for their drives http://www.samsung.com/global/business/hdd/support/downloads/support_in_aft.html and Hitachi http://www.hitachigst.com/internal-drives/advanced-format-drives All provide "Advanced Format" though some require utilities.
This appears to be a drive format option for drives that store large files. The article already addresses that this benefits large files, at this time all drive manufacturers provide this as an OPTION, not a requirement. —Preceding unsigned comment added by 74.67.130.59 (talk) 18:00, 25 April 2011 (UTC)

OS compatibility

All access is done via emulated 512b sectors, so this section is irrelevant. All systems ever conceived have same level of compatibility with those transitional AFDrives. Perhaps what author meant was partitioning tool compatibility - which is merely "improved" (partitions properly aligned by default) rather than groundbreaking. Even unaligned partitions still work, just slow as hell. All xp or 2k partitions can be shifted into most efficient position (ie via the WDAlign tool)Agent L (talk) 21:23, 24 March 2010 (UTC)

Linux also provides support, Google "Linux advanced format". I linked a few drive manufactures utilities, I do not know if there is a generic utility to format a drive, but I would not be surprised to see one as this is a industry standard and not a manufacturers standard. Therefor Linux may have a utility. —Preceding unsigned comment added by 74.67.130.59 (talk) 18:05, 25 April 2011 (UTC)
I am not sure if this format will be supported by older devices (like raid cards). This might be nice too include.
Can someone figure out if OpenBSD supports this. OpenBSD is rather slow to adopt changes.
A few drives provide this option without the use of a utility. —Preceding unsigned comment added by 74.67.130.59 (talk) 18:22, 25 April 2011 (UTC)

Not 100% scientific/encyclopedic -> advertisement ?!

Although happy about finding information about the topic, I have the feeling that the authors are utilizing wikipedia for advertising their own technology?! It is not a bad thing, if WD-employees write articles about a technology that WD invented, but an encyclopedic article needs a more scientific approach. E.G.: What are the downsides of Advanced Format? What linux kernels are the EXACTLY who support this technology? Which complications can someone encounter using such disks, etc.. Also, it is not very nice that someone just uses advertising footage in here, i.e. the images are just copy/pasted from some self-advertisement. They should be redone for the special purpose of an encyclopedia, being more scientific and less advertisement. --77.49.54.61 (talk) 07:33, 24 August 2010 (UTC)

I agree. Even the title seems NPOV. AFAICT "Advanced Format" is a marketing term for 4KB sectors. It may be worth noting that if you google for "4k sector" or "4096 sector" you get much more technical articles than if you google for "advanced format". It also seems rather silly that this article is bigger than Disk sector. While I think 4k sectors are a good idea, the compatibility mode seems like something that should be discouraged, as well as the marketing slang. Aij (talk) 23:40, 14 March 2011 (UTC)
The standard is an open standard set by a independent industry supported organization. These organizations are usually created by the industry. Such organizations like w3c are similar and are not in dispute. I see no mention of Western Digital within the current revision.
Note: WD and Seagate are using "Advanced Format", while NewEgg does not even provide an "Advanced Format" or "4K Sector" Option yet. The problem with 4K sector alone is that it is too generic. Also this is not simply a change in the Sector Size but also the Error Correction. "Advanced Format" is Defined by http://www.idema.org/?page_id=2 which is an organization like w3c which is an industry run organization that is setting industry wide standards. All drive manufacturers are offering utilities to enable this format. The name of this article is not biased.—Preceding unsigned comment added by 74.67.130.59 (talk) 17:34, 25 April 2011 (UTC)
The content is not an advertisement, as all drive manufactures now support this. See OS Support for Linux Kernel Information (which is supported).
There are details within the current revision that state the disadvantages, though the large sector size will mean that a 1Byte file will take 4Kb of space (I believe this is evident in the article though maybe I am just a techie). This is detrimental to disks that have a large number of small files. This format is better for large file storage such as video, music, etc (which is in the article). This is not simply a new sector size, it also provides a different form of ECC (as mentioned). This is a new standard. —Preceding unsigned comment added by 74.67.130.59 (talk) 18:12, 25 April 2011 (UTC)

Giday, I think you are wrong and disagree with the statement in the article where it states that a 1k file would necessarily take 4k with 4k hardware sectors. this is all in the logic of the filesystem, reiserfs used tail packing 10years ago and many other modern filesystem use more efficient structures that do not simply use a list of fixed size blocks. the article and your statement above suggest that the issue is universal when it only applies to older filesystems like fat and ntfs.

bonge on! — Preceding unsigned comment added by 123.243.86.168 (talk) 14:19, 21 April 2012 (UTC)


Please remove "The neutrality of this article's title, subject matter, and/or the title's implications, is disputed." as the title is not in dispute. All Manufacturers (Hitachi, Samsung, WD, and Seagate0 are offering tools for their drives. 4K Sector is to generic and Advanced Format 4K Sector. The article is also neutral.—Preceding unsigned comment added by 74.67.130.59 (talk) 17:56, 25 April 2011 (UTC)

redirect

Could someone please redirect advanced format to this page? Thanks. 69.111.194.167 (talk) 08:28, 13 April 2011 (UTC)

Done. — Becksguy (talk) 01:34, 19 April 2011 (UTC)

smartalign

There is a "Disk realignment is necessary to avoid a performance" in the article, but seagate claims that their SmartAlign can do the realignment in drive firmware, without partition realignment. `a5b (talk) 14:55, 6 June 2011 (UTC)

A similar claim is made by WD (with the use of jumpers to set the firmware to 512e). As for Seagate, I think this is a firmware setting without the need for jumper settings. If anyone can verify or find sources, it would be helpful.
The statement "Disk realignment is necessary to avoid a performance ..." mentioned above is true. Seagate's SmartAlign solution cannot avoid a performance loss, however, it is not as severe as a misaligned drive with no firmware solution to compensate.
Another thing I do take small issue with is the idea of "realignment". Currently, one cannot realign a drive unless its partitions are removed and the drive brought back to it's factory raw format (or the misaligned partition(s) that is (are) out of alignment is(are) removed). Essentially, this is a reformat and alignment of the hard drive's partitions. In this case, one does not necessarily require software tools provided by the manufacturers to properly partition and align the drive (one can accomplish this with tools such as fdisk, Gparted or Disk Utility through Linux).--Imwithid (talk) 04:10, 10 April 2012 (UTC)


The following paragraphs are in response to the concerns raised above.

WD's "7-8" alignment jumper adds a +1 sector offset to each LBA. This means that when the OS accesses LBA 63, say, the drive transparently remaps it to LBA 64, thereby automatically aligning the partition. Of course this only guarantees alignment for the first partition.

The ATA standard allows a drive to report the logical/physical sector alignment via word 209 of the Identify Device information block.


Working Draft AT Attachment 8 - ATA/ATAPI Command Set (ATA8-ACS):
http://www.t13.org/documents/UploadedDocuments/docs2008/D1699r6a-ATA8-ACS.pdf
------------------------------------------------------------------------
7.16.7.72 Word 209: Alignment of logical blocks within a physical block
Word 209 shall report the location of logical sector zero within the first physical sector of the media. See Annex E for more information. This word is valid if bit 13 of word 106 is set to one.
Bit 15 of word 209 shall be cleared to zero.
Bit 14 of word 209 shall be set to one.
Bits 13:0 of word 209 indicate the Logical sector offset within the first physical sector where the first logical sector is placed.
------------------------------------------------------------------------


The following Seagate patent appears to relate to SmartAlign. It describes a method for accommodating a HDD with a physical sector size of 1KB on a host system that uses 512-byte logical sector format. The same algorithm could be applied to other physical sector sizes, including 4KB. ISTM that SmartAlign relies on write caching and read lookahead caching to avoid the read-modify-write cycle.


US Pat. 12138022 - Filed Jun 12, 2008 - SEAGATE TECHNOLOGY, LLC
Buffer Management for Increased Write Speed in Large Sector Data Storage Device:
http://www.google.com/patents?printsec=abstract&zoom=4&id=GxbLAAAAEBAJ&output=text&pg=PA3


Here is an extract from the patent:

"An intelligent write command routine improves the operational efficiency of a DSD [Data Storage Device] by avoiding media access of the disk when an LBA and the physical sector are unaligned, thus reducing write time. In one implementation, when a write command is received by the DSD from the host, the intelligent write command routine maintains the read data of the read buffer, instead of clearing the read buffer and performing a read of the target sector on the disk per standard protocol. The intelligent write command copies the necessary adjacent sector data from the read buffer as a data patch to the write buffer to splice around the write data received with the write command. Furthermore, following each write command, the data written to the disk in the write buffer is copied to the read buffer. In this manner, the read buffer is maintained with the most current data on the disk and does not need to be flushed unless the LBA of the write command is beyond the data ranges stored in the read buffer. Further, if read lookahead is active during read commands, a large amount of data may be available in the read buffer for use in patching 512 byte write commands to 1K sectors and thus significantly reduces the write time." — Preceding unsigned comment added by 121.44.124.214 (talk) 00:53, 12 August 2012 (UTC)

4K-ready Host

From the article:

  • 4K-ready Host (Client devices only): A host system which works equally well with legacy 512 as well as 512e hard disk drives.

I would assume that a 4K-ready host would work well with 4K native drives, too?

SyP (talk) 14:54, 13 June 2011 (UTC)


I think there is a problem where someone has carefully avoided stating clearly what the capabilities of each o/s in terms of support for 512e and 4Kn. it is opaquely stated that win7 etc support 512e as does linux and osx, but it is not clearly stated that linux (and osx?) support 4Kn whereas windows does not.

bonge on — Preceding unsigned comment added by 123.243.86.168 (talk) 14:32, 21 April 2012 (UTC)

Does the logo relate to all categories of AF (as follows from the positioning of the logo in the article) or only to AF 512e (as mentioned in http://www.idema.org/?page_id=2153 )? 91.195.22.23 (talk) 11:46, 16 February 2012 (UTC)

Could somebody put a smaller image on the page? It's kinda' large. Miller9904 (talk) 07:30, 6 June 2013 (UTC)

512-byte ... since the inception of the hard-disk drive in 1956

The claim that sectors have been 512 bytes since the inception of the hard drive in 1956 seems bogus.

The byte was an obscure unit invented in 1956 as part of IBM's Project Stretch. Stretch was a hardly noticeable proportion of the industry (very few were sold). It wasn't until the IBM System/360 was introduced that bytes became a common unit. So 512-byte sectors could not have been common before 1964.

The first disk drive was first part of IBM's unrelated 305 "RAMAC". That was a decimal computer and so didn't use bytes (so the disk didn't either). I don't know its sector size -- perhaps 100 decimal digits.

The first disk drives I used were on the IBM 1620. They had sectors of 100 decimal digits (with an extra "flag" bit per digit), and certain metadata. This was not 512 bytes.

IBM System/360 disk drives had tracks, each of which acted a lot like magnetic tape: software could choose a wide range of sector sizes, as long as the data and the block headers/trailers fit in a track. So 512 was neither normal nor optimal. Tracks were not a round number of bytes and were different for each disk drive model.

I used a PDP-8 disk drive (late 1960s). Its sectors held 128 12-bit words. Not 512 bytes.

I have no idea when 512-byte disk sectors became common. The earliest I could imagine is with the minicomputer revolution in the 1970s (yes, minicomputers existed in the 1960s but they were not common and they didn't routinely have disk drives).

BTW, the same dubious claim is made by Disk sector#History and has been disputed by another contributor. DHR (talk) 17:35, 9 April 2013 (UTC)

My experience is that HP mini computers always used 256 byte sectors. This is implicit in the HP3000 MPE OS file system documentation where the minimum size of a file is 256 bytes and default "record" size is 256 bytes. http://bizsupport2.austin.hp.com/bc/docs/support/SupportManual/c01687363/c01687363.pdf documents the MPE LISTF command with format 11 displaying KB rather than displaying 256 byte sector counts -- the LISTF command was present since the early 1970s (though option 11 is newer) The newer HPVOLINFO command (http://bizsupport2.austin.hp.com/bc/docs/support/SupportManual/c01712464/c01712464.pdf) States: "Currently, this logical size is 256 bytes. In the future, however, disks may have different physical sector sizes. MPE will map them to system-wide logical sector sizes." Additionally, http://www.retrocomputing.net/parts/hp/hp7933/docs/7933HTechData-5953-3624-4pages-Mar82.pdf

Clearly documents that 256 byte sector size for this device.

JHawkins HP — Preceding unsigned comment added by 50.156.89.82 (talk) 17:33, 1 July 2013 (UTC)

Nice info. It would be interesting to maybe explore this in more detail - after all, 8 bits per character basically wasn't standardised upon until the rise of microcomputers, that used the cheapest possible, practical, available architecture, that just happened to be based around 8-bit CPUs (which meant 8-bit buses and 8-bit memory, holding and transporting 8-bit chunks of data). IBM had quite a love of 6-bit and its multiples (particularly 18 and 36 bit word lengths), as seen with the use of EBCDIC; those word lengths were also rather convenient for storing records that were previously held on 9-track tape or 9-row (80-column) cards. Other companies as described also seemed to go in more for the multiples-of-3 idea, with 9, 12, sometimes even 24 bit architectures. And all the data on a disc, much like with a helical scan or single-track tape, is simply held as a string of bits. When you're not using data streams whose bit lengths can be cleanly divided by 8, why use disc sectors that are a certain power-of-2 multiple of 8? 512 bytes is 4096 bits. 4096 doesn't divide into 3, so it doesn't divide into 6, 9, 12, 18, 24, 36 either... (and neither, for that matter, does (520x8), in case the strangely mentioned alternative crossed your mind).
512 itself didn't come along as a standard until later, and I think was just a historical accident of being both where the technology was "at", and something that gave a convenient data granularity and file table size at the time of introduction of (5 and 10mb, 5.25 and 8 inch) "Winchester" drives in SoHo systems in the early 80s. Floppies were generally 128 and 256 byte sector, but also quite slow and low capacity, holding small files, and not ever so reliable, so very fine sectors with a relatively large amount of ECC made sense, and the file tables weren't so huge (when your disc holds 160kb, you only have 640 x 256b sectors to look after... the FAT doesn't even need to take up 1kb). Yer 5MB Winchester took things further with about 10000 x 512b sectors (a not unreasonable 20kb file table with 16 bit addressing)... and from there on out, thanks to the general stagnation that happens in the computing world when things don't HAVE to change, so it remained. When FAT16 hit an early limit, some bright spark came up with the idea of partitions using variable-sized "clusters" tuned to their individual sizes... and as an unintended side effect, as they forgot (or couldn't find space) to include anything that defined sector size (or indeed clusters as a set group of bytes rather than sectors), pretty much froze commodity HDDs at 512b because no-one could then release a 1024 (or larger) byte sector drive without breaking everything in the existing filesystem paradigm. Even though, bizarrely, CDROMs, DVDs, and even floppy discs (first 720k's, then 1.2 and 2.8MBs) leapfrogged to 1024 (floppies; first to simplify things in the double density transition from single to double sided, then because FAT12 didn't allow more than 2.0MB with 512b sectors), 2048 (CD) and 4096 (DVD) byte sectors. Even now, similar things are occurring; 4096 has only been chosen this time because it makes things easier, and doesn't "break" things any more than it needs to... IE transactional database atomic processes, Windows file systems (4k default clusters since introduction of FAT32), etc. One expects manufacturers would have gone for at least 32k, maybe 64k, if they could have done it without massive stress. The overhead saving would have been huge, and it still wouldn't have exceeded some previously seen maximum cluster sizes. Thankfully, 4k is but "phase 1", though the details of any later phases still to come haven't been announced.
Point of note: the "decimal digits" were quite likely BCD rather than any kind of multi-level recording, and thus would be 4 bits per digit. With an additional "status" bit (as per the Intel 4004 scheme) and 100 digits per sector, that's 500 bits per sector. Or 62.5 modern "bytes". Also, 128 x 12-bit characters is 192 "bytes"... So even without the IBM/etc three-times-table examples, it STILL need not be a power of two, multiplied by 8... 146.90.69.70 (talk) 01:56, 28 July 2013 (UTC)
@146.90.69.70 wrote: "One expects manufacturers would have gone for at least 32k, maybe 64k, if they could have done it without massive stress. The overhead saving would have been huge"
I disagree. The savings would have been around 2%. The comparison table in the article states a change in formatting efficiency from 88.7% to 97.3%. In other words, AF makes an additional 8.6% of the physical drive capacity usable, and "wasted" space is reduced from 11.3% to 2.7%. For example, a 10.0TB drive with a native sector size of 512 Bytes has a physical capacity of about 11.27TB (10.0TB / 0.887). A 4kn drive with the same physical capacity has a usable capacity of about 10.97TB (11.27TB x 0.973), which is a nice, 10% increase. I'd gladly take an additional TB. Since wasted space is now only 2.7%, this limits the potential gain for further format changes. If we transition from 4k to 32k, we might again achieve a reduction of wasted space by a factor of four, but would gain only 2.7% times 3/4 equaling about 2.1% additional space. Who cares about the difference between 11.0TB and 11.2TB? Some may do so, but I don't, and I would definitely not call that a "huge saving". --RainerBlome (talk) 10:41, 12 December 2019 (UTC)

4Kn on non-bootdrives

2 TB border?

"512 (or 520) byte"...

Dougolsen ... naughty boy?

List of typical drives

Requested move

What is the role of external HDD enclosures in this standard

Request for Additional Information Inclusion - Change a HDD from 512e to 4Kn Mode

Related Articles

Wikiwand AI