The name originates from the practice of mining, where tunnels were dug under enemy fortifications or forces. These tunnels ("mines") were first collapsed to destroy fortifications above, and later filled with explosives and detonated. Land mines generally refer to devices specifically manufactured for this purpose, as distinguished from improvised explosive devices ("IEDs").

The use of land mines is controversial because they are indiscriminate weapons, harming soldier and civilian alike. They remain dangerous after the conflict in which they were deployed has ended, killing and injuring civilians and rendering land impassable and unusable for decades. To make matters worse, many factions have not kept accurate records (or any at all) of the exact locations of their minefields, making removal efforts painstakingly slow. These facts pose serious difficulties in many developing nations where the presence of mines hampers resettlement, agriculture, and tourism. The International Campaign to Ban Landmines campaigned successfully to prohibit their use, culminating in the 1997 Convention on the Prohibition of the Use, Stockpiling, Production and Transfer of Anti-Personnel Mines and on their Destruction, known informally as the Ottawa Treaty. As of 2007, a total of 158 nations have agreed to the treaty. Thirty-seven countries have not agreed to the ban, including China, India, Israel, Pakistan, Poland, Russia and the United States.

Land mines were designed for two main uses — to create defensive tactical barriers (such as protecting a unit's flanks against infiltration tactics, channeling attacking forces into predetermined fire zones or slowing an invasion force's progress to allow reinforcements to arrive), and to act as passive area-denial weapons (in order to deny the enemy use of valuable terrain, resources or facilities when active defense of the area is not desirable or possible). The former purpose is the primary large-scale current use of land mines, and the reason for their widespread use in the demilitarized zones (DMZs) of likely flashpoints such as Cyprus, Afghanistan and Korea.

Some sources report that the 3rd-century Prime Minister Zhuge Liang of the Kingdom of Shu in China invented a land mine type device. This claim was made by Jiao Yu in his Huolongjing Quanzhi (Fire-drake Manual in One Complete Volume), his preface written in 1412 AD (although the book was originally published in the mid 14th century), and that Zhuge had used not only "fire weapons" but land mines in the Battle of Hulugu Valley against the forces of Sima Yi and his son Sima Zhao of the Wei Kingdom. However, this claim is dubious, considering that gunpowder warfare did not exist in China until the advent of the flamethrower (Pen Huo Qi) in the 10th century, while the land mine was not seen in China until the late 13th century.

Explosive land mines were being used in 1277 AD by the Song Dynasty Chinese against an assault of the Mongols, who were besieging a city in southern China. The invention of this detonated "enormous bomb" was credited to one Lou Qianxia of the 13th century. The famous 14th century Chinese text of the Huolongjing, which was the first to describe hollow cast iron cannonball shells filled with gunpowder, was also the first to describe the invention of the land mine in greater detail than references found in texts written beforehand. This mid 14th century work compiled during the late Yuan Dynasty and early Ming Dynasty (before 1375, when its co-editor Liu Ji died) stated that mines were made of cast iron and were spherical in shape, filled with either 'magic gunpowder', 'poison gunpowder', or 'blinding and burning gunpowder', any one of these compositions being suitable for use. The wad of the mine was made of hard wood, carrying three different fuses in case of defective connection to the touch hole. In those days, the Chinese relied upon command signals and carefully timed calculation of enemy movements into the minefield, since a long fuse had to be ignited by hand from the ambushers in a somewhat far-off location lying in wait. However, the Huolongjing also describes land mines that were set off by enemy movement, called the 'ground-thunder explosive camp', one of the 'self-trespassing' (zifan) types, as the text says:

The Huolongjing describes the trigger device used for this as a 'steel wheel', which directed sparks of flame onto the connection of fuses running to the multiple-laid land mines underneath the carefully-hidden trap. However, further description of how this flint device operated was not made until a Chinese text of 1606 AD revealed that a weight drive (common in medieval clockworks) had been used to work the 'steel wheel'. The way in which the Chinese land mine trigger worked was a system of two steel wheels rotated by a falling weight, the chord of which was wound around their axle, and when the enemy stepped onto the disguised boards they released the pins that dropped the weights. In terms of global significance, the first wheellock musket in Europe was sketched by Leonardo da Vinci around 1500 AD, although no use of metal flint for gunpowder weapons were known before that point in Europe.

Besides the use of steel wheels providing sparks for the fuses, there were other methods used as well, such as the 'underground sky-soaring thunder'. The Ming Dynasty (1368–1644) text of the Wubei Zhi (Treatise on Armament Technology), written by Mao Yuanyi in 1628, outlined the use of land mines that were triggered by the heat of a slow-burning incandescent material in an underground bowl placed directly above the train of fuses leading to the mines buried 3 ft beneath. The booby trap of this mine system had a mound where weapons of halberds, pikes, and lances were dug in, meant to entice the enemy to walk up the small mound and claim their stolen prize of war booty. When the weapons were removed from the mound, this movement disturbed the bowl beneath them where the butt ends of the staffs were, which in turn ignited the fuses. According to the Wubei Huolongjing volume of the 17th century, the formula for this slow-burning incandescent material allowed it to burn continuously for 20 to 30 days without going out. This formula included 1 lb of white sandal wood powder, 3 oz of iron rust (ferric oxide), 5 oz of 'white' charcoal powder (from quicklime), 2 oz of willow charcoal powder, 6 oz of dried, ground, and powdered red dates, and 3 oz of bran.

The Chinese also employed the use of the naval mine at sea and on the rivers of China and elsewhere in maritime battles.

The first land mine in Europe was created by Pedro Navarro (d. 1528), a Spanish soldier, who used it in the settles of the Italian castles, in the beginning of the sixteenth century.

At Augsburg in 1573, a German military engineer by the name of Samuel Zimmermann invented an extremely effective mine known as the fladdermine. It consisted of a fougasse (or later, sometimes a shell fougasse, that is, a fougasse loaded not with stones but with early black powder mortar shells, similar to large black powder hand grenades) activated by a snaphance or flintlock mechanism connected to a tripwire on the surface. Combining the effects of a tripwire activated bounding fragmentation mine with a cluster bomb, it was devastating to massed attackers but required high maintenance due to the susceptibility of black powder to dampness. Consequently it was mainly employed in the defenses of major fortifications, in which role it continued to be used until the 1870s.