Index

Food (Diet)

2025-12-20T00:00:00+00:00

How to eat deliciously with less salt, potassium, glucose.

Overview

Do you control your food intake?

It’s convenient to get food from restaurants, markets, or delivered by PrimeNow, Walmart+, DoorDash, GrubHub, Uber Eats, Postmates, Instacart, Zomato, etc. But that means losign control of what levels of sodium, sugar, and unhealthy chemicals we consume. We are also at the mercy of waiting for trucks from UPS, FedEx, and USPS trucks to deliver packages.

Foods from covenience stores and markets are manufactured for shelf life, which means unhealthy levels of salt, sugar, and other presevatives.

Food apps

Open Food Facts.org is a free app to scan a UPC code to discover & compare over 3 million food products. Provides Nutri-score of healthiness and impact on planet. For Android and iOS, crafted with Flutter and Dart and open-sourced at https://github.com/openfoodfacts/smooth-app Since 2012. Docs at https://openfoodfacts.github.io/smooth-app/

For $100/year, prepear.com presents a tagline “Deals to Meals” which covers the entire workflow of eating:

Identify money-saving deals
Design meals based on those deals
Structure how to prepare those meals.

Purines, Uric Acid, and Gout

Red meats, organ meats, shellfish, sardines, aged cheese, yeast, alcohol (especially beer), and sugary drinks/fructos contain purines. Purines are absorbed in the gut and enter the bloodstream as nucleotides and bases, which are then further broken down in the liver. Uric acid is carried in the blood to the kidneys, which filters it out in urine.

Uric acid levels can also rise when taking diuretics (“water pills”), low‑dose aspirin, some blood pressure drugs, and anti‑rejection drugs after transplants.

If too much uric acid is created or kidneys do not clear enough of it, uric acid builds up (hyperuricemia) and forms needle‑like monosodium urate crystals in joints, causing gout attacks (often in the big toe). Dehydration can also trigger gout attacks.

https://www.mayoclinic.org/diseases-conditions/gout/symptoms-causes/syc-20372897
https://www.niams.nih.gov/health-topics/gout
https://medlineplus.gov/gout.html
https://www.webmd.com/diet/foods-high-in-purines
https://pmc.ncbi.nlm.nih.gov/articles/PMC9459802/

Minerals

Magnesium maintains nerve and muscle function, a healthy immune system and strong bones. In Blood tests for Magnesium, the normal range is 1.6 to 2.6 mg/dL.

Iron makes hemoglobin for healthy red blood cells, from red beans, liver (high in colesterol), ???

Phospherous

Calcium & PTH Testing

Sources of calcium are dairy, fortified orange juice, antacids, green leafy vegetables, oats, sweet potatoes, almonds. Almonds also help to stimulate acetylcholine production, which helps the neurons in the brain effectively communicate.

The “PTH, Intact” blood test (CPT code 35202) measures the full (not just fragment) intact parathyroid hormone (PTH) circulating in blood made by the parathyroid glands in the neck (in the back of the thyroid), which help regulate calcium, phosphorus, and vitamin D levels in the body. Although their names are similar, the parathyroid glands and the thyroid gland are not related.

Normal PTH range is 18.4 to 80.1 picograms per milliliter (pg/mL).

Install the free Calcium Pro app (by “Calcium Science”) on iPhone or Android. Developed by Normn Center in Tampa, Florida. It explains the interaction of Calcium, PTH, Vitamin D, bone density, etc.

PTH triggers the release of small amounts of calcium from your bones into your bloodstream.
PTH enables the production of active vitamin D (calcitriol) in the kidneys. PTH also signal kidneys to keep calcium in the body rather than flushing it out through your pee.
PTH signals small intestine to absorb more calcium from food eaten.

The test identifies parathyroid disorders such as severe osteoporosis, or mineral/bone disorders.

Hyperparathyroidism (too high) can indicate not enough Vitamin D or chronic kidney disease (which cause the parathyroid glands to become overactive).

Symptoms of hyperparathyroidism include bone and joint pain, constipation, nausea, vomiting, kidney stones, lack of appetite, and fatigue.

Hypoparathyroidism (too low) can be from excessive calcium or Vitamin D intake.

Resources:

https://www.parathyroid.com/parathyroid-disease.htm
https://www.niddk.nih.gov/health-information/endocrine-diseases/primary-hyperparathyroidism
https://www.ucsfbenioffchildrens.org/medical-tests/parathyroid-hormone-(pth)-blood-test
https://medlineplus.gov/lab-tests/parathyroid-hormone-pth-test/
https://testdirectory.questdiagnostics.com/test/test-detail/35202/pth-intact-without-calcium?cc=MASTER

Sodium

Food labels percentages are based on 2300mg (one teaspoon) of Sodium as the recommended consumption per day.

CAUTION: Many products (such a bullion) sold as “Low Sodium” merely replace sodium with Potassium.

Potassium

kidney.com notes that I can protect my kidneys by watching how much I consume potassium, which affects blood pressure.

A potassium level of 5 or higher detected in the blood, called hyperkalemia, means the kidneys are not able to remove excess potassium. That can cause irregular heartbeat or a heart attack.

REMEMBER: 5175 mg/day is the basis for percentages of daily on US food labels. 1 Potassium point = 39mg for 132 points/day. So if a 168g persimmon has 270mg, /39 = 7 points (like a mango, 4 prunes, or a cup of blackberries).

PROTIP: Avoid what are high in potassium: red meats, dairy, black tea, coffee, molassas, coconut, tomatos, bananas, mushrooms, spinach, all nuts, etc. Substitutes:

Instead of red meats (beef), eat eggs, chicken, turkey, vegetarian dishes
Instead of tomatos, BBQ sauce
Instead of bananas,
Instead of mushrooms,
Instead of black tea and coffee, Postum,
Instead of molassas, maple syrup,
Instead of oranges, citrus
Instead of avocados,
Instead of potatos, consider cauliflour, jacima
- Gingered Sweet Jacima-Apple Salad
Instead of dairy, rice milk

Low potassium fruits (fresh or dried):

Apple 1 medium
Applesauce ½ cup
Apricots, canned in juice ½ cup (drain liquid first)
Blackberries ½ cup
Blueberries ½ cup
Cherries ½ cup
Cranberries ½ cup
Fruit cocktail ½ cup (drain liquid first)
Grapes or grape juice ½ cup
Grapefruit ½ whole
Mandarin oranges ½ cup
Peaches 1 small fresh or ½ cup canned
Pears 1 small fresh or ½ cup canned
Pineapple ½ cup
Pineapple juice 4 ounces
Plums 1 whole
Raspberries ½ cup
Strawberries ½ cup
Tangerines 1 whole
Watermelon Limit to one cup
- Very Berry Tofu Smoothies
- STORE: Sunnyfruit dried persimmons $7.69

Low-potassium vegetables:

Grilled Vegetables
Alfalfa sprouts ½ cup
Asparagus 6 spears
Beans, green or wax ½ cup
Broccoli (raw or cooked from frozen) ½ cup
Green cabbage ½ cup
Red cabbage ½ cup
Carrots, cooked ½ cup
Cauliflower ½ cup
Celery 1 stalk
Corn?
- Birthday Popcorn
Cucumber ½ cup
Eggplant ½ cup
Kale ½ cup
Lettuce
White mushrooms, raw ½ cup ???
Onions ½ cup
Peas, green ½ cup
Peppers ½ cup
Yellow squash ½ cup
Zucchini squash ½ cup
Radish ½ cup
Water chestnuts, canned ½ cup
Beets ???
Watercress ???
Pumpkin ???
Tofu?

Canning, Leaching out potassium

Reduce the potassium in spinich and carrots by leaching the vegetables.

Canned or cooked mushrooms (generic) typically have around 100-277 mg per 1/2 cup. CAUTION: Dried and cooked mushrooms are higher potassium per serving because water is lost and weight decreases, concentrating the minerals. Maitake mushrooms have 204 mg per 100 grams fresh to an extremely high 2625 mg per 105 grams dried.

American supermarkets such as Walmart and Albertsons display isles and isles of packages from the industrial food complex of over-processed food.

I get the “No salt” or “Lightly Salted”.

References:

https://estore.uga.edu/C27063_ustores/web/product_detail.jsp?PRODUCTID=4495&SINGLESTORE=true
Fry chicken without adding salt.

Cooking

Combine with spices in Recipies from kidney dietitians:

https://based.cooking/ https://github.com/binabh/based-cooking-app

Instead of Chicken McNuggets from McDonalds or Chick-Fil-A,
- Healthy Chicken Nuggets
Glazed Carrots
Eggplant dip
Grilled Veggie Kabobs
Cauliflower Herb Soup
Vegan African Stew
Vegetable Spanish Paella
Korean Bibimbap Oatmeal
Caribbean: Jerk Chicken with Rice and Peas
Chickpea Tikka Masala
Curry Ginger Pea Dip
Maple-Balsamic Chicken
Balsamic Herb Tofu with Rainbow Roast Vegetables
Mexican Style Stuffed Peppers
BBQ Pineapple Chicken
Pad Thai de pollo
Chicken Broccoli Stir Fry
Stuffed Pumpkin Meatloaf
Creamy Curry Rice & Apple Salad
Shredded Mexican Chicken in a Crock-pot
Smoked Chicken and Apple Soup

From among On Amazon: Low-Potassium cookbooks:

Stage 3 Kidney Disease Diet Cookbook for Seniors: 100+ Quick & Easy Low-Sodium, Low-Potassium Recipes with a 14-Day Meal Plan, Grocery Lists & Full Nutrition Facts to Help Manage CKD [Print Replica] Kindle Edition

Cooking eggs

To cook hard-boiled eggs, steam them ensures uniform cooking, preventing rubbery whites. Using a steamer removes the guesswork of timing that comes with boiling. In a steamer basket, cover, and cook 6 minutes for soft-boiled eggs or 12 minutes for hard-boiled. Alternative: air fryer 8 - 12 eggs at 275 for 12 mins.

Rapid cooling in an ice bath halts the cooking process, preserving the ideal texture and preventing overcooking.

Remove shell under a thin stream of running water. (The water helps get under the shell and lift it off the egg.)

Dairy

Get all 3 in Kerry Gold Butter buscuits, mailed from Caroll’s Gifts in Ireland. $10 US for two boxes.

Washington State Univerity’s Cougar Cheese got a Highly Recommend” rating on Bon Appetit! “Refrigerate upon arrival” $25.00 per 30-ounce can (plus shipping) in 8 flavors: Cougar Gold® (aged 14 months), Natural Cheddar (aged at least a year), Smoky Cheddar, Viking (similar to a Monterey Jack), Dill Garlic, Sweet Basil, Hot Pepper, Crimson Fire

Sugar & Carbs: Glucose

Our bodies convert carbohydrates to sugar.

The “Hemoglobin A1C (HbA1c)” blood test at a doctor’s lab measures the average (over the past 2 to 3 months) blood sugar (glucose) based on the percentage of glycated hemoglobin (a protein in red blood cells) that is coated with sugar.

Normal: below 5.7%
Prediabetes: 5.7% to 6.4%
Diabetes: 6.5% or above

A1C of 7% roughly corresponds to an average blood sugar level of 154 mg/dL (8.6 mmol/L).

Our pancreas produces insulin that travels through our blood to break down sugar. Type 1 Diabetes is when the pancreas does not make enough insulin. Those with Type 1 Diabetes need to take insulin several times during the day. There are different ways to take insulin: via a needle and syringe, an insulin pen, or an insulin pump (also called an automated insulin delivery system) device.

People with Type 2 diabetes can control their blood glucose level by consuming healthy meals and beverages, limiting calories if they have overweight or obesity, and physical activity (150 minutes, each week).

Those with type 2 diabetes need to take diabetes medicines which include diabetes pills or medicines you inject, such as insulin. Over time, you may need more than one diabetes medicine to control your blood glucose level. Even if you do not take insulin, you may need it at special times, such as if you are pregnant or if yoxu are in the hospital for treatment. x Txhe glucose test at the doctor’s office identified a calibrated level that is 10 points above what my Stelo Continuous Glucose Monitor (CGM) reported at the same time. Costco carries Dexcom (Stelo) by prescription. It needs to be changed every 15 days.

After you identify a baseline – about 104 mg/dL (milligrams per deciliter)after fasting (waking up after 8 hours sleep), I’m realy at 94 mg/dL, which is within normal glucose levels for a healthy adult of between 70 and 99 mg/dL. A fasting level higher than 126 mg/dL suggests diabetes.

The Stelo CGM issues a notification to my phone above a set threshold. That enables me to see to what level different foods spike my blood glucose level:

A can of water-washed peaches took me to 140 mg/dL.

Sustained high readings above 140 to 199 mg/dL (7.8 mmol/L and 11.0 mmol/L) suggests prediabetes. Levels above 200 mg/dL or 11.1 mmol/L (millimoles per liter) suggests diabetes. *

Normally, two hours after eating, levels should be back to baseline.

REMEMBER: Eating protein before sugar intake and exercise after eating helps to reduce levels.

The pancreas does not differentiate between natural vs. artificial sugar (Sucralose).

“Regular” canned fruit:

$0.64 per oz. ($0.64/oz.) The Amish Made brand of Bartlett Pear Halves canned fruit (in 2-32 oz. jars). DO THE MATH: In 113g are 17g (15%) carbs.

“No Sugar Added” and “100% Juice” does not mean “low-sugar”!

$2.44 per 15 oz Can (16.3 ¢/oz) Del Monte “100% Juice” Yellow Cling Sliced Peaches also has 17% carbs. The 434g in each can (124g per 1/2 cup serving * 3.5 servings/can)
$29.28 (12 pack) at Walmart = $2.44 for each 14.5 oz can of Del Monte “No Sugar Added” Sliced Peaches has 6g of carbs (when drained of juice).
$1.98 per 14.5 oz can Del Monte No Sugar Added Bartlett Pears is “immersed in artificially sweetened water”.
Costco peaches

PROTIP: Although additional sugar from the syrup has been soaked up into canned fruit, some sugar is reduced from rinsing the fruit in water through a colandar.

References:

https://www.ynhhs.org/articles/what-is-healthy-blood-sugar

Uric Acid

Normal value: 3.7 - 9.2 mg/dL

Too much leads to painful gout and damaged to kidneys.

Dash Diet

They say blood pressure is low by eating lots of whole grains, fruits, vegetables, and low-fat dairy. Look for foods that don’t have much fat or cholesterol. This approach has a name: the Dietary Approaches to Stop Hypertension (DASH) diet. It includes lean meats, poultry, fish, and nuts. It’s also high in protein and fiber and avoids sugary drinks, sweets, and red meats.

NEW: The amount of potassium is now required to be on food labels.

Maple Syrup

Producers in both Vermont and Quebec claim their’s is best. Blind taste tests: No synthetic colors No high-fructose corn syrup No artificial sweeteners No artificial flavors

NOTE: Serving sizes are “30ml” (2 teaspoons), which is way less than what we really pour.

Target’s own “Good & Gather” brand 100% Pure Maple Syrup $16.99 for 32 oz has good flavor”
Costco’s $14.99 33.8 oz jug ($0.44/oz) “Kirkland Signature Organic Pure Maple Syrup”
Packaged in the same 32oz jugs are Butternut Mountain Farm Organic Grade A Amber (from Vermont) $17.97 from Walmart ($0.562/oz) but $21.38 from Amazon (0.67/oz) $8.92 / 12 oz glass bottle ($0.74/oz) is often rated best overall store syrup for rich, balanced flavor. Has Amber Rich, Dark Robust, Organic Amber Rich, Organic Dark Robust
Anderson’s Pure Maple Syrup $5.28 for 8 ounces at Walmart – praised for being darker, thicker, and very “maple‑y” without weird aftertastes. caramel-y flavor
Runamok (Vermont) – recommended by chefs for high‑quality single‑origin syrups and interesting infused versions.
Escuminac Late Harvest Maple Syrup (Quebec Canada) – often called out as a top “luxury” syrup with strong, clean maple flavor $25.95 for 16.9 glass bottle ($1.54/oz)

Grow your own

When you grow veggies from seen, you’re assured of the lack of pesticides (because you didn’t put it there).

(But what about the dirt?)

Here are the veggies:

Rashishes are among the shorting growing time, and thus the first harvest in the Spring. If you find them bitter, see how they taste fried or roasted.
Snow peas
Potatoes
Red Bell Peppers
Bush beans
Snap peas
Beets. Its leaves takes like spinich.
Cucumbers
Catelupe
Corn
Carrots
Mushrooms
Watermelon
Stinging Nettle
Bok choy (Chinese cabbage)

Can = glass jars

https://canninglids.com/

Chocolates

Chocolates are made from fermented cocoa. Cocoa is indiginous as a spicy drink in Latin America and brought to the New World.

During the second half of the 19th century, Swiss chocolatiers created the dense, sweet chocolate that is popular today.

In the United States, chocolate manufactuers prioritize a long shelf life. So they add corn syrup and butyric acid, which gives US chocolate a slightly sour note that is often unsettling to European palates.

Chocolate recipes in the EU, for example, are more strictly regulated than in the US: Milk chocolate must contain at least 25% cocoa solids, and cocoa butter is required as the main fat.

European colonial powers deliberately introduced the cocoa plant to their tropical colonies. Cultivation and harvesting were carried out with the help of the local population — usually under inhumane conditions. Ghana is the world’s largest cocoa producer after Cote d’Ivoire. West Africa is the world’s largest producer of cocoa.

Big on-line stores

Amazon.com has a “gourmet” section. Using the Amazon Visa card gets us 5% back. PROTIP: Beware that some items are marked up by those who resell stuff from elsewhere.

If you like Whole Foods for their wokeness but hate Amazon, ThriveMarket.com carries many of the same shelf items. Note they ask for $60/year membership.

Walmart.com also has a 5% rebate when using their credit card. They actually have healthy stuff among all that junk and over-processed food, such as No salt added cans of corn and beans:

$0.98 corn from DelMonte
$0.72 corn from Libby’s
$0.98 corn from Great value (Walmart)
$5.28 per 4-pack of Del Monte No Salt Added Fresh Cut Blue Lake Cut Green Beans, 14.5 oz Can (Pack of 4)

Target, surprisingly, has great prices on many items despite their “bougy” vibe. They have a gluten free food section online.

(Cost Plus) worldmarket.com has food from around the world. Note their SMS coupons exclude discounts on food items.

Costco.com Grocery delivers free over $75, even with their membership at $60-$100/year. But, as you know, selection is limited and even more so online.

Dark chocolate with coconut (individually wrapped)
real Cylon Cinnemon
Kirkland Signature Organic Extra Virgin Olive Oil, 2 L for $13.49
Kirkland Signature Organic Pure Maple Syrup, 33.8 oz for 13.99
Kirkland Signature Organic Coconut Water, 1 Liter, 9 ct $18.39

Specialty on-line stores

goldbelly.com is the e-commerce platform for 1,000 restaurants. They now has a deal with videos on QVC.

$20 each - Roberta’s Wood Fired Pizza — Margherita (named “the best frozen pizza”)

Handshake on Spotify has salt-free rubs and USA seasonings

CucinaAndAmore.com creates the foods they sell online ($35 shipping). They invented shelf-stable Quinoa & cauliflower meal kits, tomato-free salsas, pasta, pasta sauce, pesto, artichokes, fruit jams, balsamic vinegar, wafer rolls.

ShopMove.co offers cooked meals and snacks “from Michelin chefs and celebrity bakers”. Free shipping over $35. Their $6 Lemon Rice is lemoney. I think there’s too much dough for me on ther $6 Hong Kong Pineapple Buns. Their $12 Chicken Tikka Masala has a bit of hot spice.

JustAsianFood.com has snacks from China, Japan, Thailand, etc.

Farmer brand peanuts: dried and roasted (10.58oz each)
Michelle’s Golden Sana Banana Chips 12.35oz
Regent Labzter 3.5oz chips
Dragonfly Lobster Crackers 1.76oz
Liyuan Roasted Organic Chestnuts 5.3oz
Liyuan Organic Chestnuts 8.8oz
Homei Roasted Chestnuts - Organic 3.6oz
Golden Coins Almond Tofu Agar Mix 6.2oz
Asian Best Lychee In Syrup 20oz $3.39
Companion Lychee In Heavy Syrup 20oz
Ming River Lychees In Syrup 20oz $3.39

Balduccis.com offers top brands from Europe

igourmet.com

mouth.com snacks, drinks, bacon, jerkey

foodzie.com

MarketHallFoods.com

ImportFood.com

Zingermans.com tinned fish, $200 packaged DIY ruben sandwich (too expensive)

TasteOfSpain.com sells J. Vela thick white asparagus

kayanoya.com has Japanese yuzu citrus juice and peel preserve, unique sweet and sour flavor. They also have low-sodium stock powders.

The duo of $74 olive oil bottles from Brightland are based on heirloom Arbequina and Arbosana olives harvested from a single-family farm in California’s Central Coast. no fillers or artificial preservatives. Founder Aishwarya Iyer’s ancestors were salt farmers in South India. A drizzle of “Awake” accentuates pasta, roast chicken, and crusty bread. “Alive” evokes a vibrancy in vinaigrettes, raw vegetables, and, something sweet and bitter like dark chocolate.

Fortnum and Mason is a large department store in London and throughout the UK (since 1707). They are famous for their “hampers” (baskets) containing their biscuits, preserves, candies, teas, coffees, and wines. Their $18.95 Piccadilly Biscuit tin contains butter biscuits: Stem Ginger (my all-time favorite), Salted Caramel, Macadamia Nut, Lemon Curd, Fruit & Nut Flapjack and Chocolate Pearl (a cut above your regular chocolate chip). $25 for delivery to the US.

MyFitnessPal rates 100g of Stem Ginger at 470 calories and 66g carbs (burned off by 1.2 hours of cycling or 48 minutes of running).

Waters

Good water makes for better-tasting tea, coffee, rice, etc.

Alkaline water (above neutral pH of 7) is better for you than acidic water.

NOTE: There are 33.814 fluid ounces in a liter. 25.36 fluid ounces in a pint = 750 ml. A half-liter bottle contains 16.9 fluid ounces.

Among all brands:

Glass bottles:

San Pellegrino (green bottles) are my favorite (with alkaline pH: 7.7 and high TDS: 1109 and no sodium). It has what’s described as “medium bubbly”, which is supposed to enhance taste. It’s offered at many fine (especially Italian) restaurants because it’s from the San Pellegrino Terme (baths) area in Val Brembana area in the Lombardy region in the Italian Alps, since 1932. Now available in both glass and PET plastic bottles, in a variety of flavored and unflavored varieties.

Hildon water from a chalkly aquifer in Hampshire (south of England) are what is served in the UK Parliment and in Royal household (by Royal Warrant). Each liter contains 7.7mg of sodium, Nitrate level of 6 ml per liter, and TDS of 312 in 11.1 or 25.3 fluid ounce (.75 Liter) glass “Bordeaux” bottles. Its pH is a neutral 7.2.

Plastic bottles:

Icelandic I think is best due to its naturally highest (most alkaline) pH of 8.4 from the pristine Ölfus Spring in vulcanic Iceland.

Fiji water (slightly Alkaline at pH: 7.7 with TDS: 222) was filtered through vulcanic rock. It comes only in thicker plastic bottles.

Not recommended acidic:

Voss (acidic pH: 5.5 ) still and processed sparkling waters come in heavy glass bottles (designed by the former Creative Director for Calvin Klein). Despite its name, the products are not bottled in the municipality of Voss in Norway but in the pristine wilderness of Southern Norway. Low TDS (total dissolved solids) level of 44.

Perrier sparkling Mineral Water is well-known (advertised). Unfortunately, the water from Les Bouillens is Acidic at pH: 5.5 with TDS: 475. It now comes in flavorless and fruity variants. Commonly used in cocktails and drinks, it contains total dissolved solids of 475 mg/L of water, which provides extra carbonation to create strong bubbles in mixed drinks.

Saint-Geron lightly carbonated pH: 6 (very hard/acidic) water with TDS: 1158 comes out of a spring in volcanic Auvergne, France. Dubbed “The Queen of Mineral Waters”, has been bottled since Roman days. While the water contains carbonic acid, its sparkling water is not overpowering.

from Amazon $0.31 / Fl Oz at $95.59 for pack of 12, 25.3-oz bottles.

Meats

Many wild game meats (venison, pheasant, quail, rabbit, etc.) are known to be high in purines which cause gout inflammation.

That’s also the case with organ meats (“sweetbreads”) such as liver, kidney, tongue, heart.

Salmon seems to be an exception to fish with high purine levels, in that most gout sufferers don’t have a problem with it.

Korean BBQ Bulgogi “fire meat” (rib-eye, short-rib beef, chicken, pork marinated in soy sauce) shipped in a $19.99 foam box with cold packs from Omonausa.com. Free shipping for orders over $200.
Meats from Rastelli.com and Honeybaked.com
Lamb from LavaLakeLamb.com
Scottish grouse, and other wild game meat from DArtagnan.com
Seafoods from vitalchoice.com
Iberico ham (popular in Barcelona), cheeses, and condiments from FormaggioKitchen.com
Applewood-smoked meats from Nueskes.com

Veggies

REMEMBER: Beets, okra, rhubarb, turnips contain high levels of oxalates (which increase uric acid levels that trigger gout).

Heirloom beans, herbs, spices from RanchoGordo.com
Spices and seasonings from TheSpiceHouse.com
Indian food from Kalustyans.com
Scandanavian meatballs, limpa, pickled herring from scandiaFood.com
Greek baklavas, spanakopitas, and other filo-based pastries from KatinasGreekCafe.com
Italian Proscitutto, EVOO, etc. from Eataly.com
Spanish paella, sausage, etc. from Tienda.com (Williamsburg, VA)
Fair trade from around the world at EqualExchange.com
LaQuercia.us
Freeze-dried fruits from thive.com
Fresh fruit from HarryAndDavid.com fruit-of-the-month
Fresh California peaches, plums, nectarines, cherries, graham crackers, tarlets from FrogHollow.com
Sour cream coffee cake, buttery rum cake, quiches from RedTruckBakery.com
Baked goods and many others from goldbelly.com
Jams and Salsas from Stonewalkkitchen.com
Freeze-dried ice cream and (high salt) meals from MountainHouse.com (commonly sold at Walmart and sporting goods stores)
Pies from GTPie.com of Michigan

Bread from live yeast

DEFINITIONS: pleasanthillgrain.com/baking-glossary

If you regularly consume bread, consider growing live yeast from wheat for sourdough bread.

Both yeast and baking powder will cause your bread dough to rise. But both yeast and baking powder have relatively short shelf lives.

Proofing Directions: In a 1 cup liquid measuring cup, mix 1 teaspoon sugar into 1/2 cup of warm water (110° to 115° F), then mix in 2-1/4 teaspoons yeast. If mixture has risen to the top of the cup by the end of ten minutes, yeast is very active. If not, it needs to be replaced.

Make your own baking powder by mixing together ingredients with an indefinite shelf life if properly stored.

1 part baking soda.
1 part corn starch.
2 parts cream of tartar.

Grounded “white flour” bought from stores consists only of the starchy endosperm of the wheat kernel – the least nutrient-rich part of the grain. Removed are the nutrient-packed bran, wheat germ, and wheat germ oil to ensure shelf life. Buy unbleached for healthy.

Freshly ground wheat is tastier.

But ground wheat needs to be sifted.

To make your own “whole grain cake flour”, measure 1 cup of finely ground soft wheat flour then substituting 2 tablespoons of that flour with 2 tablespoons of cornstarch or tapioca starch.

Malted barley and Vitamin C are added into flour to aid in bread rising and gluten development. Bread flour has a protein content of at least 12.5%—the higher the percent, the stronger the dough rise. This is a good flour to mix with other grain flours to produce a more lightweight product.

For cakes, cookies, and donuts prepared from batters, including biscuits, cakes and whole grain pastries, use soft white wheat berries ground to ultra-fine texture. Soft wheat (triticum aestivum) has high starch/carbohydrate content and a protein content of 7-9%, while hard wheat typically has a protein content of 10-15%. Consequently there’s little gluten development in soft wheat flour.

Soft wheat is typically a winter wheat – planted in the autumn, grows a few inches tall before it’s covered with snowfall through the winter, and lies dormant until the ground warms up in early spring. In the early spring the wheat resumes growth until it’s ready to be harvested.

In the U.S., soft wheat is mainly grown east of the Mississippi, although some is grown in the Pacific Northwest.

For dough-bread making, use hard red or hard white wheat berries. Aloso add spelt, kamut, or rye.

teff combine well with wheat flour though and has something of a sweetish flavor. It’s the smallest grain, with kernels only about 1/32nd inch in diameter. The name means “lost” because if dropped on the ground, it’s too small to recover. It’s been been a staple in Ethiopia for nearly five millennia in making Ethiopian flat bread “injera”. Small amounts are now grown in South Africa and the United States. This grain ranges in color from white to reddish brown as a source of iron. Its protein content in the 10-12% range, good calcium but has no gluten content.
Khorasan,
Einkorn,
emmer

Some specialty bread types call for semolina flour. May also be known as “alimentary flour”, “macaroni flour”, or “pasta flour.” Farina, a coarse meal used as a breakfast cereal, is made from Durum wheat, used for making pastas, noodles, and couscous.

oxidation begins to occur as soon as grain is ground, exposing the cell’s contents to oxygen in the air.

PROTIP: Wheat Berries store longer (30 years) than flour ground by a wheat grinder which use a stone burr mill, impact mill, or steel burr mill.

From https://pleasanthillgrain.com/search?search=wheat+berries (Nebraska, (866) 467-6123 ) buy Golden 86 or White Wheat in a Mylar bag with O2 absorbers within a six-gallon pail. A $35 x3 Gamma Seal Lid has a polymer gasket, giving the container an air-tight seal that excludes not only freeloaders such as mice and insects, but moisture too.

The 41 lbs net yields about 72,000 calories.

$150.12 ($3.66/lb) from Zone 2 (CT, FL, ME, MA, NH, RI, VT)
$150.12 ($3.53/lb) from Zone 1 (from other states)

Quinoa

Quinoa, pronounced “keen-wah”, is a gluten-free, pseudo-cereal seed native to the Andes Mountains of South America. $210.79 for 36 lbs ($5.90/lb) in 6-gallon tub.

Quinoa is often referred to as a supergrain because it is high in protein – a complete protein possessing all the essential amino acids in the balanced amounts that our bodies require.

Most recipes call for white quinoa, but red quinoa can be swapped in for a nuttier flavor and more texture, if preferred (note that it can take longer to cook). Black quinoa is crunchier and can have a gritty feel, so it’s best to used when a recipe specifically calls for it as it’s not a good substitute for red or white quinoa.

Unless prewashed quinoa is purchaed, quinoa needs to be thoroughly washed before cooking to remove its bitter protective coating, called saponin.

Toast the quinoa before simmering it to further emphasize its nutty flavor.

Simple Quinoa Pilaf Ingredients:

3 tablespoons extra-virgin olive oil
1¼ cups white quinoa, rinsed
¼ teaspoon table salt
2 cups chicken broth instead of water to add extra savoriness and flavor.
1 stalk celery, finely chopped
2 carrots, sliced
1 small onion, minced
1 clove garlic, minced

Heat oil in large saucepan over medium-high heat until shimmering.
Stir in vegetables and garlic.
Cook and stir until onion has softened and turned translucent, about 5 minutes.
Stir in broth add quinoa.
To add earthiness, golden color, and bright acidity:
- ¼ teaspoon dried basil
- 1 teaspoon ground turmeric
Cover and reduce heat to low. Simmer until quinoa is tender, 15 to 18 minutes. The quinoa is done when it turns completely translucent besides a small opaque dot in the center and their little curlicue tails unfurls.
Remove saucepan from heat and let sit, covered, for 5 minutes.
Stir in
- 1 teaspoon lime juice
Fluff quinoa with fork. Season with salt to taste, and serve.

Butter

Among canned butter:

From New Zealand, the Red Feather brand, which claims eighteen months of shelf-stable storage, is
$0.79/oz for 6x12-oz cans from Walmart Although salted, it’s not as heavily salted as most salted butter in the U.S.

H.J. Wijsman & Zonen Preserved Dutch Butter is
$1.42/oz from $49.99 for 5x7.05oz cans.

Beurdell French Salted Real Canned Butter 100% Natural Pasteurized Butter A real butter from France 3% salt
$229.99 ($26.14/oz) for pack of 24 8.8oz/250g cans.

Caffeine

400 mg of caffeine.

Drinks which have no caffeine include: 7-Up, Fanta, Fresca, Orange Crush, Sprite, Tonic Water, Verners Ginger Ale, and Root Beer from A&W, IBC, Diet Barq, Mug.

Resources

https://farmstress.us for Farmers and ranchers, to cultivate rural resilience.

Articles

https://www.mofad.org/events/2020/0820/chopsueysupperclub

http://www.oprah.com/food/the-best-online-grocery-shopping-websites/all 2010

https://www.bonappetit.com/story/online-specialty-food-stores

https://www.thespruceeats.com/gourmet-specialty-food-shops-1666059

http://www.tullabs.com/cicadaworld/cicadarecipes.pdf Recipies for Cicadas InsertSpaces

Rodent-resistant containers

Rodents spread bacteria harmful to humans and pets.

Food needs to be kept in rodant-resistant containers such as metal, glass, or thick plastic.

To repel rodants, some use a device that emits a noise humans can’t hear. But they might annoy dogs and cats.

Some place around their home packets of plant-based essential oils containing cornmint, citronella, and linseed oil. Each Vamoose pouch is $9.43 (in packs of 3) from https://www.bugmd.com/. They last 30 days.

_{25-12-20 v018 Purines :2020-08-13-food.md created 2020-08-13}

Sodium 2000 low red meat (including pork) 2oz serving (the size of a deck of playing cards). 48-64 oz (a gallon) of non-caffinated fluid/day. quinoa has fiber & protein eichorn ancient (non-GMO) wheat berries more fiber & B vites. breaks down better. but more potassium. Renal Diet Cookbook. Preserving Kidney Function with plant-based eating. (Vegitarian Diet) each carbs with protein Boiling apples and drinking the juice reduces the amount of minerals. https://www.youtube.com/watch?v=Bs9MwpXRxTg nvidia

Food (Diet) was originally published by Wilson Mar at Index on December 20, 2025.

MLflow

2025-12-18T00:00:00+00:00

Get full visibility and versioning of models, their metadata, and compare metrics from runs.

Overview

Why MLflow? Run Metadata and Metrics
Competition to MLflow
MLflow Components
End-to-end capabilities Flowchart
Two sided product
Docker Compose
Manual Install locally
- Vulnerability Scans
Download and Start Server
- Start MLflow
IDE
Custom MLflow Extensions
GitHub repos
Python Libraries
Scoring Guidelines in Python
MLflow activation in Python
MLFlow workflows
Aliases
- Metrics for each experiment:
- Metrics Classification Report
Compare metrics from selected experiments
Dagshub
References:

Why MLflow? Run Metadata and Metrics

Machine Learning (ML) engineers not using MLflow need to track their run metadata perhaps using a spreadsheet such as this:

Metadata about runs include: Run ID, Run Start/End time, User, Model type, Parameters, Dataset version, etc.

Run metrics include: F Score, Precision, Recall, Accuracy.

The above doesn’t provide versioning and is a clumsy way to share data.

MLflow provides a GUI to share and visualize data many different ways.

Competition to MLflow

Kubeflow is run within Kubernetes.

NVIDIA’s reinforcement learning environments (NeMo Gym and NeMo RL) run with https://lmstudio.ai to run LLMs privately (like Hugging Face).

LangSmith:

Debugging
Playground
Prompt Management
Annotation
Testing
Monitoring

Airflow focuses on using a DAG (Directed Asysclic Graph, like GitHub uses) to version data changes.

MLflow Components

MLflow provides “Enterprise worthy” features in each of its “pluggable” components:

The menu that appears lists the data artifacts MLflow works with:

Experiments are run based on input prompts (referencing tags)
Models are artifacts (e.g. a pickled scikit-learn model)
Prompts are store in a backend SQL store

Architecture:

Backend SQL Store to store metadata about runs, models, traces, and experiments
(Binary object file) Artifact store
Tracking UI Server

Backend SQL Store

Run metrics (such as model parameters, tags, and metadata from experiments (logs, traces, metrics) are streamed into a Backend Store. This is typically a relational (SQL) database.

“managed cloud services” from cloud vendors provide enterprises the fine-grained user and network access controls they need.

Databricks
AWS Sagemaker
Azure Machine Learning
GCP (GKE)
Nebius

MLflow software managing the MLflow Backend Store makes use of SQLAlchemy Engine library</a> which implements OS environment variables controlling SQLAlchemy’s QuePool connection pooling options referenced to manage a pool of long running database connections in memory for efficient re-use:

OS System Environment Variable	SQLAlchemy QueuePool option	Default
MLFLOW_SQLALCHEMYSTORE_POOL_SIZE	pool_size	5
MLFLOW_SQLALCHEMYSTORE_MAX_OVERFLOW	max_overflow	10
MLFLOW_SQLALCHEMYSTORE_POOL_RECYCLE	pool_recycle	True

These setting can be instantiated with the sqlachemy engine:

engine = create_engine(
    config.SQLALCHEMY_DATABASE_URI, pool_pre_ping=True, pool_size=32, max_overflow=64
)

“pool size” is the total number of concurrent DBAPI connections an application may use simultaneously.

BLOG: CAUTION: Default values mean that a timout occurs when more than 15 connections are opened at the same time (with 5 of them staying idle when not in use, and 10 of them being discarded when released).

PROTIP: Ongoing monitoring of resource usage (such as slowlog) is needed for algorithms (such as gunicorn) to recognize when settings need to be reconfigured to adequately handle actual average and peak loads.

A connection pool shared among several modern (WSGI) web servers (which use multiple threads and/or processes for better performance) need subtle but fundamental configurations that can lead to very bad and difficult to diagnose production errors:

WSGI servers are created before the worker processes are forked.
Several processes will use the same connection concurrently, and the reponses could get mixed up.
One process will close the connection, and the other will try to use it, leading to an exception raised.

Enterprise MLflow on Databricks UnityDB

For example, when MLflow runs on a Databricks’ “Unity” database in the cloud, Databricks’ “Lakehouse” architecture holds multiple versions of the same data to enable “fall back” to the state of the whole database at previous points in time.

https://www.mlflow.org/docs/latest/self-hosting/architecture/overview/

One can start with a single host mode with SQLite backend and local file system for storing artifacts. To scale up, you can switch backend store to PostgreSQL cluster and point artifact store to cloud storage such as S3, GCS, or Azure Blob Storage.

MLflow Artifact store

https://mlflow.org/docs/latest/self-hosting/architecture/artifact-store

MLflow objects (binary-format files) containing model weights, container images (.png files), etc. are housed in an Artifact Store.

The legacy default was storing those artifacts in a local folder path specified one of two ways: * MLFLOW_TRACKING_URI=”./mlruns” is set in CLI or * --backend-store-uri ./mlruns in CLI parameters when starting the server.

Path: mlflow-artifacts:/…

For Logistic Regression:

MLmodel (Parquet file)
conda.yaml (if you’re using Conda environment)
model.pkl (“pikle” files containing Scikit-learn model data)
python_env.yaml
requirements.txt

Software such as min.io AIStor (Object store) located by the value of MLFLOW_S3_ENDPOINT_URL) manages artifacts as file storage types:

* NFS (Network File System) such as mount point <tt>/mnt/nfs</tt>
* Amazon S3 at MLFLOW_S3_ENDPOINT_URL
* Azure Blob Storage,
* Google Cloud Storage,
* SFTP server, 
<br /><br />

A separate Bash CLI script needs to be secured to contain secret keys defined such as this OS system variable to use stronger KMS keys (which cost more) on AWS S3:

export MLFLOW_S3_UPLOAD_EXTRA_ARGS=’{“ServerSideEncryption”: “aws:kms”, “SSEKMSKeyId”: “1234…”}’

Tracking UI Server

Tracking Server is the lightweight FastAPI server that serves the MLflow UI and API.

Click “Open Source” under “Model Training” at:

https://www.mlflow.org/docs/latest/ml/

(Classic/Traditional Machine Learning) Model Training which create LLMs. MLflow helps with management of tuning hyperperameters and analyzing result metrics from various experiments during the whole lifecycle of machine learning projects.
- https://docs.databricks.com/aws/en/mlflow/
- https://docs.databricks.com/aws/en/getting-started/free-edition
- VIDEO: Databricks’ MLflow 3 product managers Eric Peter and Corey Zumar Nov 7, 2025.

End-to-end capabilities Flowchart

TODO: Text

Two sided product

Our question about MLFlow’s “Open Source” editions: can it be used by cheap students to evaluate my own AI prompts. Examples here run on the default SQLite database setup on my macOS laptop or self-host on servers.

In an internet browser, visit where MLflow is open-sourced:

https://github.com/mlflow/mlflow

“The open source developer platform to build AI agents and models with confidence. Enhance your AI applications with end-to-end tracking, observability, and evaluations, all in one integrated platform.”

“MLflow is the only platform that provides a unified solution for all your AI/ML needs, including LLMs, Agents, Deep Learning, and traditional machine learning.”
Visit the MLflow marketing website:

https://www.mlflow.org

Notice there are two sides to the MLflow product:

A. Classic/Traditional Machine Learning Model Training runs which create LLMs used to respond to prompts.

B. New GenAI Apps & Agents to evaluate and optimize AI applications and agentic workflows of prompts which use LLMs to plan actions and call APIs.

Either way, MLflow’s “end-to-end” capabilities led to make it the most popular framework enterprises use for “industrial scale” operation and governance in the lifecycle of LLM creation and usage (from dev to production use).
Visit MLflow’s Docs website:

https://www.mlflow.org/docs/latest/index.html

Notice that to each side there is an “Open Source” option and “MLflow on Databricks” option.

Docker Compose

All components can be setup using a single docker compose CLI command which instantiates 3 docker containers:

A. MLflow
B. MinIO artifact (object) server (port 9000)
C. MySQL backend on port 5000

TODO:

based on https://github.com/sachua/mlflow-docker-compose

Manual Install locally

PROTIP: Using uv rather than pip:

Python
```
python --version
```
Ensure you have the latest uv utilities installed, including the global uv configuration directory ~/.config/uv/ and uv.toml file:
```
uv config --show
uv --version
```
```
uv 0.9.13 (Homebrew 2025-11-26)
```
PROTIP: Create a folder to receive files, populate with .git folder, .gitignore, pyproject.toml, README.md, .python-version
```
uv init mlflow1
cd mlflow1
```
PROTIP: To install MLflow as a CLI tool (instead of using pip):
```
pipx install mlflow
mlflow --version
```
```
mlflow, version 3.7.0
```
Databricks reports 5,000 users.
NOTE: MLflow describes its releases at: https://github.com/mlflow/mlflow/releases

Vulnerability Scans

PROTIP: Scan for vulnerabilities:

pipx runpip mlflow list --format=freeze | safety scan --stdin

Research CVEs found, such as:

The safety scan found 8 HIGH severity vulnerabilities (CVSS 8.8) in MLflow 3.7.0, all related to deserialization issues in various ML model formats:

•  CVE-2024-37057: TensorFlow models
•  CVE-2024-37055: pmdarima models  
•  CVE-2024-37053 & CVE-2024-37052: scikit-learn models
•  CVE-2024-37054: PyFunc models
•  CVE-2024-37056: LightGBM scikit-learn models
•  CVE-2024-37059: PyTorch models
•  CVE-2024-37060: Recipes

No known fixes are available yet for these vulnerabilities. These are deserialization vulnerabilities that could potentially allow arbitrary code execution when loading untrusted model files. If you're working with models from untrusted sources, exercise caution until patches are released.

CAUTION: Raise security issues securely. Instead of detailing specifics about security issues in public, follow the procedure in their SECURITY.md (email).

Download and Start Server

Download modules for server:

mlflow ui

Without configuration means these warning message appear:

Backend store URI not provided. Using sqlite:///mlflow.db
Registry store URI not provided. Using backend store URI.

Look for:

INFO:     Uvicorn running on http://127.0.0.1:5000 (Press CTRL+C to quit)
...
INFO:     Application startup complete.

Start MLflow

Optionally: Open another CLI Terminal window and:
```
mlflow server --port 5000
```
Open your default browser:
```
open http://127.0.0.1:5000
```
IDE
- VSCode vs. PyCharm vs.
- AI browsers Comet, etc.
Custom MLflow Extensions

To extend MLflow’s core with new flavors, UI tabs, or artifact stores, build custom functionality, see Write & Use MLflow Plugins. It shows how to package your plugin, register it, and test it locally before pushing to production.

in Python, Java, R, CLI, and REST API Example

GitHub repos

Spam Classification, Time Series Analysis, Text Classification using Random Forest, Deep Learning

MLproject file

https://github.com/mlflow/mlflow-example/blob/master/MLproject
```
name: tutorial
conda_env: conda.yaml
entry_points:
main:
    parameters:
    alpha: {type: float, default: 0.5}
    l1_ratio: {type: float, default: 0.1}
    command: "python train.py {alpha} {l1_ratio}"
```
MLflow’s Sample Python code

https://github.com/mlflow/mlflow-example wine quality. Uses Conda.

Sample_ML_model.py

https://github.com/c17hawke/mlflow-introduction/blob/main/mlflow-codebase/simple-ML-model/simple_ML_model.py

Azure Sample GenAI Python code

https://github.com/Azure-Samples/azure-databricks-mlops-mlflow Azure Databricks MLOps sample for Python based source code using MLflow without using MLflow Project.

Python Libraries
Python –version
mlflow, etc. in requirements.txt
Although the Conda library is not secure for having too many modules that can go rogue, create and activate the conda environment:
```
conda create --prefix ./env python=3.12 -y
conda actiavate ./env
```

Although not scalable, install pandas for dataframe handling:

Scoring Guidelines in Python

import mlflow
from mlflow.genai.scores import Guidelines
custom_guidelines = [{
    "name" : "accuracy",
    "guideline": """The response correctly references ...
    ...
    "name" : "personalized",
    ...
    ]
custom_scorers = [{
    Guidelines(name=g["name"], guidelines=g["guideline"])
    for g in custom_guidelines  # above.

MLflow activation in Python

Add these lines of Python code to activate MLflow instrumentation:
```
 from openai import OpenAI
 mlflow.openai.autolog()
```
MLFlow workflows
1. Log traces
2. Train models
3. Run evaluation
4. Register prompts
Aliases

Aliases can be associated with specific runs, such as “@Challenger”.

Metrics for each experiment:

recall_class_0 ???

recall_class_1 ???

Metrics Classification Report

A sample print(classifaction_report(y_test, y_pred_xgb) after an experiment run yields:

Adapted from https://scikit-learn.org/stable/modules/generated/sklearn.metrics.classification_report.html#sklearn.metrics.classification_report

Among Per-Class Metrics:

Precision: Of all instances the model predicted as a given class, what percentage were actually that class? Intuitively, precision is the ability of the classifier not to label as positive a sample that is negative.
- Class 0: Precision 0.98 means that when the model predicts 0, it is correct 98% of the time.
- Class 1: 81% of predicted 1s were correct
Recall: Of all actual instances of a given class, what percentage did the model correctly identify? Recall is the ability of the classifier to find all the positive samples.
- Class 0: Recall 0.98 means it finds 98% of all true 0’s.
- Class 1: 83% of actual 1s were found
F1-score: The weighted harmonic mean of precision and recall, balancing both metrics:
- Class 0: 0.98 (excellent)
- Class 1: 0.82 (good)
Support: The count of actual instances of each class in the dataset:
- Class 0: 270 instances (90% of data)
- Class 1: 30 instances (10% of data)
The model performs better on class 0 than class 1, which is common when there’s class imbalance (270 vs 30 samples). The weighted average of 0.96 is closer to class 0’s performance because that class dominates the dataset.

Among Aggregate Metrics near the bottom:

Accuracy: Overall correctness across all predictions = F1 score of 96%

Macro avg: Simple average of metrics across classes (treats each class equally).

Doesn’t account for class imbalance

Weighted avg: Average weighted by support (accounts for class imbalance).

More representative of overall performance given the 270:30 class distribution.

Compare metrics from selected experiments

Dagshub

https://github.com/code/mlflow_dagshub_demo

References:

[1] VIDEO by codebasics.io who offers a class.

https://mlflow.github.io/mlflow-website/blog/deep-learning-part-2/ Deep Learning with MLflow (Part 2) uses dataset https://huggingface.co/datasets/coastalcph/lex_glue/viewer/unfair_tos

https://medium.com/@mohsenim/tracking-machine-learning-experiments-with-mlflow-and-dockerizing-trained-models-germany-car-price-e539303b6f97 Tracking Machine Learning Experiments with MLflow and Dockerizing Trained Models: Germany Car Price Prediction Case Study

https://aws.amazon.com/blogs/machine-learning/securing-mlflow-in-aws-fine-grained-access-control-with-aws-native-services/

https://mlflow.org/docs/latest/ml/tracking/tutorials/remote-server Remote Experiment Tracking with MLflow Tracking Server

https://viso.ai/deep-learning/mlflow-machine-learning-experimentation/ MLflow: Simplifying Machine Learning Experimentation

https://arxiv.org/pdf/2202.10169 MACHINE LEARNING OPERATIONS: A SURVEY ON MLOPS TOOL SUPPORT by Nipuni Hewage and Dulani Meedeniya

https://learning.oreilly.com/library/view/-/9781098179625/”>BOOK: “Data Governance with Unity Catalog on Databricks” September 2025</a> By Kiran Sreekumar and Karthik Subbarao

https://www.linkedin.com/in/jun-shan-8332221/”> Jun Shan

_{25-12-18 v014 + SQLAlchemy :2025-01-16-mlflow.md created 2025-01-16}

MLflow was originally published by Wilson Mar at Index on December 18, 2025.

AI Benchmarks

2025-12-16T00:00:00+00:00

Let’s get to know the benchmarks AI companies use to compare each others’ versions.

Overview

In AI Computer Science, a benchmark is a way to determine how well each LLM model can solve problems. Several benchmarks have been created, mostly by academics and giant frountier LLM producers.

AI Vendors and their LLM Brands

Country	Vendor	LLM brand	app
China	Alibaba	Qwen
US	Allen AI	Olmo
US	Amazon	Nova
US	Anthropic	Claude
US	Apple	MM1, ReALM
China	DeepSeek	R1,R2,V3
US	Fireworks.ai	KwaiKAT-Coder
US	Google	Gemini
China	Zhipu (Z.Ai)	Kimi K2
US	Meta	Llama
US	Microsoft	Phi
Singapore	MiniMax	M2, Hailuo, Speech
France	Mistral	Medium, Large
US	NVIDIA	Nemotron
US	OpenAI	GPT	ChatGPT
US	xAI	Grok

LLM Highlights:

Nathan Lambert’s 2025 tier list shows Chinese labs (DeepSeek, Qwen, Kimi) now define the frontier. Their list:

Frontier: DeepSeek, Qwen, Moonshot AI (Kimi)
Close competitors: Zhipu (Z.Ai), Minimax
Noteworthy: StepFun, InclusionAI / Ant Ling, Meituan Longcat, Tencent, IBM, NVIDIA, Google, Mistral
Specialists: OpenAI, Ai2, Moondream, Arcee, RedNote, HuggingFace, LiquidAI, Microsoft, Xiaomi, Mohamed bin Zayed University of Artificial Intelligence
On the rise: ByteDance Seed, Apertus, OpenBMB, Motif, Baidu, Marin Community, InternLM, OpenGVLab, ServiceNow, Skywork
Honorable mentions: TNG Group, Meta, Cohere, Beijing Academy of Artificial Intelligence, Multimodal Art Projection, Huawei

No US company currently appears in their top tier. But NVIDIA’s response is to compete on efficiency and openness. NVIDIA’s Nemotron 3 claims to be the Intelligence vs. Output Speed king:

OpenRouter

KAT-Coder-Pro V1 from Fireworks.ai was ranked 2nd on HLE and the lowest token usage. What a bargain! It’s for coding and “agentic” work. Founded by leads from Meta PyTorch & Google Vertex at San Mateo.
Anthropic’s Claude
Microsoft’s Phi-1 (1.3B parameters) LLM is focused on Python coding. Microsoft’s focus is on edge devices.

List of benchmarks

https://betterbench.stanford.edu is a repository of AI benchmark assessments for informed benchmark selection through quality evaluation and best practice analysis.

Huggingface.co is the internet’s repository of LLMs. For example:

https://huggingface.co/datasets/cais/hle/viewer/default/test?p=24&views%5B%5D=test

VIDEO: Huggingface accelerate library to run

The biggest one is “Humanity’s Last Exam”,

Show your work. Get famous.

PROTIP: Look through the problems from a category (below) you might be able to solve. Explain how you solved each problem in text and video. Really solving just one problem provides proof of your academic capabilities and grit. It shows you’re not lazy enough to blindly let AI rot your brain. And it others notice you can defend against false charges of plagerism.

Making YouTube videos may get you some money. And if you find issues with a problem’s autograder, even better. File an issue on the benchmark problem GitHub repo.

PROTIP: Suggest new problems. File a PR and get listed as a contributor.

BTW I’m working on a website to encourage such evaluations and contributions, by giving out rewards and recognition (including cash). Let me know if you’re interested.

A concern about AI benchmarks is data contamination, where test questions leak into training data, enabling models to “memorize” answers instead of reasoning that connect concepts rather than just recalling facts. Thus, the Massive Multitask Language Understanding (MMLU) benchmark that evaluates language understanding is enhanced by MMLU-Pro with broader and more challenging tasks. Its Leaderboard now exceeds 90% over its 12,000 rigorously curated questions from academic exams and textbooks, spanning 14 diverse domains including Biology, Business, Chemistry, Computer Science, Economics, Engineering, Health, History, Law, Math, Philosophy, Physics, Psychology, and Others.

To raise the difficulty and reduce the chance of success through random guessing, ten answer options are given.

LLMs by subject category

Language:

HELLASWAG (Harder Endings Longer context Low-shot Activities Situations With Adversarial Generations) to finish sentences
MMLU (Massive Multitask Language Understanding) 15K questions
Creative Writing
TRUTHFULQA to test whether the LLM recognises 800 unhinged conspiracy theories as false

General safety:

IFEval (Instruction Following)
Instruction Following
HarmBench of prompts to jail-break out of content moderation controls by LLMs
Mind2Web and AITW benchmark of GUI screen object recognition to evaluate OMNIPARSER vs GPT-4V

Reasoning:

ARC (AI2 Reasoning Challenge) from the Allen Institute for AI
ARC is “Abstraction and Reasoning Corpus”. The best models solves 30% of the tasks.

Science:

MT-bench as a judge of 160 questions in 8 categories of knowledge
Science (GPQA Diamond) of 198 questions

Composite:

Humanity’s Last Exam (Math, Physics, Computer Science, Biology/Medicine, Chemistry, Engineering, Humanities/Social Science, Other) 2500 of the most difficult closed-end questions submitted by volunteers from universities around the world.

Math benchmarks:

AGIEval 5m58s - ARVIX: Available in English (AGIEval-en) and Chinese Gaokao (AGIEval-zh), a bilingual benchmark designed to use 20 official, public, and high-standard admission and qualification exams taken by humans around tasks relevant to human cognition and problem-solving. law school admission (LSAT) tests, math competitions.
MMMU (Massive Multitask Math Understanding) Visual Reasoning
GSM8K (Grade School Math 8K) word problems which take 2-8 steps to solve, from OpenAI
Math 500 Math Problem Solving
Math (AIME) Math competition

Coding/Programming:

WINOGRADE 44K
Coding LCB (Live Code Bench)
SWE-Bench (Agentic SoftWare Engineering)
- SWE-bench Lite - curated to make evaluation less costly and more accessible
- SWE-bench Multimodal featuring issues with visual elements (images, videos) from JavaScript repositories
- SWE-bench Verified - a human annotator filtered subset that has been deemed to have a ceiling of 100% resolution rate
TAU-Bench (Task Analysis Unit) to test agentic tool use
humaneval, humaneval+ and taco to cover the current programming benchmarks.

Humanity’s Last Exam

https://huggingface.co/datasets/cais/hle

The data folder (in parquet format) can be downloaded from: https://huggingface.co/datasets/cais/hle/tree/main

Create an account at https://agi.safe.ai/ and click “Contributors” to see submissions in the fields of Math, Physics, Computer Science, Biology/Medicine, Chemistry, Engineering, Humanities/Social Science

AGI & ASI?

VIDEO: In June 2024, Leopold Aschenbrenner wrote his situational-awareness.ai blog with this illustration:

Click image to enlarge to full frame.

By 2025, AI companies have sucked up all the information that have been created by humans. The next thing is generation of new information. New problems need to be defined because, in 2025, evaluations about the extent that a particular offering has reached AGI (Artificial General Intelligence) based on a relatively small number of challenges.

ASI (Artificial Super Intelligence) will be reached when “proto-automated” researchers automate research (within massive AI datacenters).

AGIEval

Introduced 16 Dec 2023 on ARVIX (by Ruixiang Cui while working at Microsoft and during his PhD at the University of Copenhage) as “A Human-Centric Benchmark for Evaluating Foundation Models” for AGI (Artificial General Intelligence) development.

5m58s -

AGIEVal is called “human-centric” because its prompts are based on 20 exams: official, public, and high-standard admission and qualification exams taken by humans: SAT, law school admission (LSAT) tests, math competitions.

As of March 2025, the v1.1 version of the leaderboard for AGIEval shows:

A top score in the low 70% by GPT-4o means a low “pass” for humans?
Providing examples (Few Shot and Few Shot-COT) improved accuracy by 3.1 points (AGIEval-en).
The newer GPT-4o with reasoning capabilities improved accuracy over GPT-3.5 by an average of 1.2 points (AGIEval-en).
Because AGIEval is uniquely bilingual, it provides insight on the “arms race” toward AGI development between the US and China. With Few-shot GPT-4o, the achievement of 71.9% puts the Chinese (AGIEval-zh) slightly ahead of the 71.4% (AGIEval-en) for English.

An example is https://github.com/ruixiangcui/AGIEval JSONL (JSON Lines) is a lightweight, text-based data format designed for storing structured data records, where each line in the file represents a valid JSON object. This format is particularly useful for handling large datasets efficiently, as it allows for line-by-line processing without requiring the entire file to be loaded into memory.

Shown below: https://github.com/ruixiangcui/AGIEval/blob/main/data/v1_1/math.jsonl

{"passage": null, "question": "Let $\\lambda$ be a constant, $0 \\le \\lambda \\le 4,$ and let $f : [0,1] \\to [0,1]$ be defined by\n\\[f(x) = \\lambda x(1 - x).\\]Find the values of $\\lambda,$ $0 \\le \\lambda \\le 4,$ for which there exists an $x \\in [0,1]$ such that $f(x) \\neq x$ but $f(f(x)) = x.$", "options": null, "label": null, "answer": "(3,4]", "other": {"solution": "We have that\n\\[f(f(x)) = f(\\lambda x(1 - x)) = \\lambda \\cdot \\lambda x(1 - x) (1 - \\lambda x(1 - x)),\\]so we want to solve $\\lambda \\cdot \\lambda x(1 - x) (1 - \\lambda x(1 - x)) = x.$\n\nNote that if $f(x) = x,$ then $f(f(x)) = f(x) = x,$ so any roots of $\\lambda x(1 - x) = x$ will also be roots of $\\lambda \\cdot \\lambda x(1 - x) (1 - \\lambda x(1 - x)) = x.$  Thus, we should expect $\\lambda x(1 - x) - x$ to be a factor of $\\lambda \\cdot \\lambda x(1 - x) (1 - \\lambda x(1 - x)) - x.$  Indeed,\n\\[\\lambda \\cdot \\lambda x(1 - x) (1 - \\lambda x(1 - x)) - x = (\\lambda x(1 - x) - x)(\\lambda^2 x^2 - (\\lambda^2 + \\lambda) x + \\lambda + 1).\\]The discriminant of $\\lambda^2 x^2 - (\\lambda^2 + \\lambda) x + \\lambda + 1$ is\n\\[(\\lambda^2 + \\lambda)^2 - 4 \\lambda^2 (\\lambda + 1) = \\lambda^4 - 2 \\lambda^3 - 3 \\lambda^2 = \\lambda^2 (\\lambda + 1)(\\lambda - 3).\\]This is nonnegative when $\\lambda = 0$ or $3 \\le \\lambda \\le 4.$\n\nIf $\\lambda = 0,$ then $f(x) = 0$ for all $x \\in [0,1].$\n\nIf $\\lambda = 3,$ then the equation $f(f(x)) = x$ becomes\n\\[(3x(1 - x) - x)(9x^2 - 12x + 4) = 0.\\]The roots of $9x^2 - 12x + 4 = 0$ are both $\\frac{2}{3},$ which satisfy $f(x) = x.$\n\nOn the other hand, for $\\lambda > 3,$ the roots of $\\lambda x(1 - x) = x$ are $x = 0$ and $x = \\frac{\\lambda - 1}{\\lambda}.$  Clearly $x = 0$ is not a root of $\\lambda^2 x^2 - (\\lambda^2 + \\lambda) x + \\lambda + 1 = 0.$  Also, if $x = \\frac{\\lambda - 1}{\\lambda},$ then\n\\[\\lambda^2 x^2 - (\\lambda^2 + \\lambda) x + \\lambda + 1 = \\lambda^2 \\left( \\frac{\\lambda - 1}{\\lambda} \\right)^2 - (\\lambda^2 + \\lambda) \\cdot \\frac{\\lambda - 1}{\\lambda} + \\lambda + 1 = 3 - \\lambda \\neq 0.\\]Furthermore, the product of the roots is $\\frac{\\lambda + 1}{\\lambda^2},$ which is positive, so either both roots are positive or both roots are negative.  Since the sum of the roots is $\\frac{\\lambda^2 + \\lambda}{\\lambda^2} > 0,$ both roots are positive.  Also,\n\\[\\frac{\\lambda^2 + \\lambda}{\\lambda} = 1 + \\frac{1}{\\lambda} < \\frac{4}{3},\\]so at least one root must be less than 1.\n\nTherefore, the set of $\\lambda$ that satisfy the given condition is $\\lambda \\in \\boxed{(3,4]}.$", "level": 5, "type": "Intermediate Algebra"}}

TODO: Utility to display jsonl files for human consumption.

Upload a .json file and download it as .jsonl using online converters Code Beautify and Konbert.com

Sneaky Tricks with Benchmarks

When xAI unveiled its Grok-3 LLM on Feb 18, 2025, one analysis shows it ranking #1 across the various benchmarks (including Creative Writing, Instruction Following, etc.):

This table compares specific scores on specific benchmarks:

That resulted in some crying that xAI neglected to include in the comparison results of OpenAI’s o3 December results:

Claude 3.7 Sonnet

The above is from Anthropic’s Claude 3.7 Sonnet announcement on Feb 25, 2025. Dubbed the first hybrid AI reasoning model, it is a groundbreaking AI model because it allows users to control how long it “thinks” before responding to deliver real-time answers or take extra time to provide more complex, well-reasoned responses. It’s available to premium Claude users. Pricing: $3 per million input tokens and $15 per million output tokens—higher than OpenAI’s o3-mini.

Anthropic is also launching Claude Code, a tool that lets developers run AI-driven code edits directly from their terminal, analyze projects, and even push changes to GitHub.

Math Benchmarks

There are several mathematics competitions: AIME, HMMT, Mandelbrot, ARML.

Additionally, each US state:

MCTM (Montana Council of Teachers of Mathematics)

Math notations

VIDEO: Answers of specific (discrete) values can be represented between commas within curly braces (keyed by Shift + [ and Shift + ]) in “Roster Notation (aka Roster Form)” such as this to enumerate (list) a set of elements. VIDEO:

Within curly braces { } is a “set,” i.e., a collection of elements without order or repetition rules. Commas separate elements within the set.

A = {1, 2, 3, 4,…,999}

On Macs, to open the Character Viewer, press Control + Command + Space to type in a search term:

ℕ means Natural numbers (positive integers)
2ℤ means even integers (positive or negative integers)
ℚ means rational numbers (fractions)
ℝ
ℂ
Three dots between elements represents intermediate values between 4 and 999.
Three dots at the end of the list represents infinite number of elements.

With Roster Notation, the order of elements does not matter. There is no order in a set. All elements are written in any order and only once.

An alternative is “Set Builder Form”, which defines the unique properties or conditions satisfied by all the elements of the set, using symbols:

{ x | -1 ≤ x < 6 }

”|” is read “such that”.
“≤” is less than or equal symbol \leq
”<” is less than or not equal to \leq.
”>” is greater than or not equal to \geq.

Thus: All values of x such that X is less than or equal to -1 or less than 6.

{ 2x | x ∈ ℤ⁺ }

“x” is \times multiplier.
∈ (epsilon, set by Option+E or \in) in (belongs to) “x ∈ ℤ⁺” is read: x among positive integers.
∉ (not element of)

DEFINITION: “Cardinality” is the number of elements in a set, represented as |N|.

n(A)
|∅| (null, set by Option + O) means an empty set.
ø means similar
|{∅}| means the size of an empty set = 1 for the empty set itself.
⊂ (subset) is set by \subset
⊆ (subset or equal)
∪ (union = \cup)
∩ (intersection), as is “Fish n Chips”
Δ or δ (delta symbol for difference, keyed by Option + J or Option + D)
° (degree symbol keyed by Option + Shift + 8
∝ (proportional symbol ∝)
≈ is approximately equal \approx, keyed by Option + X. ≈

About mathematical set notation, see:

https://www.purplemath.com/modules/setnotn.htm
https://www.geeksforgeeks.org/maths/set-notation/

Mathjax

VIDEO: Mathematical symbols are typeset from textual notation markup in LaTeX (or ASCIImath MathML), such as:

\$$\frac{4}{9} \left( 17 - 8\cos(2\sqrt{3}) \right)$$

The \$$ at the beginning and $$ at the end specifies use of the Mathjax library to generate graphical mathematical symbols using CSS with web fonts or SVG, such as:

$\frac{4}{9} \left( 17 - 8\cos(2\sqrt{3}) \right)$

\frac specifies the fraction “4/9”.
\left specifies left parentheses.
\right specifies right parentheses.
\sqrt specifies square root.

$$x = {-b \pm \sqrt{b^2-4ac} \over 2a}.$$

specifies the quadratic equation:

$x = {-b \pm \sqrt{b^2-4ac} \over 2a}$

\pm specifies the ⨦ plus or minus symbol.

Others:

\ne specifies the ≠ not equal symbol.
π is the symbol for Pi (3.14…), written as \pi or π
∞ is the infinity symbol ∞ written as \infty
e^ of P(???) specifies exponentiation to the power of {-1/3}, presented as a superscript.
_ (underline) define subscript as in \log_2(x)

Alternatives to LaTex coding include VIDEO: Typst which enables automatically formats as you write, and thus real-time collaboration on Google Docs.

AIME

The American Invitational Mathematics Examination (AIME) is administered by the Mathematical Association of America each year as the second exam in the series of exams used to challenge high school mathletes competing to represent the US at the International Mathematics Olympiad (MOP). over 300,000 students in 50 states and over 30 countries

Students are invited to take the AIME based on their scores for exams AMC 10 for middle schoolers and AMC 12 for high schoolers offered November each year.

The questions test knowledge in algebra, geometry, counting and probability, and number theory. Both tests cover material typically covered in the first few years of high school math. Topics such as trigonometry, complex numbers, and logarithms are only needed for the AMC 12. Calculus is not required for either exam. Challenges include fundamentals in Pigeonhole Principle, Mathematical Induction, Inequalities, Diophantine Equations, and Functional Equations.

All answers are a single integer between 0 and 999. Click the “Solution” link for explanations.

In 2025, the AIME was held February 6th, with problems and answers published immediately afterwards on various YouTube channels, forums, and blogs:

Pi Academy
MathProblemSolvingSkills.com
Anton Levonian
https://areteem.org/blog/2025-aime-i-answer-key-released/

BLOG: Annie Cushing (author of Making Data Sexy), notes that “The MathArena team … worked against the clock to run evaluations using the … problems before models could start training on it.” because the challenging math problems “makes for an excellent benchmark to see how well these models reason through more complex problems, with less opportunity to get the answer correct by chance since the test isn’t multiple choice like many benchmarks.”

For use by AI, Lex code for the first of 15 problems in AIME 2025 II are at:
https://github.com/eth-sri/matharena/blob/main/data/aime/aime_2025_II/problems/1.tex QUESTION: Print properly formatted Lex files using wlect cat ???.lex

https://matharena.ai publishes how well various LLM models reasoned about mathematics challenges in terms of Accuracy and cost of compute. As of Feb 20, 2025:

Each green box indicates the AI solved the problem >75% of 4 runs (repeated passes with the same prompt). Red boxes indicate problem solved less than 25% of passes. Yellow: Problem solved 25-75% of the time.

Stats: 150 is the highest score.

Math HMMT Feburary 2025

The HMMT (Harvard-MIT Mathematics Tournament, at hmmt.org) is a math competition founded in 1998 by students at Harvard, MIT, and schools near Boston, Massachuetts. It remains organized by students.

Each tournament draws close to 1000 students from around the globe.

WIKIPEDIA: The HMMT February tournament is generally considered to be more difficult than the American Invitational Mathematics Examination (AIME). However, difficulty varies by tournament and by round.

The top 50 scorers in the February tournament are invited to compete in the HMIC (Harvard MIT Invitational Competition), a five question proof contest.

The November tournament is easier than the February tournament, with problems similar to the AMC 10 and 12, and the AIME.

Calculus is not required for most of the problems, but it may be needed to solve some of the more difficult problems.

HMMT hosts staff exchange programs with the Princeton University Mathematics Competition (PUMaC), Carnegie Mellon Informatics and Mathematics Competition (CMIMC), and Stanford Math Tournament (SMT) to further collaboration between the competitions’ organizers. During exchanges, participants ranging from first-year members to more senior officers spend the weekend proctoring, grading, and otherwise volunteering at the host competition day-of.

Science benchmarks

GPQA

GPQA (Google-Proof Q&A) is a challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry.

“Google Proof” means that the answer is not discoverable by a query on Google.com (or Perplexity.ai). The answer requires “reasoning” through several intermediate queries to a panel of “experts”.

PDF of https://arxiv.org/abs/2311.12022 says “We ensure that the questions are high-quality and extremely difficult: experts who have or are pursuing PhDs in the corresponding domains reach 65% accuracy (74% when discounting clear mistakes the experts identified in retrospect), while highly skilled non-expert validators only reach 34% accuracy, despite spending on average over 30 minutes with unrestricted access to the web (i.e., the questions are “Google-proof”).

“The questions are also difficult for state-of-the-art AI systems, with our strongest GPT-4 based baseline achieving 39% accuracy. If we are to use future AI systems to help us answer very hard questions, for example, when developing new scientific knowledge, we need to develop scalable oversight methods that enable humans to supervise their outputs, which may be difficult even if the supervisors are themselves skilled and knowledgeable. The difficulty of GPQA both for skilled non-experts and frontier AI systems should enable realistic scalable oversight experiments, which we hope can help devise ways for human experts to reliably get truthful information from AI systems that surpass human capabilities.

The GPQA Leaderboard at https://klu.ai/glossary/gpqa-eval

The GPQA Dataset at https://github.com/idavidrein/gpqa was created by I. David Rein while he was a Researcher at New York University and now part of METR FAR.AI

https://sofworld.org/pattern-questions-and-marking-scheme

SOF ICSO - International Computer Science Olympiad
SOF NSO - National Science Olympiad
SOF IMO - International Mathematics Olympiad
SOF IEO - International English Olympiad
SOF ICO - International Commerce Olympiad
SOF IGKO - International General Knowledge Olympiad
SOF ISSO - International Social Studies Olympiad
SOF International Hindi Olympiad

GAIA Real-World AI Assistant Assessment

VIDEO: https://arxiv.org/abs/2311.12983 [Submitted on 21 Nov 2023] GAIA (General AI Assistant) real-World AI assistant Benchmark evaluates AI systems on practical, real-world tasks that encompass reasoning, multi-modal processing, web browsing, and tool utilization.

Despite being conceptually simple for humans, who achieve 92% accuracy, GAIA’s 466 questions aims to pose 3 levels of challenges for AI, requiring web browsing, multi-modaity, coding, diverse file type reading, play Tetris, translation, spell checking. GPT-4 (with plugins) scored only 15%. This stark performance gap underscores GAIA’s effectiveness in benchmarking AI systems’ robustness and adaptability across diverse, everyday scenarios, emphasizing the need for AI to match or exceed average human performance on practical tasks.

BASIS

BASIS: Frontier of Scientific AI Capabilities BASIS (Benchmark for Advanced Scientific Inquiry Systems) pushes the boundaries of AI evaluation in scientific domains, surpassing even GPQA in complexity. Tailored for assessing AI systems expected to perform at or beyond human expert level, BASIS focuses on tasks demanding advanced scientific inquiry and reasoning. This benchmark is crucial for developing and evaluating AI systems capable of contributing meaningfully to cutting-edge scientific research and problem-solving, potentially accelerating breakthroughs across various scientific disciplines.

Coding LCB (Live Code Bench)

Model names beginning with “O” such as “O3” are from OpenAI.com
Model name “Kimi” is at https://kimi.moonshot.cn from China.
Model name “DeepSeek” is DeepSeek.com from China.
Model names “Gemini” are from chat.google.com
Model names “Claude” are from Anthropic at https://claude.ai/new where it proclaims its “emphasis on what’s called “constitutional AI” - an approach to developing AI systems with built-in safeguards and values.
Model names “Dracarys” uch as Dracarys2-Llama-3.1-70B-Instruct are in the Smaug series, a finetune of Qwen2.5-72B-Instruct developed by: Abacus.AI China at
LLama3-70b-Ins from Meta at https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
DSCodder at https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base
Where is IBM WatsonX in this list?

Over time, a larger fraction of difficult problems are introduced with model capability improvements. A drop in performance in the later months is expected.

https://livecodebench.github.io says LCB (Live Code Bench) collects problems from periodic contests on

LeetCode,
AtCoder, and
Codeforces (ELO). VIDEO

VIDEO: Build a game usong ChatGPT 03 Mini O3-mini achieved a perfect 10/10 on pylint for a Hangman game project.

LLM platforms use them for constructing a holistic benchmark for evaluating Code LLMs across variety of code-related scenarios continuously over time.

The livecodebench runner is Naman Jain CS Ph.D. Berkeley.

Shangdian (King) Han living in Berkeley, California. Previously Microsoft Research.

OpenAI o3 scored among the top 10 contestants in Codeforces.com competitive programming solving complex problems under time constraints (2.5 hours).

LiveCodeBench.com publishes four Leaderboards: For each leadershboard provides a time slider. As of this writing:

880 Code Generation
713 Self Repair
442 Test Output Prediction
479 Code Execution
Not Kaggle competitions?

Models submitted for evaluation are at https://github.com/LiveCodeBench/submissions

For a more nuanced evaluation of LLM performance across different difficulty levels,
“Pass@1” measures the percentage of problems a model can solve correctly on its first attempt across all difficulty levels.
“Easy Pass@1” refers to the Pass@1 performance on problems categorized as “Easy”. See https://openreview.net/forum?id=chfJJYC3iL

At https://github.com/LiveCodeBench/LiveCodeBench/blob/main/lcb_runner/prompts/code_execution.py
prompts begin with:

 system_message = "You are an expert at Python programming, code execution, test case generation, and fuzzing."
``

You are given a Python function and an assertion containing an input to the function. Complete the assertion with a literal (no unsimplified expressions, no function calls) containing the output when executing the provided code on the given input, even if the function is incorrect or incomplete. Do NOT output any extra information. Execute the program step by step before arriving at an answer, and provide the full assertion with the correct output in [ANSWER] and [/ANSWER] tags, following the examples. ```

Its dataset of “448” multiple-choice questions is in the password-protected 2.2MB dataset.zip file at https://github.com/idavidrein/gpqa/blob/main/dataset.zip

VIDEO: Here’s a question about use of hour glasses that Grok3 cannot solve in 3 minutes.

VIDEO “Write a chess engine using the UCI (Universal Chess Interface) protocol”

SWE-Bench benchmark

SWE-Bench (Software Engineering Benchmark) at https://www.swebench.com involves giving agents a code repository and issue description, and challenging them to generate a patch that resolves the problem described by the issue.

https://www.swebench.com/#verified

https://github.com/swe-bench/sb-cli/ provides the CLI to run the benchmarks.

SWE-Bench has been used as the way to compare how well LLM offerings tests systems’ ability to automatically solve GitHub issues in a dataset containing 2,294 Issue-Pull Request pairs from 12 popular Python repositories:

astropy (95)
Django (850)
Flask (11)
matplotlib (184)
pylint (57)
pytest (119)
requests (44)
scikit-learn (229)
seaborn (22)
sphinx (187)
sympy (386)
xarray (110)

The 10 Oct 2023 Arxiv article describes the unit test verification using post-PR behavior as the reference solution.

"Resolving issues in SWE-bench frequently requires understanding and coordinating changes across multiple functions, classes, and even files simultaneously, calling for models to interact with execution environments, process extremely long contexts and perform complex reasoning that goes far beyond traditional code generation tasks."

Those working on it include [email protected] and [email protected]

CodeClash

https://codeclash.ai/

This evaluates 8 models on 6 arenas across 1680 tournaments at 15 rounds each (25,200 rounds total), generating 50k agent trajectories.

An LLM’s success over several “rounds” is measured by relative scores like income, territory control, survival in 6 “arenas”:

Battlesnake: Snake AIs compete to survive and grow in a grid
Core War : Redcode warriors battle to control a virtual computer
Halite : Distribute resources wisely to conquer territory
Poker : No Limit Texas Hold’em with 2+ players
RoboCode - Tank combat - outlast and outgun opponents
RobotRumble : Program swarms to overwhelm opponents

https://viewer.codeclash.ai/ shows the leader – Anthropic Sonnet 4 and 4.5 – score between 30 to 70.

Instead of explicit GitHub issues or tasks to solve (like other benchmarks), competitors are given just a high-level objective (goals) so models decide for themselves what to build.

Each round has two phases: edit, then compete. In the edit phase, models get to improve their codebase as they see fit. Write notes, analyze past rounds, run test suites, refactor code – whatever helps.

In each round, the LLM analyzes gigabytes of logs, adapt strategies, implement algorithms, and make all high- to low-level decisions.

Competition logs are then copied back to each model’s codebase and the next round begins.

https://github.com/CodeClash-ai/CodeClash

Creative Writing

Coming soon.

Instruction Following

Coming soon.

https://www.youtube.com/watch?v=a6bPt9oyoa8&t=1m32s “retirement will come for most people sooner than they think”. Brandage: Ex OpenAI Employee Gives Warning About The Economy TheAIGRID

https://www.youtube.com/watch?v=REjFL9hkkL4 Anthropic’s Chilling 18-Month Warning: AI Apocalypse in 18 Months TheAIGRID

https://www.youtube.com/watch?v=379s4W_EaTk

https://www.youtube.com/watch?v=379s4W_EaTk&t=9m3s LLM Engineer’s Handbook (from Packt) by Paul Lustzien,

OmniParser https://microsoft.github.io/OmniParser/

https://www.youtube.com/watch?v=kkZ4-xY7oyU&t=2m11s PersonaQA for Hallucination Evaluation

Language Translations

COMET, BLEU, and CHRF are widely used metrics for evaluating machine translation (MT) quality.

https://www.perplexity.ai/search/what-is-the-comet-score-for-tr-9RkzS6rsRr6R9oyBwYZvag

Evaluation Quality Metrics

It depends on what you are trying to achieve.

Classification tasks are measured using the “Accuracy” metric.
Regression tasks are measured using mean squared error (MSE).
Generation tasks are measured using mean squared error (MSE).
Task allocation tasks are measured using the F1 score.
Text summarization tasks are measured using the ROUGE score.
Question answering tasks are measured using the BLEU score.

https://bomonike.github.io/ai-benchmarks

_{25-12-16 v030 Nemotron :2024-12-28-ai-benchmarks.md created 2024-12-28}

AI Benchmarks was originally published by Wilson Mar at Index on December 16, 2025.

A Foody's Christmas

2025-12-14T00:00:00+00:00

Eat your way through Christmas films.

Christmas movies

The Polar Express (2004) HBO - Rich, frothy hot chocolate served on the train.
A Bad Moms Christmas (2017) - Spiced, spiked cider.
Rudolph the Red-Nosed Reindeer (1964) - Tomato soup and other simple winter comfort foods.
The Family Stone (2005) - Egg strata for Christmas breakfast.
A Christmas Carol - Roast goose, Christmas pudding, and other rich Victorian holiday foods.
A Christmas Story (1983) - Chinese roast duck at the restaurant, plus meatloaf and mashed potatoes at home.
National Lampoon’s Christmas Vacation (1989) - Eggnog in moose cups and a very dry roast turkey.
Home Alone (1990) - Plain cheese pizza and microwaved macaroni and cheese.
How the Grinch Stole Christmas (2000) - “Roast beast” at the Whoville feast.
It’s a Wonderful Life (1946) - roast chicken and other comfort foods.
The Holiday (2006) - Braised brisket and festive coffee drinks).
Meet Me in St. Louis (1944)</a> - Ketchup, corned beef.
Last Christmas (2019) - sauerkraut, sausage, Krempita, tiramisu.
The Holdovers (2023) -
Die Hard (1988) - Hostess Twinkies.
Frosty the Snowman (1969) - Red velvet cupcakes.
The Santa Clause (1994) - Giant chocolate chip cookies and hot chocolate made by the elves.
<a target=”_blank” href=https://www.justwatch.com/us/movie/home-alone-2-lost-in-new-york”>Home Alone 2:Lost in New York (1992)</a> - Huge ice cream sundaes via room service.
Elf (2003) - Buddy’s candy-loaded maple-syrup spaghetti and the “four main food groups”: candy, candy canes, candy corn, and syrup.
Love Actually (2003) - Banoffee pie (no-bake or almost no-bake layered dessert with biscuit crust, caramel/toffee, bananas, and whipped cream).
The Man Who Invented Christmas (2017)
A Christmas Story Christmas (2022)
White Christmas (1954)
Joyeux Noel (2005) Merry Christmas on Fandango
Little Women (2019)
Little Women (1994)
Miracle on 34th Street (1947)
Tim Burton’s The Nightmare Before Christmas (1993)
The Guardians of the Galaxy Holiday Special (2022)
Arthur Christmas (2011)
Tokyo Godfathers (2003)
Jingle Jangle: A Christmas Journey (2020)
Edward Scissorhands (1990)
While You Were Sleeping (1995)
Journey to Bethlehem (2023) - figs “fat juicy ones”.
Gremlins (1984) - Sandwich, chips. After receiving an exotic small animal as a Christmas gift, a young man inadvertently breaks three important rules concerning his new pet, which unleashes a horde of malevolently mischievous creatures on a small town.
A Christmas Tale ( Un conte de Noël, 2008) - When their regal matriarch falls ill, the troubled Vuillard family come together for a hesitant Christmastime reunion. Among them is rebellious ne’er-do-well Henri and the uptight Elizabeth. Together under the same roof for the first time in many years, their intricate, long denied resentments and yearnings emerge again.
Rare Exports: A Christmas Tale (2010) - Young Pietari lives with his reindeer-herding father in arctic Finland. On the eve of Christmas, a nearby excavation makes a frightening discovery and an evil Santa Claus is unleashed…
Better Watch Out (2016)
Spoiler Alert (2022)
Happiest Season (2020)
Anna and the Apocalypse (2017)
Four Chirstmases (2008)
Christmas with the Kranks (2004) HBO

_{25-12-14 v009 eof :2025-09-02-foody-christmas.md created 2025-09-02}

A Foody's Christmas was originally published by Wilson Mar at Index on December 14, 2025.

(Dates in) History

2025-12-13T00:00:00+00:00

Over the years, I reference this page when watching documentaries, traveling to museums. Many dates are approximate and controversial. I welcome your comments.

NOTE: Content here are my personal opinions, and not intended to represent any employer (past or present). “PROTIP:” here highlight information I haven’t seen elsewhere on the internet because it is hard-won, little-know but significant facts based on my personal research and experience.

About the Future

“… the sons of Issachar had understanding of the times, to know what Israel ought to do,” --1 Chronicles 12:32 (KJV)

“I like the dreams of the future better than the history of the past.”

--Thomas Jefferson

“We celebrate the past to awaken the future.”--John F. Kenedy, August 14, 1960

“Trying to plan for the future without regard for the past is like trying to plant cut flowers.”--Daniel Boorstin, Historian

Jokes and Quotes

“War is God’s way of teaching us geography” –Comedian Paul Rodriguez

“Coincidence is just God protecting his anonymity.–anonymous

“God cannot alter the past, though historians can.” –Samuel Butler

“You can’t understand who we are, unless you understand who we were.”–David McCullough, Historian

“Those who cannot remember the past are condemned to repeat it.”–George Santayana (1863-1052), in “The Life of Reason”

“History is the sum total of things that could have been avoided.”–Konrad Adenauer (1876-1967), first chancellor of West Germany

“It is easier to fool people than to convince them that they have been fooled.” Mark Twain

A Panorama of History?

What are the most significant events in world history, and what do they tell us about the future?

BC = B.C.=B.C.E. (Before Christ = Before the Common Era)
AD = A.D.=C.E. (Anno Domini = Common Era)

It turns out I found one ancient book that has been proven to be a reliable chronicle: the “Judeon-Christian” Bible (66 Old and 44 New Testament books) which were written in several languages in the ancient Hebrew Masoretic Text, the Textus Receptus in koine (common) Greek, Aramaic. Over the years, various translations have been created for different audiences over the world. This article is written for reading online by readers of English. Underlined links to passages referenced in the Bible are presented by the BlueLetterBible.org. Readers can select from among several translations in English:

The default here is the King James Version (KJV) of the Bible from 1611 Anglican England. The KJV is in the public domain and is considered by many to be the most accurate translation of the original Hebrew Masoretic Text and Greek Textus Receptus. The BlueLetterBible.org site also provides a concordance of where each (of 6,000) words is referenced. There are also commentaries to help readers better understand the original meaning of the words and concepts in the Bible.

Timeline of History?

Several have deduced timelines presenting the most significant events. Below is one version from CJ Lovik, which have not come true:

Click image for full screen

The above diagram got wrong the beginning of “70th Week of Daniel” (7 years of Tribulation) when the al-Madhi rules the world (Dan 9:27; Rev 6:1-19?.

But I show it for its illustration of past events, many which have archeological evidence. The most significant events in world history are:

Creation 4005 BC
Sin event (of Adam and Eve) 3971/3970 BC
Noah’s (global) Flood 2353 BC
Promised land from Egypt 1408 BC

Sieges:

First Seige of Jerusalem 701 BC
Second Seige of Jerusalem 589 BC
Crucifixion of Jesus on Nisan 14 (Friday), 30 AD (at the same time as the Passover lamb was being sacrificed).
Third Siege of Jerusalem (by Roman Emperor Titus in 70 AD)
Restoration of Jerusalem: Israel regathered in the land (Ez 37:12; Isa 11:11,12; Deu 30:3-5)
- Ancient cities rebuilt and inhabited (Ez 36:1-5, 8-10)
- Muslim “Arab” resistance (Jer 49:16; Zep 2:8; Ez 25:12,32:5,36:2; Oba 1:10)
- Israel establishes an army for defense (Ez 36:67, Ez 38:8)
- Adjacent nations confederate, committed to the destruction of Israel (Psalms 83:1-5, 12)
- War between Confederacy & Israel (Jer 49:2, 8, 19)
- Title regained: “My people Israel” (Hos 1:8-10; Rom 9:25,26; Ez 36:8-12)
- God decisively defeats the Confederacy (Oba 1:9,18; Ez 24:13,14; Jer 49:10,20,21,23-26; Isa 11:12-14; 17:1; 19:16-17)
Rapture of the Church “brides” and the Holy Spirit “restrainer” with it (2 Thess 2:7; 1 Thess 4:13-18; 1 Cor 15:51-53)
Damascus, Syria destroyed (Isa 17:1)
Anti-Christ is revealed
UN? activates the “Covenant with Many” (Dan 9:27) for a one-world government (Rev 13:1-8) with international currency (Rev 13:16-18) and religion (Rev 13:11-15)
The Ark of the Covenant discovered (by the Madhi?) (Zach 6) (Rev 11:19)
2025? The “Abomination of Desolation” (Dan 9:27) is set up in the Temple (Rev 13:14-15)
Rebuilding of The Temple: “And it shall come to pass in the last days, that the mountain of the LORD’S house shall be established in the top of the mountains, and shall be exalted above the hills; and all nations shall flow unto it.” (Isaiah 2:2)
As previously, Rosh ha Shanan (Tishri 10, the Day of Atonement), the “Abomination of Desolation” is set up in the Temple (Rev 13:14-15) VIDEO
Second Return of Christ, to begin the Millenium Reign of Christ
2000th anniversary of Christ’s resurrection.

Other Timelines

Contextual Principles

To understand the various events in world history, it helps to have some context:

One day is as a thousand years

“… one day is with the Lord as a thousand years, and a thousand years as one day” —Psalm 90:4 (NKJ) & 2nd Peter 3:8 (NKJ)
Ancient calendars around the world initially used a 360-day calendar without leap years and 5 extra days (in 31-day months) to make the cycle of seasons uniformity on the equinoxes of 20 March and 23 September – when daytime and nighttime are of equal duration.

Although the Roman Julian calendar reform of 45 BC adopted a 365-day solar calendar with modern leap years, when John in 95 AD wrote the Book of Revelation, he used lunar-based 360-day years. Specifically, the verse “holy city shall they tread under foot forty and two months” in (11:2 is 42 * 30 = 1260 days, the same as “a thousand two hundred and threescore days” (where “threescore” is 60) in the next paragraph 11:3. That’s not 1278 days of 3.5 years by a 365-day calendar with some 31-day months.

BTW Major financial software used today uses a 360-day calendar (to calculate interest).
Writings about the future necessarily also deal with the cosmic realm not visible to the naked eye nor measurable using scientific instruments. Ephesians 6:12

“For we wrestle not against flesh and blood, but against principalities, against powers, against the rulers of the darkness of this world, against spiritual wickedness in high places.”
The Bible focuses on one country/people: the 12 tribes of Israel, their 7 feasts each lunar year, and their capital Jerusalem. Psalm 122:6 says “Pray for the peace of Jerusalem: they shall prosper that love thee.”

Some analysts look to the “Jubilee” years that repeat every 7-years. (Leviticus 25:8) 2023 and 2030 are Jubilee years.
The multi-decade sieges of Jerusalem occurred because God of the Bible did not receive acknowledgment of supremacy from his people (Isaiah 45:7). The first of 10 Commandments. (Exodus 20:1)
To the “elect” of Christians, the New Testament fulfills predictions in the Old Testament – that of redemption from Adam’s sin through Jesus Christ, applicable to all people. Isaiah 11:11-12

Romans 10:12 For there is no difference between the Jew and the Greek: for the same Lord over all is rich unto all that call upon him.
The 70th week of Daniel (7 years of Tribulation). See Ron Wyatt’s Red Sea Discoveries and Talmud Talmud
A pivotal basis for an important prediction is “when the sacrifice cease”. This video points out that it refers not in the plural (sacrifices of the Tabernacle system), but singluar – of Christ’s sacrifice.
Many are concerned about the “Mark of the Beast” (666) an how those who take it will be condemned to hell.

Why would having a shopping mark have a religious connection? My personal conjecture is that it somehow interferes with the spiritual connection with God. God hears our thoughts as prayers. Disrupting prayer disrupts community with God.

Romans 10:9 … believe in thine heart that God hath raised him from the dead, thou shalt be saved.
The “Four Horsemen” mentioned in Revelation 6 and 1 Thessalonians 5.

Killer Talking Mind-Control Robots? - “And he had power to give life unto the image of the beast, that the image of the beast should both speak, and cause that as many as would not worship the image of the beast should be killed. (Rev 13:15)
Wallet Implant - “And he causeth all, both small and great, rich and poor, free and bond, to receive a mark in their right hand, or in their foreheads; And that no man might buy or sell, save he that had the mark, or the name of the beast, or the number of his name.” (Rev 13:16-17)

VIDEO: Koran: Sur 9:29 “fight those who believe not in Allah nor the Last Day, nor hold that forbidden which hath been forbidden by Allah and His Messenger, nor acknowledge the religion of Truth, (even if they are) of the People of the Book, until they pay the Jizya with willing submission, and feel themselves subdued.”

Countries & People Groups

Here’s what I’ve been able to figure out so far about the locations of people groups in the Bible and their modern names:

Ashkenaz = Germany
Amalek = Arabs of the Sinai Peninsula
Ammon = Palestinians & central/northern Jordan [A]
Assyria = Syria and Northan Iraq [A]
Assur = Assyria = Syria [A]
Beth Togarmah = Türkiye (Turkey)
Chub = Libya [B]
Children of Lot = Syrians & Northern Jordanians [A] ???
Cush = Ethiopia [B]
Dedan = AlUla, Saudi Arabia
“Tents of Edom” = 100,000 refugees in Southern Lebanon [A] (Rev 2:9,3:9)
Egypt (Muslim Brotherhood?)
Ethopia = Sudan [B]
Elam = West-Central Iran
Gebal = Hezbollah & Northern Lebanon [A]
Gog = Russia (person) Pamyat
Gomer = Turkey [B]
Hagrenes = Egyptians (Hagar Egypt Matriarch) [A] OR Hagarites (v. 6) were a tribe against whom the Transjordanian tribes of Reuben, Gad, and Manasseh fought at the time of the Jewish conquest of Palestine.” (Boice)
Ishmaelites = Palestinians & Southern Jordanians [A]
Inhabitants of Lebanon = Hezbollah
Kedar = Saudi Arabia [B]
Kittim = Cyprus [War Scroll]
“children of Lot” = Moab and Ammon [A]
Magog = Russia [B]
Media = Eastern Iran (Persia) (Judges 6-8)
Meshech = Türkiye (Turkey) [B]
Moab = Central Jordan & Palestinians [A] “shall be like Sodam” – (Zephaniah 2:9)
Philistia = Hamas of the Gaza Strip [A]
Persia = Iran [B]
Put = Libya [B]
Rosh = Russia
Sheba = Yemen
Tarshish = Cornwall UK and its “young lions” = USA? & British Commonwealth nations (Canada, Australia, New Zealand, etc.) VIDEO: (Ezekiel 38:13) “will bless Israel”
Togarmah = Türkiye (Turkey) [B]
Tubal = Türkiye (Turkey) [B]
Tyre = Hezbollah & Southern Lebanon [A]

References:

John Ankerberg Show

[A] marks the “inner circle” of countries who share a borders with Israel, mentioned by (Psalm 83:6-8 to “wipe Israel off the face of the Earth”): Lebanon, Jordan, Syria, [Wikipedia] VIDEO

[B] marks the “outer circle” mentioned in Ezekiel 38-39: Libya, Sudan (Ethopia), Gomer=Turkey, Saudi Arabia, Yemen, Persia=Iran, Iraq, Magog=Russ, Rosh, Mesheck, Tubal=Turkey, Togarmah: VIDEO

Sisera = Judges 4 Deborah & Barak [A]
Jabin, at the brook of Kison: Which perished at Endor:
Make their nobles like Oreb, and like Zeeb: yea, all their princes as Zebah, and as Zalmunna: defeated by Gideon in Judges 7.

PreHistory (Geologic Time)

Precambrian	-4.6 Billion years
Cambrian	-570 million years (Peking Man, Java Man)
Mesozoic	-225 million years (dinosaurs)
Holocene	-10,000 BC
Paleolithic (Old Stone Age)	50,000 years ago, 40,000 BC in Australia & Japan, 27,000 Siberia
Neolithic (New Stone Age)	15,000 Wall paintings made in caves at Lascaux, France and Altamira, Spain. 12,000 BC with cereals farming in the Levant
Calcolitic (Copper-Stone)	6500 BC in Eastern Anatolia, 5176/4114/4004 BC - Biblical Creation 4500 BC in India, 3000 BC throughout Mediterranean
Broze Age (Copper+Tin from Cornwall, England)	3000 BC in Greece & China, 1900 BC in Britain (source of Tin)
Iron Age	From 1200 BC in the Middle East, 600 BC in China

Astronomer Barry Setterfield of Australia theorizes that because the speed of light is decreasing geometrically, millions of years could have gone by in our current perception of time. The Bible speaks of this:

Martin Anstey’s 1913 "Romance of Bible Chronology".
Edwin R. Thiele, in his The Mysterious Numbers of the Hebrew Kings (Academie Books, Zondervan Publishing House, Grand Rapids, 1983) further untangled the chronology of the monarchic period.

The stand-off between Biblical and archeological discoveries in Egypt and other countries surrounding Isreal was resolved in 1990 by physicist Gerald E. Aardsma in A New Approach to the Chronology of Biblical History from Abraham to Samuel. It concludes that the "480 years" in (1 Kings 6:1) contradicts with Acts 13:19-20 and archeological records because of an early (rare, homeoarkton) copy error of "1480" years. (Similar to an issue with the translation of Samuel 6:19, where the number of people killed by God for looking into the Ark of the Covenant was mistranslated as 50,070 instead of 70.)

Additional information: Creation Research Society and Creation Science bend time

3.8-4 million BC ? First bipedal human in Ethiopia
35,000 Upper Paleolithic Period, when first humans are believed to arrive in North America and Asia.
Nephilim (Genesis 6:4-6)

Year of Creation

5762 according to Alan D. Corré. Alternately:
5176(+/-26) as estimated by Gerald E. Aardsma
4114 based on analysis of Bible text, as explained in this video by usefulcharts.com
4004 [October 23] according to "Annals of the World" (1600 pages in Latin) by Irish Archbishop James Ussher (1581-1656)

No date? Earth’s moon created when planet Rahab, located between Mars and Jupiter, destroyed into the Asteroid Belt? (Job 26:11-14, Psalm 89:9-14, Isaiah 51:9-16)

? [4043] Adam created by God (Gen 2)
3971/70 BC - when Adam was as old as Jesus when he was crucified, sinned and subsequently got expelled from Garden of Eden (Gen 3)

__ Enoch translated (midway between Adam & Abraham)

Early History

Jan 1, 4713 BC (-4712 CE) - First Julian Date (Epoch) on the Gregorian Calendar, as proposed in 1583 by Joseph Justus Scaliger, who named the epoch after his father’s name. Complex formulas are needed to convert between the two due to its use of the 19-year Metonic cycle (lunar phase cycle). The Julian calendar added one extra day every four years, but this led to an overcorrection of about 11 minutes per year (one day every 128 years). The Gregorian calendar introduced a more accurate calculation of leap years by omitting three leap years every 400 years. The change created a period of about 350 years (1582-1920s) where two different dating systems were in use simultaneously. Historians used notations like O.S. (Old Style) for Julian dates and N.S. (New Style) for Gregorian dates.
3913 Seth born when Adam was 130 years old (Genesis 5:3)
3808 Enosh born when Seth was 105 (Genesis 5:6)
Oct 7, 3761 BC, Hebrew (lunar) calendar starts on a New Moon (Molad) on 1 Tishrei (New Year)

3520(+/-21) [Usher 2348] Methuselah dies at 969 years old (Gen 7:27), his death shall bring the one-year flood of Noah on 17th Nisan. This begins 427-year Dispensation of Human Government.
Post-diluvian times:

3167 Abram (father of many) born in Ur, Assyria Mesopotamia (modern day Iraq) (Gen 11:26-32; Gen 12:4; Acts 7:4)

3114 the epoch (beginning) of the Mayan calendar (on 11 Aug)
3100 First war recorded (in Egyptian hieroglyphics) about Pharaoh Narmer "Menes the Fighter" uniting Upper and Lower Egypt.

3092(+/-16) [1630] [1921 Usher] God calls Abraham to leave Ur Chaldeans (who identified the Soros cycle) to settle awhile in Haran, Egypt, then Canaan.
3067 Issac born (Gen 25:26)
? Ishmael cast out (Gen 21:8-10)
? Issac (Gen 26:17-25) wife Rebecca from Iraq (Gen 24:4,10)
? Semite Sodom & Gomorrah destroyed by fire and brimstone” (Gen 19:24-25)
3007 Jacob (=by might) born (Gen 47:9) (Gen. 28:10-12, 32 & 35:1-7)
2916 Joseph born (Gen 41:46)

2952(+/-51) Egypt’s Early Dynastic period ends with Dynasty 3.
2879-2872 (Transition from Early Broze age I and II) high residue radioactivity in tree rings of the time indicate lower solar activity, which causes drought and thus famine in the Near East.
2877 Joseph and family in Egypt (during its Second Dynasty)

2646 (by Carbon 14 dating) "Step" pyramid of Djoser (Zoser) built at Saqqara, Egypt.
2590 Great Pyramid of Khufu at Giza begins to be built.
2334 Semitic Akkadian Sargon the Great from the North conquers Summarians in the South (Mesopotamia) above the Red Sea, forming the first empire and standing army (armed with bows on horses)
2234 [Usher] The races are dispersed with different languages after the Tower of Babel in Iraq (Genesis 10:10,11;11:1-9) during the Bronze Age of Human Government

Ancient Egypt

From the Met: Our knowledge of the succession of Egyptian kings is based on kinglists kept by the ancient Egyptians themselves. The most famous are the Palermo Stone, which covers the period from the earliest dynasties to the middle of Dynasty 5; the Abydos Kinglist, which Seti I had carved on his temple at Abydos; and the Turin Canon, a papyrus that covers the period from the earliest dynasties to the reign of Ramesses II. All are incomplete or fragmentary. We also rely on the History of Egypt written by Manetho in the third century B.C. A priest in the temple at Heliopolis, Manetho had access to many original sources and it was he who divided the kings into the thirty dynasties we use today.

3100 BC Unification of Upper and Lower Egypt by Narmer during the Early Dynastic Period
2649–2150 BC Old Kingdom: Dynasty 3-6
2150–2030 BC First Intermediate Period: Dynasty 7–11 first half
2040–1640 BC Middle Kingdom: Dynasty 11 second half - Dynasty 13
1550–1070 BC New Kingdom: Dynasty 18–20 (Ramesses II the Great)
1070–713 BC Third Intermediate Period: Dynasty 21–24
712–332 BC Late Period: Dynasty 25–30
332–304 BC Macedonian Period: Alexander the Great
304–30 BC Ptolemaic Period: Dynasty 31–34
30 BC–395 AD Roman Period: Ptolemy

The word pharaoh is not from the Egyptian language but is the Hebrew word for the King of Egypt’s palace. Pharoahs of ancient Egypt are each identified by a cartouche. Each ruled for an average of 25 years. The first king was Menes, who ruled for 62 years. The last king was Cleopatra VII, who ruled for 21 years. The longest-reigning monarch was Pepi II, who ruled for 94 years. Mention of some were erased from history by their successors. The Bible mentions some of them by name, such as Shishak (1 Kings 14:25-26) and Necho (2 Kings 23:29-35). Chronology places the beginning of the Old Kingdom in the 27th century BC (+/- 300 years), the beginning of the Middle Kingdom in the 21st century BC and the beginning of the New Kingdom in the mid-16th century BC. the “New Chronology” proposed in the 1990s, which lowers New Kingdom dates by as much as 350 years, or the “Glasgow Chronology” (proposed 1978–1982), which lowers New Kingdom dates by as much as 500 years.

Mosaic Age of Law

? Egyptian pharaoh Phiops II subjugates Isrealistes.
Moses rescued from the Nile to become Senenmut (“mother’s brother”) [marked on empty tomb in the temple of Egyptian princess Hatshepsut 1503-1482 BC, first female Egyptian pharaoh]
PROPOSED: 2447(+/-12) (during reign of Egyptian Menkaure, 1480 years after the Promise was given Abram, per modern reading of 1Kings 6:1)
2152 BC The 6th Dynasty of Egypt’s Old Kingdom under Pharoah Merenre Antyemsaf II (Greek name Niocris) collapses (putting Egypt into Dynasty 7 of the First Intermediate period), by parting and closing of the Yam suth (modern day Lak Yahablah - the Red Sea).
1446 VIDEO: (based on 1Kings 6:1 “In the 480th year after the Israelites came out of Egypt), in the 4th year of Solomon’s reign”) in 966 BC. That’s during the reign of Ahmenhotep II (1450-1425 BC) during the 18th Dynasty of Egypt. in the jubilee of jubilees (50 x 50 years or 2500 years after the fall of Adam)
1406 BC Moses leads Exodus from Egypt (Exodus 14:23,27-30). Alt:

Ten commandments given apodictic Normative, the beginning of Judaism

Mount Sinai of Moses (VIDEO: “Jabal Al Laws” [Google Map] in present day Saudi Arabia. See VIDEO of bull petroglyphs and alter of uncut stones and burnt ash. Burnt rock at Horab. VIDEO.
The Red Sea crossing site (Nuweiba Beach in present day Egypt). After nearly a week of walking from Avaris/Tel-Ramses; a dead-end path to a beach that is of the size to hold potentially 3 million Israelis escaping to Midian. At Pi-Hahiroth [Google Map] (“place of-mouth of canyon/channel/canal” mentioned in Exodus 14:2) is where, in 1978, Ron Wyatt and his sons discovered chariot wheels covered in gold and coral formations on both sides of an otherwise bare sea floor with a gradual 6% incline. See VIDEO: Ron Wyatt’s Red Sea Discoveries.
In 1984 they discovered the 2nd of two carved Pillars, placed by King Solomon, as memorials on opposite sides of the site of the Exodus Red Sea crossing. See Tim Mahoney Patterns of Evidence movie: The Red Sea Miracle (2020) [imdb].

2407 Hebrews (under Joshua, without Moses) enter Canaan, destroying Jericho and Ai (confirmed by radiocarbon dating of et-Tell digs found in 1934 by Marquet-Krause).
Hebrew occupation ends the Early Broze III period of Palestine.

Casuistic (case) Law in Late Bronze Age

2350 Akkadian kingdom in Mesopotamia established by Sargon lasts 146 years by descendants Rimush, Manishtusu, Naram-Sin, and Shar-kali-sharri. one of them is the Cushan-rishathaim, the first oppessor of Isreal, later delivered by judge Othniel (Judges 3:10)
2205-1765 Hsia dynasty in China.
2000 BC Mayan civilization forming to reach peak 250-900 CE.
[not 1375] Judges rule: Othniel, Ehud, Deborah, Gideon,
1977-1957 [not 1075] Samson in Gaza, the last judge in the book of Judges.
Ruth & Boaz (=by his counsel)
? Elijah translated (midway between Abraham & Christ)
(800 year) Biblically quiet period of more Judges of Isreal

1775 casuistic (case) law Code established by Hammurabi (1792/1728-1686), the Amotittian ruler of Babylonia.
1766-1121 Shang Dynasty in China is known for its use of acupuncture, elaborate bronze ritual vessels, oracle bones to determine the future, and the earliest standardized form of Chinese characters
1628 Volcano erupts in Thesus (modern day Satorini, Greece) destroys the Minoan civilization on the island of Crete, an art-loving culture Homer calls Atlantis.
1590 Kassites take power in Mesopotamia and Palestine.
1550(+/-15) Egypt begins New Kingdom period Dynasty 18.
1500 Hinduism begins in India.

[1525] Moses saved by princess Nefure, only child of Tutmoses I (Exodus 2:1-10), and lives in the palace as Senmut.
Nefure becomes Queen Hapsepsut with half-brother Tusmoses II after Moses refused it.
1458 Tuthmosis III (1516-1426) seiges Meggiddo (among 350 cities) during his 1504-1450 reign of Egypt’s 18th dynasty.
[1445/7-1336] Early date for the Exodus, when Tutmoses IV (Amenhotep III) ruled Egypt.
Egyptian pharaoh Akhenaten (Amenhotep IV) and wife Nefertiti switch to monotheistic worship of Aten (in place of Amen) and moves capital from Thebes to El-Amarna.
Oct. 25, 1404 Mars passes 70,000 miles away from Earth, causing a 5 degree Polar shift and days on Earth from 360 to 365.5.

1300 Temple of Abu Simbel built in Nubia for Ramesses II.
1274 stalemate in the Battle of Qadesh (Kadesh, on the Orontes River in present-day Syria) when Hittite King Muwatalli II repels Pharaoh Ramesses II of Egypt in the largest chariot battle in history led to the first recorded peace treaty.
1236 - 1203 Merneptah’s campaigns into Palestine via sea.
1200 Trojan War between Greeks and Trojans, as described in Homer’s Illiad.

1200-1000 Rig Vedas composed in India
1198 - 1153 Ramesses III campaigns with chariots into Peleset (Philistines) in Palestine.
1191 Zen Buddhism introduced to Japan by Chinese monk Eisai
1185 Samurai wrest power from aristocracy in Japan

1177 VIDEO: Civilization Collapsed by invasion from running “Sea Peoples” invading the Eastern Mediterranian among Greek Mycenaeans, Cyprus, Egypt, Hittie, Assyria, Babylon.
1122-225 Chou dynasties reign in China

1070(+/-15) Egypt begins Third Intermediate period Dynasty 21.
1051(+/-16) Samuel born, ending age of Judges.

United and Divided Kingdoms

1051(+/-16) Saul unites kingdom of Isreal and begins to reign in the Biblical age of Monarchy.
1103 BC Brutus (decendent of "low-tree" Zarah who ruled Egypt as son of Joseph, per prophecy in Ezekiel 17:22-24 and 21:25-27) estabishes New Troy in Britain (later to be renamed London).

980 (within 40 year rule 1010-970) David king (Psalms, 1st Chronicles) establishes Jerusalem
965 Solomon begins building the temple
940 Solomon king with 700 wives (Songs, Proverbs, 2nd Chronicles, 1 Kings)
947 First temple built by Solomon consecrated on 10th Jubilee (1 Kings 9:1-3)
925/900 Jeroboam 10 tribes split to North from Rehoboam
Omri’s son Ahab & Jezebel hunt Elijah to Mt. Carmel (1 Kings 18)
871 [RC14 dating at Tel Rehov says not 925] Shishak invasion in year 39 of Solomon/Year 5 of Rehoboam
880 Asa king of Southern Kingdom of Judah; Joehoshaphat, 7 yr. old Joash
842 Elijah outs Ahab and Jezebel for their worship of false gods
814 Jeroboam II king of Israel after Yahwist Jehu coup
800-600 Upanishads composed in India
785? Amittai Jonah (=Dove) prophet to Assyrian Ninevah (Greek Ionas) Matthew 12:38)
776 Greeks hold first Olympics in town of Olympia — the first year of the Greek Calendar.
Northern Prophets: 760-750 Amos, 753 Hosea (harlot wife Gomer)
763 June 15 VIDEO: Solar eclipse in Nineveh (North of Bagdad Iraq) noted on cuniform tablets under Assyrian king Ashurbanipal provides a way to corroborate (using Eclipse Emphemeris) Jonah and correlate Sennacherib’s captue of Jerusalem on 701 BC and Exodus at 1446 BC.
753 Foundation of Rome.
Southern Jotham & Ahaz & Hezekiah: 742 Micah, 740-681 Isaiah
731 Ukinzer (a Chaldean) becomes king of Babylon (modern-day Iraq) to begin Chaldean rule.
730 Sparta conquers Messene.
722 Ten Northern tribes of Israel taken as slaves to Assyra by Shalmaneser on 9th of Az
710 Hezekiah (715-686) repels Sennacerib (the death angel) from Jerusalem
753 year 1 AUC (Ab Urbe Condita, meaning “from the foundation of Rome”) on the “Kalends of March” (March 1st)
722 Samaria completely destroyed by Assyrian king Shalmanesar V (727-722BC) 2 Kings 17-18.
701 calendars adjusted (for planetary ressonance with Mars?)
697 Manasseh bad king of Judah (2 Kgs 21 & 2 Chron. 33)
669 Babylon destroyed by Assyrians.
660 Shinto religion defined in Japan during rein of Jimmu, first Japanese emperor.
640 Zephaniah prophet, 635 Xephaniah, 626 Jeremiah, 620 Nahum, 612 Habakkuk
630-550 Life of Zoroaster
621 Josiah (640-609 son Amon) discovers the Law Book of Deuteronomy in the Temple and begins monotheistic practice
621 The Laws of Dracon become the first written laws of Athens, Greece. The adjective “draconian” describes its harshness. "We need the death penalty to prevent small crimes, and for bigger ones I can’t think of any greater punishment."

614 Fall of Assyria.
608-597 Jehoiakim, 597 Ezekiel captive, 593-571 Ezekiel prophesizes
605 Jehoachin/Jeconiah & Zedekiah exiled, Daniel captured by Medes & Persians.

604-562 Nebuchadnezzar II rules Neo-Babylonian (Chaldean) Empire and builds the Hanging Gardens of Babylon, one of the "Seven Wonders of the Ancient World".
600 Taoism religion defined in China by Lao-Tse (604-531) writing Tao-te-Ching (“The Way of Power”) which describes the nature of life, the way to peace and how a ruler should lead his life.
597-8 First Babylonian conquest of Jerusalem
594 Solon establishes a constitutional democracy in Athens, and wipes out all debts.
586/587 on 9th of Az (Ezekiel 12:10-17) Nebuchadnezzar destroys Soloman’s temple in Jerusalem during his 2nd Babylonian conquest. This date is an anchor for chronologies.
583 BC Jeremiah (with Baruch) marries Tea Tephi, a daughter of King Zedekiah, to Eochaidh II (Eremhon), High Zarahite King of Ireland. This exalts the Zarah line from which all the kings and queens of Britain and northwest Europe descend.
563-483? Siddhartha Gautama, founder of Buddhism (later enlighten to Buddha), born in Napal.
561 Pisistratus, leader of the poor, becomes the tyrant of Athens.
560 Lao-Tze writes his philosophy.
551-479 Confucious writes fortune cookie sayings in China (Analects).

Ancient Persians

550 King Cyrus II of Persia founds Persian empire.
539 Mesopotamian region (inhabited by Chaldeans and Babylonians) conquered by Cyrus the Great (the Father of Iran).
539 BC Cyrus the Great of Persia (lion with wings) conquers Babylon (Daniel 5:30-31)
Oct 12, 539 Persian Aramaic Cyrus overthrows Babylon (Daniel 8:25 fulfills Isaiah 44:28) under Belshazzar.

521 - 485 BC Darius I (the Great of Persia) (Ezra 4:5)
520 Cyrus allows Isreal to return from Babylonian Exile (Ezra).
512 Second Temple of Isreal finished.
510 Cleisthenes, with exiled Athenian nobles and an army from Sparta, liberates Athenians from Pisistratus and his sons.
505 Democracy established in Athens.

486 - 464 BC Xerxes I (Ahasuerus) of Persia marries Esther (Esther 1:1-22)
464 - 424 BC Artaxerxes I (Longimanus) of Persia sends Ezra to Jerusalem (Ezra 7:1-28)
424 BC Xerxes II
424 - 423 BC Sognianus
424 - 404 BC Darius II (Nothus) of Persia sends Nehemiah to Jerusalem (Nehemiah 13:6)
404 - 358 BC Artaxerxes II (Mnemon) of Persia
358 - 338 BC Artaxerxes III (Ochus) of Persia
338 - 336 BC Arses of Persia
336 - 330 BC Darius III (Codomannus) of Persia conquered by Alexander the Great (Daniel 11:2)

A “diadem” (crown) is a blue band marked with white which Persian kings used to bind on the turban or tiera.

477 Athens assumed leadership of the Delian League alliance of the city-states and islands of Greece against the Persians.
464 Earthquake in Sparta; helots revolt.
458 On the 20th Jubilee, 7th year into the reign of Artaxerxes Longimanus decree allows Ezra to leave Babylon to rebuild Jerusalem. This starts the 490 (70x7) prophesy in Daniel 9:25 to Jesus’ death on 1 Nisan (Friday April 15) AD 33.
434 Dedication of the wall of Jerusalem by Ezra and Nehemiah (Nehemiah 12:27)

434 [not 490] Battle of Marathon, (coast of Attica) Greece won by Athenians after Persian king Darius I is killed by a Greek beauty.
424 [not 480] Xerxes (aka Artaxerxes, son of Darius) destroys an empty Athens after overcoming the heroic 300 Spartans at the Battle of Thermopylae.
Xerxes leaves the war to Mardonius after defeat by the more nimble Greek navy at the Battle of Salamis.
425 [not 479] Persians under Mardonius are defeated by allied Greeks at the Battle of Plataea.

428 (Esther saves her people (celebrated in Jewish Purim festivals).

403- [according to Thucycides] Sparta defeats Athens in the 27 year Peloponnesian War.

Inter-Testament Times

753 Romulus & Remus (Castor & Pollux) saved by wolves, start of Roman Anno Urbis (ab urbe condita) calendar.
630 Egyptians ransack the Temple in Jerusalem
606 Babylon captures Jerusalem, the beginning of “times of the Gentiles” Luke 21:24)
604 Lao-tzu, founder of Taoism, born in China.

328 AD Nammara inscription is among earliest written evidence of Nabataean script Old Arabic.
470 AD oldest known inscription, a composite of Nabataean and Arabic writing, found near Najran in Saudi Arabia.

410-322 Age of Socrates (the first to recognize a one true, but unknown, G-d), Plato, and Aristotle in Greece
403 Start of "Waring States" period in China.

356 Alexander born to Phillip II of Macedonia, tutored by Aristotle (384-322)
338 Philip II of Macedonia conquers other Greek city-states in Battle of Chaeronea.
335 Alexander begins in Thebes the conquest of the known world.
334 BC Battle of Granicus (now the Biga River in modern-day Turkey) is Alexander the Great’s first major victory against the Persian Empire

Greece

333 At the Battle of Issus, Alexander defeats the army of Persia to control the western Persian empire.
332 (at age 24) Alexander the Great capture of Tyre fulfills Ezekiel 26:12,4-5,14
331 Alexander defeats Persian King Darius II in the Battle of Gaugamela (Arbela) in Persia (modern day Iraq) to establishes Greece as the world power.
326 Alexander’s invasion of India ends after the Battle of the Hydaspes.
323 Alexander dies in Babylon. Land distributed among his 4 Greek generals during the Hellenistic age:

Cassander rules Macedonia & Greece in the West
Ptolemy rules Egypt & Palestine in the South
Lysimachus rules Thrace & Asia Minor (Byzantium) in the North
Seleucus rules Antioch, Syria (Seleucia) & Mesopotamia in the East

322 Chandragupta founds Mauryan Empire in India.
312 Greek Seleucid dynasty reigns in Mesopotamia, with Seleucia as capital, infusing Hellenistic culture.

304 Egypt becomes independent under Roman general Ptolemy I.
301 Alexander’s successors fight at the Battle of Ipsus.
290 Foundation of library at Alexandria, Egypt.
285-270 Hebrew Bible translated into Alexandrian Greek Septuagint (=70=LXX in Roman numeral)
206BC-219AD The Han dynasty (named after a tributary of the Yangtsz river) begin 400 year reign in an empire similar in size and power to that of the Roman Empire. (Korea and Japan still call Chinese glyphs “Han”)

281-275 Pyrrhus fights in Italy and Sicily.

Roman Empire

List of Roman Emporers

264-146 Punic Wars between Rome and Carthage.
264-241 Rome wins control of Sicily from Carthagians under Hannibal in First Punic War.

262 Mauryan emperor Asoka becomes a Buddhist and sets up stupas containing a part of the Buddha’s body.
245 Agis attempts reform in Sparta.
241 Agis is executed by the rich of Sparta.

221 Qin Shi Huangdi unites China and becomes its first emperor.
222 Royal lines of Sparta ends.
218-202 Roman general Scipio wins Second Punic Wars against Hannibal.
214 Great Wall of China begins construction.
202 China reunited under Han dynasty.
198 Syrian Seleucid Antichus III rules.
197 Rome defeats Macedonia.
192-188 War between the Seleucids and the Romans.
168 Greece ends its dominance to Rome (two feet in Rev.).
167 Syrian Antiochus Epiphanes IV defiles temple with pig & statue of Zeus (Daniel 8:9-12)
164 (168-165) Judas Maccabee revolt, Hanukkah begins priestly Hasmonean dynasty

149-6 Rome destroys Carthage in Third Punic Wars.
146 Rome obliterates Corinth. All Greece becomes conquered territory.
135 Total exile of the Jewish people from Jerusalem by the Romans.
129 Jerusalem becomes an independent Jewish capital
112-106 Rome destroys Juguertia, King of Numidia
112 "Silk Road" opens from China to the West.
111 Han annexes North Vietnam.
100 Anasazi, Hohokam, and Mogollon people populate Southwestern North America.
100 BCE-250AD Yayoi (metal) period in Japan
84 Rome (Agricola) repeled by Scottish tribes in Battle of Mons Graupius.
74 Julius Caesar defeats Pharnakes, king of Pontus (now northeastern Turkey), son of Mithridates
73-71 Revolt of slave Spartacus vs. Rome
64 Roman general Pompey conquers Syria.
63 Roman general Pompey renames Judea & Palestine after subjecting them.
59 Julius Caesar named consul (highest rank) by the Roman Senate, begins to conquer Gaul and Britain.
53 Parthians prevent further eastward expansion of Romans.
Jan. 10, 49 Julius Caesar crosses the Rubicon from Gaul into Italy with his army to establish himself as a dictator over Pompey and the Roman nobility.
48 Julius Caesar defeats Pompey in the Battle of Pharsalus
46 BC, called the "Year of Confusion" because it consisted of 445 days due to an intercalary month being inserted to get public Roman feasts back to the correct seasons. This calendar change also moved the first day of the year from March 15 (the "Ides of March") when new Roman consuls take office (see Shakespear’s Julius Ceasar).
45 Julian calendar of 12 months and 365.25 days per year (with a leap year every 4 years) instituted by Roman Julius Ceasar.
40 Jimmu Tenno, first emperor of Japan
37 Herod the Great, ruling under Roman authority, builds 2nd Temple
31 Octavius defeats Mark Anthony and Cleopatra of Egypt, ending Roman civil wars at the Battle of Actium, Greece.
27 Octavius (Julius Ceasar’s adopted son) is renamed Augustus Ceasar and replaces Republic.
19 Herod finishes construction on Temple in Jerusalem.
15 (Ides of) March, 44 Assassination of Julius Caesar by Brutus marks the end of the Roman Republic See Shakespeare’s play.
14 Augustus deified by the Roman Senate–the first Roman ruler to be worshipped as a son of a god (divi filius).
4 Death of Herod the Great, Rome-appointed ruler of Judea, Samaria, Galilee, and surrounding territories. His son, Herod Antipas, took lands north of the Galilee and east of the Jordan River. Phillip took the areas east of the Sea of Galilee (the area now called the Golan Heights). Third son, Archelaeus, took the central portion which includes Jerusalem.

__ Pontius Pilot comes from Rome to be a military “Prefect” over Judea.
__ John the Baptist born (Isaiah 40:3 & Malachi 3:1)
__ Mary conceives after the Annunciation
__ Mary stays at cousin Zacharia & Elizabeth
John the Baptist starts in the 15th year of Tiberius Caesar (Luke 3:1-2). That’s between Aug - Sep 29 AD according to numismatic and inscriptional evidence.

Time of Christ

June, 2 BC (alternately, 6-7 AM Tishri 15 (Sep. 11, 3BC) or Tishri 1 (Sep. 8, 5BC) during the Feast of Trumpets, the first/former rain) Jesus, the Christ (the basis of Christianity) is born of Mary and Joseph in Bethlehem (while flocks are in pasture). [Quran 5:46]
Sep. 11, 3 BC (Tishri 1) wise men, guided by a Matthew+2:9 star, bring gifts fit for a king to the King of the Jews when he was about two years old. (4,000 years from Adam’s Fall)
Jesus’ family in Egypt (Matthew 2:13-15)

Fall, 29 AD Jesus begins his ministry over 3 Passovers (John 2:13, 6:4, 11:55, 12:1, 13:1, 18:28, 19:14)
(27/28) Jesus rides into Jerusalem (on a donkey) as Messiah the prince (the First Advent), as predicted in Daniel+9:24-26, but Matthew+16:1-4: not recognized by people at the time.

April 6 (Nizon 13), 29/30 AD Christ crucified (</a>Daniel+9:26 “cut off”) as Passover (Pesach) lambs were slain.

(Nisan 16) Ressurection (Easter) on the Feast of Unleavened Bread

Apostolic Age of Grace - The Early Church

NOTE: The time periods to follow are split based on John (and Jesus Christ’s) Letters to the seven churches in the Book of Revelation.

To the church in Ephesus –Revelation 2:1

9 AM, (Sivan 6) 30/33 AD Acts+2 Pentecost, birth of the Ephesians+1:22-23 Body of Christ, the Church, indwelt by the John+14:16-18 Holy Spirit (50 days after Jesus’ resurrection). Beginning of the Dispensation of Grace.

17-24 AD/CE Tacfarinas leads African Numidians in revolt against Romans.
35-36 AD/CE Saul of Tarsus, a Jew, comes to believe in Jesus as the Messiah and subsequently becomes the apostle Paul
42 Mark Anthony defeats Caius in Battle of Phillipi.
43 Romans invade Britain.
45 Julius Ceasar introduces the 12 month Julian calendar with leap years on advice of Alexandrian astronomer Sosigenes.

48/49 Council at Jerusalem with bishop James (the helf-brother of Jesus)–Acts 15:28

50 Paul leaves Antioch to begin his Aegean Mission. His letters to these congregations are the earliest documents in the New Testament.
50-52 Paul’s visits Corinth for the first time and writes his first letter to the 1 Thessalonians.
50 jew Philo writes
52 Paul visits Ephesus and writes a letter to the Galatians and the 1 Corinthians.
54-55 While imprisoned in Ephesus, Paul completes a second letter to the Corinthians and writes a letter to the Philippians and to Philemon.
56 First church Council - formed the Apostle’s Creed
57 Paul’s 3rd mission to Macedonia (Acts 22:17-21, 23:11)
58-60 Paul is imprisoned in Rome.
61-63 Roman forces move into Sudan.
64 Nero Claudius Ceasar (Lucius Domitius Ahenobarbus) persecutes Christians after Fire of Rome. Some believe he is the “beast” described in the book of Revelation.
64 (60-68) Peter martyred in Rome under Nero.
68 (60-65) Paul martyred in Rome under Nero.
69-79 Roman emporor Vespasian reigns.
70 (on 9th Av) Temple destroyed by Roman general Titus (eldest son of Vespasian) – as predicted by Daniel 9:26 “The people of the prince that shall come shall destroy the city and the sanctuary”) and Luke 21:24,27
70 Council at Jamnia codifies canon (books) of the Hebrew Bible.
100 Buddhism Spreads to China - 4th Council precipitates split of Theravada (hinayana) and Mahayana traditions.
70-100 Gospels of Mark, Matthew, and Luke written.
79 In Southern Italy, Mount Vesuvius erupts and destroys the town of Pompeii.
79-81 Reign of Titus.
81-96 Reign of the emperor Domitian (Vespasian’s younger son and the object of the anti-Roman attack in the Book of Revelation).
85 “Curse against Heretics” (Birkath ha-minim) added to Jewish synagogue benedictions, with the intent of excluding Christians.
90 Council of Jamnia produces Jewish scriptures in Greek.
94 jewish historian Flavius Josephus (37-100) publishes “Antiquities of the Jews”.

96 (90-110) John, the last apostle alive, while exiled on the island Patmos (Greek word for “mortal”), pens Book of Revelation (Greek word apocalypse which means disclosure, appearing, coming, uncovering, unveiling, and revealing).
96-98 Roman emperor Nerva reigns.
98-117 Roman Emperor Trajan reigns. In Dante’s Divine Comedy, Trajan is the only emperor allowed into heaven. He is so celebrated that all other Roman emperors are honored by the Roman Senate with felicior Augusto, melior Traiano (“may he be more fortunate than Augustus and better than Trajan”).

Roman Persecutions

Smyrna in Revelation 2:8

107-117 Ignatius (bishop of Antioch) is martyred.
117-138 Roman emperor Hadrian reigns.
112 Cornelius Tacitus, Pliny the Younger writes about Jesus.
120 Suetonicus writes about Jesus in Life of Claudius
132-135 Second Jewish revolt (the “Bar Cochba” revolt) against Rome.
136 Second Roman (Hadrian) conquest of Jerusalem.
~150 Justin Martyr (100-165) writes First Apology and Dialogue With Trypho defending Christianity as a “philosophy” worthy of the respect of the educated and as the only legitimate heir to the Israelite scriptures.
Irenaeus writes Against Heresies
119 Tertullian writes oldest Christian works in Latin
150 Invention of triangular lateen sails allow Mediterranean ships to tack into the wind.
156? Polycarp, bishop of Smyrna and younger colleague and admirer of Ignatius of Antioch, martyred.
161-180 Ceasar Aurelius persecutes and executes Christians.
185-254 Origen, early church scholar, writes Against Celsus and De Principiis

200-258 Novation caused split in Rome over what to do with Christians who avoided persecution.
220 Jewish Mishnah (commentary on the Bible) completed
200 Indian epics of Rmayana and Mahabharata composed. Creation of Hindu scripture Bhagavad Gita.
224 Sassanids come to power in Persia.
249-251 Persecution of the church by Decius.
265-420 The Qin (Ch’in) dynasty unifies China and standardized currency, weights, and measures.
251-356 Antony of Egypt, founder of monasticism, becomes the earliest hermit monk.
258 Bishop Cyprian, Catholic theologian, martyred

293 Diocletian divides Roman Empire in two.
303 Severe persecution of the church by Roman emperor Diocletian.
304 Invasion of Huns divide China.
October 27, 312 Battle of Rome’s Milvain Bridge leads to the succession of Constantine to the throne and conversion to Christianity.
320 Chandragupta I founds Gupta Empire in Northern India.
320 Pachomius, a hermit, starts communal monasticism.
325 Constantine calls Council of Nicea to settle Arian controversy with the Nicean Creed. First mention of the Temple Mount in Jerusalem. Worship of the sun on Sunday from Saturday (Ezekiel 8:14-16)
(260-340) Eusebius, Bishop of Caesarea, writes geography
372 Buddhism in Pyonyang, Korea
Athanasius (293-373), Bishop in Egypt, defends Christian Orthodoxy against Arianism.
391 First Japanese invasion of Korea.
420-589 Six Dynasties in China.

313-600 Byzantine Era / Age of Constantine (Dark Ages)

Pergamum in Revelation 2:12

324 Constantine’s Edict of Milan ends Roman persecution with toleration of Christians.
Flavius Theodosius (January 11, 347-January 17, 395) after reunited East and west fractions of the Roman empire as the last emperor of all Rome, declared Christianity the official state religion of the Roman Empire.
325 Lactantius tutors the son of Constantine.
325 Nicea Council issues Nicean Creed adopted 381
330 Constantine (280-337) establishes Roman capital in Byzantium (modern Istanbul, Turkey)
335 Queen Helena builds Church of the Holy Sepulcher
336 Catholic Church Council of Laodicea shifts services (Mark 7:7-9,13) to Sunday from Saturday (Ezekiel 8:14-16)
358/359 Patriarch Hillel II implements the modern Jewish Calendar (with disagreement about the proper years for intercalation and the initial epoch).

378 Goths (Germanic tribes) defeat Romans in Adrianople, Turkey.
(389-461) Patrick, a missionary to Ireland, encouraged asceticism.
391-2 Pagan worship (including the Olympics) outlawed throughout Roman empire.
395 The will of Theodosius I officially splits Roman Empire into Eastern and Western legs.
397 Council of Carthage defines Canon of 27 NT books; Jerusalem Talmud
382-405 Jerome completes Latin Vulgate (common) Bible in Jerusalem
399-414 Fa Hsien travels to India to recover Vinaya
401 Introduction of writing (kanji) to Japan
410 Rome sacked by Visigoths from the North
451 The 4th Council at Chalcedon clarifies orthodox Christology -

Christ as truly man AND truly divine without Monophysite confusion, mixture; or Nestorian separation.

476 Fall of last Roman Emperor; Roman monk Dionysius establishes Before Christ/Anno Domini calendar
476 Romulus Augustulus, the last Roman emperor, is overthrow. Apostles are scattered (Acts 8:1)
491 Armenian church founded.

520 Guptas of India invent the decimal system.
527-529 Canons of the Council of Orange
533 Ananthemas of the 2nd Council of Constantinople
533 Roman Emperor Justian retakes northern Africa.
538 Bishop Silverius of Rome allows Justian's army into Rome (fighting against Goths), and gets banished. Vigilus is appointed Pope (and the seat of Caesar) by Belisarius, Justinian's general. (Daniel 7:24) Popes begins 1260 year rule until 1928.
539 War between Persians and Byzantines
540-604 Gregory the Great, a monk, is Pope
(480-550) Bendict founds Benedictine monasticism
552 Buddhism brought to Nara, Japan
552 Justian restores Italy to Roman control
587 Visigoths convert to Christianity
589 Reunification of China under Sui dynasty
618-906 T'ang dynasty reunifies China
600 Babalonia Talmud codified
605 Augustine is sent by Pope to be a missionary to Celtic England.

604 Prince Shotoku establishes rule of law in Japan

Middle Ages

Thyatira in Revelation 2:18

614 Persians massacre jews in Jerusalem
610-June 7 During his annual monthly retreat within a desert cave on Mount Hira in Arabia, prophet Mohammed (PBUH), a camel driver from the Quraysh tribe asked to recite the Qur’an (recitation) from Jibril (the angel Gabriel). This is remembered during the 9th month each year with day-time fasting during Ramadan.
617? 618-906 T’ang dynasty in China
July 16, 622 Muhammad PBUH and his followers start a 200 mile Hijrah (migration) from Mecca/Makkah to Madina (now Saudi Arabia), an event marked as the first day of each Islamic new year (epoch)

627 Byzantine Emperor Heracles defeats the Persian army.
629-645 Chinese pilgrim Xuanzang collects Buddhist teachings in China, Cambodia, and India, then translates many of the surviving Sutra of the Mahayana Canon into Middle Chinese.
630 (Without a battle) Muhammad's 10,000 man army Jihad (struggle) restores the Ka'bah (first mosque) in Mecca.
632 (since Muhammed Recitations written in the Qur'an and hadith (words of the prophet) in the Sunna are written. It contains the Five Pillars of Islam (submission). These events are celebrated on Isra' 632 Muhammad PBUH dies in Mecca, and ascends to Mi'raj (heaven) from the temple mount. His father-in-law, Abu Bakr, is elected by Sunni tribal leaders as the Rightly-Guided caliph (successor).
634 Abu Bakr dies after appointing Umar I caliph, who then conquers Jerusalem, Byzantine Damascus, and Syria.
635 Buddhism spreads to Tibet
636 Arabs under Kalid ib-al Walid defeat Byzantines in desert sandstorm at Yarmul (now Isreal).
644 On his deathbed, Umar names a council which chose Uthman the next caliph, who conquers Persia (Iran).
656 Ali (cousin/son-in-law to Mohammed PBUH) named first Iman by Shiites (party of Ali) in Iraq.
657 Al Aksa Mosque construction begins in Jerusalem. “Desolation of abomination" is placed in the Holy Place.
661 Muawiya takes over as a Sunni caliph after Ali is murdered, beginning the Ummayad dynasty which advanced into Africa.
665 Muslims conquer Arabs in the Battle of Basra, Iraq.
664 Synod of Whitby - Roman Church authority (based on lineage from St. Peter) chosen over Ionian Celtic traditions (for Easter) by Northumbrian King Oswy.
670 Silla Kingdom defeats other kingdoms in Korea.
687-714 Pepin II rules after uniting the Franks.
688-691 Dome of the Rock built in Jerusalem's Temple Mount by caliph Abd al-Malik (9th Caliphate 685-705), who also mints purely Muslim coins and declares Arabic the official language.
700 Masorites divide Tanache (Old Testament) into chapters
711-715 Muslims Conquor Spain
726 Byzantine Emperor Leo III declares himself also pope of the Eastern church order after ignoring complaints from icondule Roman Pope Gregory II over iconoclasts destroying the picture of Christ on the gate of Constantinople (modern-day Istanbul, Turkey).
732 Muslims reach their limit of European expansion when defeated by Charles Martel (“The Hammer”) and his army of French Franks in the "Battle of Tours" at the Loire River.
750 The Abbasids, headed by al Abbas, gain control of the Muslim Empire. Abu Jafar al Mansur moves Muslim capital to Baghdad in Mesopotamia, beginning a golden period when al Khwarizmi invented algebra (al jabr).
756 After escaping, Abbasid general Abdullah reunites the Umayyad government in Spain; Abd al Rahman begins to build The Great Mosque and libraries in Cordoba, Spain.
768 Germanic leader Charlemagne named emperor of the former Western Roman empire.
787 Second Council of Nicea (Seventh Ecumenical Council)
800 Charlemagne crowned Emperor by Roman Pope at Aachen.
July 16, 869 "Great Filoque Schism" of Roman & Byzantine Church (1054?)
844 Defeat of Picts unites Scotland.
861 end of Abbasids empire. ## 500-1500 Medieval History 868 The first printed book, the Diamond Sutra, is made in China using wood blocks.
878 Egyptian Ign Tulum rules
907-960 Five dynasties and Ten Kingdoms in China
925 Shisak of Egypt destroys Jerusalem
960-1129 Northern/Southern Sung dynasties in China
939 Chinese rule in Vietnam ends
960 Founding of Sung Dynasty in China
962 Coronation by Pope of Otto I as Emporor of the Roman Empire.
969 Descendents of Fatimid (a daughter of Mohammed) conquer Jerusalem from Cairo and North Africa.
982 Viking warrior Erik the Red settles Greenland.
1003 Leif Eriksson (son of Erik the Red) sails down North America and names it "Vinland."

In Dalmatia (Yugolavia) Croats use Roman alphabet, Serbs loyal to Eastern Constantinople church use Cyrillic alphabet invented by missionary brothers Cyril and Methodius.
1008-1020 Tale of Genji written in Japan
Inquisitions by Pope Innocent.
1044 Gunpowder invented in China.
1053 Western Church insists on the celibacy of its higher clergy. 50 years later church excommunicates all married priests.
1054 Orthodox Eastern church and Roman Catholic church separate after excommunicating each other in a Great Schism.
1055 Seljuk Turks from central Asia conquer Baghdad.
1066 French under William the Conqueror beats Saxon England in the Battle of Hastings at Norman, England
1071 Byzantine era when muslims defeat Islamic Ottomans at Anatolia (now Western Turkey).
1085 Spanish Alfonso VI takes Muslim city Toledo.
1086 English Doomsday Book published.
1095 Roman Pope Urban II calls for a holy crusade to protect Christians against muslims on pilgrimages to Jerusalem, And help Italy capture trade through Constatinopole Byzytine (Greek Orthodox) church territory.
1096 First crusades begin.
July 15, 1099 Crusaders enter Jerusalem.
1104 Crusaders take Acre in Isreal from muslims referred derisively as saracen (roughly meaning "Easterners").
1169 Muslim Saladin becomes King of Cairo, Egypt.
1170 Thomas Becket (born 1162), Archbishop of Canterbury, is murdered for standing up against the English King.

1187 After luring Crusaders to a waterless plateu in July and decimating them, Saladin ("rectifier of the faith") captures Jerusalem from crusaders led by consort Guy de Lusignan (after he was expelled by the Duke of Aquitane, who later became Richard I).
1187 Medieval Knights restore Jerusalem during 2nd crusade.
1189 Jews in England massacred during the coronation of Richard I.
1191 Zen Buddhism introduced to Japan by Chinese monk Eisai.
1200 Inca civilization forms to peak in the 15th century.
1204 Constantinople sacked by crusaders during the 4th Crusade.
1206-1227 Genghis Khan establishes the Mongol Empire
June 15, 1215 Magna Carter of liberty signed by king John to avert English Barons' War.
(1182-1226) Francis of Assisi establishes the Franciscan order.
1228 Stephen Langston divides the New Testament Bible into chapters.
(1225-1274) Thomas Aquinas' Scholasticism separates Grace from Nature
1234 Sun Diata founds the Mali Empire in West Africa.
1235 Mali defeats Ghana to become the major power in West Africa.
1236 Cordoba, Spain falls to Christian forces, leaving Berbers in Granada.
1241 King Bela IV of Hungary defeated by Mongolian Golend Horde in the Battle of Mohi.
Marco Polo (1254-1324) at age 16 journeys from Venice, Italy to China.
Feb 10, 1258 Abbasid-Seljuk Baghdad (and its libraries) falls to cavalry of Yuan dynasty (1271-1368) (Tartars) commanded by nomadic Mongols Kublai Khan (1215-1294), grandson of Genghis Khan. Paper currency first instituted.
1274 Mogol invade Japan
1275-1292 Marco Polo in China
May 1281 KubliKhan's Mongols invade Japan. Although initially successful at Tsushima, were thawrted by Kamikaze (divine/god-wind) typhoons VIDEO
1291 Crusades end after 8 wars.

1304 The first "humanist," Francesco Petrarca (1304-1374) is born to become a poet and "father of the Renaissance"
1325 Ibn Battuta (1304-1368) travels from Morocco throughout the Muslim world. VIDEO
1345 Black Plague wipes out 30%-50% of Europe
1345-1521 Aztec civilization in central Mexico peaks, just when the Spanish conquistadors arrived.
Dominican nun Catherine of Siena (1347-1380) works miracles.
1356 Koreans overthrow Mongols
John Wycliffe (1329-1384) translates Latin Bible into English & converts England
Timur the Lame (1369-1405)
1368-1408 Yoshimitsu is third Shogun of Japan
1368-1611 Ming (“brilliant”) dynasty in China
July 6, 1415 Bohemian pastor John Hus, singing, burns for heresy in Prague.
1453 Ottoman Mehmet II of Turkey captures Constanopole and ends the Byzantine empire.
1467-1477 Onin War burns everything in Japan ## 1517-1648 Renaissance/Reformation Sardis in Revelation 3:1 (nothing good about them)
1429 French heroine Joan of Arc lifts English seige of Orleans, France.
1448 Russians under Jonas become autosepholis - self governing religiously.
1453 Turks capture Constantinople (in Türkiye) to end the Byzantine empire.
1455-1485 30-year War of the Roses between Houses of York and Lancaster for the English throne
1456 Gutenberg produces German Bibles using movable type
1462 Russian Grand prince Ivan, in marrying Sophia, niece of Constantine, unites church and state
1469 Sikhism (monotheistic non-ceremonial) religion formed by Guru Nanek in India.
1473 First book printed in English, a translation of French stories about the Trojan Wars.
1492 Sulan Muhammad XI surrenders Muslim rule in Alhambra, Spain to Ferdinand of Aragon and Isabella of Castile.
1492 Columbus sails the ocean blue while Sephardic Jews are expelled from Spain (on Tisha B'Av), and Mulims flee to Berber Morocco, North Africa.
1497 John Cabot explores the coast of Newfoundland.
1497 Vasco da Gama voyages around the Cape of Good Hope for a sea route to India.
1499 Amerigo Vespucci locates mouth of the River Amazon.

1512 Michelangelo completes Sistine Chapel frescoes in the Vatican Palace of Pope Julius II (1443-1513), who reigned from 1503 to 1513.
1513 Vasco Nunez de Balboa crosses the Panama Isthmus to discover the Pacific Ocean.
1516 Desiderium Erasmus of Holland is first to publish Greek New Testament.
1517 Ottoman Selim I captures Jerusalem
Oct 31, 1517 Monk Martin Luther (1483-1546) starts the Protestant Reformation by publishing his 95 Theses on the door of his church in Wittenberg, Germany.
1519 Ferdinand Magellan leaves Spain to make the first sea voyage around the world.
1525 Led by students of Urich Zwingli in Zurich, Brethren (nicknamed "Anabaptists" for their insistance on adult rather than infant baptism) break from the state-controlled churches in Germany and the Netherlands. Those who follow one of their leaders, Menno Simons (1496-1561), called "Mennonites".
1526 Babur conquers Delhi, India Battle of Panipat establishing the Mughal empire.
1527 Sack of Rome by Imperial troops
1529 September VIDEO: The First Siege of Vienna by 120,000 men led by Suleiman the Magnificent stopped by 16,000 Christians
1534 Henry VIII's Act of Supermacy breaks England from papal supremacy by declaring the king of England to be the head of the Church of England.
1535 Miles Coverdale finishes the first complete, printed Bible in English.
1536 John Calvin (1509-1504) writes Institutes of The Christian Religion
1534 Martin Luther translates the entire Bible into German.
1536 William Tyndale (b 1490) executed and burned in Vilvorde, Belgium for translating the New Testament Bible into English (from Greek manuscripts). His last words: "Lord! open the King of England's eyes."
1537 King Henry VIII of England authorizes the "Matthew's Bible" and allows it to be sold and read.
1539 Copernicus (1473-1543) in Poland publishes (after 30 years) De Revolutionibus (of Ptolemiac theory from Egyptian Claudius Ptolemy about 150 AD) a theory that the Earth is not the center of the universe
1538-41 Sultan Suleiman the Magnificent occupies Jerusalem.
1545 The first Council of Trent (near Salzburg), convened under Pope Paul III, defined Catholic counter-reformation doctrines, including the pope as "Vicar" of Christ on Earth.
1549, 2 years after the death of Henry VIII, Thomas Cranmer, before being burned as a heretic in 1556, defines Anglican theology (such as "transubstantiation") by publishing the first Book of Common Prayer used in English worship services.
1551 Robert Stephens Estienne of France divides New Testament verses in the Bible.
1555 Peace of Augsberg reached by Catholic Charles V with Lutherans.
1557 Portuguese establish settlement in Macao, China
1565, on St. Augustine's Day, Pedro Menendez de Aviles arrived to establish America's first city on Florida's Atlantic coast.
1557 first Index of Forbidden Books officially issued under Catholic Pope Paul IV
1556-1605 Mughal Empire prospers in India under Akbar (the Great).
1571 Battle of Lepanto in Greece ends Turkish seapower in the Mediterranean.
4-15 Oct. 1582 Based on a committee led by Naples astronomer Aloysius Lilius, Pope Gregory XIII issues bull "Inter Gravissimus" to implement the Gregorian calendar, fixing vernal equinoxes at 21 March each year and taking 10 days out of the Julian calendar.
1588 Spanish Armada of 130 ships defeated by storms and the British fleet.
1598 French Hugonaughts retreat after Edict of Nant
1590 Hideyoshi Toyotomi (1536-1598) unifies Japan
1565-1616 Shakespeare, the Bard, writes!
1611 "Authorized" King James Version of Bible published in English
Galileo (1564-1642) proposes earth not center of universe
Isaac Newton (1642-1727)
1603 Tokugawa Ieyasu takes feudal control. Makes Edo political center of Japan, beginning 300 years of peace.
Sep 11, 1609 Henry Hudson arrives on Manhattan Island and meets the indigenous people living there.
1610 Henry Hudson claims New York Hudson Bay for England.
1618-1648 Thirty Years War between German Catholics and Protestants.
1619 a Dutch ship brings the first African slaves to the English colony of Virginia.
16xx upon Iaysu's death, grandson Imaitsu begins parades to Edo by regional daimyos.
1620 Mayflower Compact drafted by Puritan Pilgrims upon their landing at Provincetown on Cape Cod, Mass.
1623 William Shakespeare's plays are published in book form for the first time.
(1624-1691) George Fox establishes the Quaker church.
1644-1911 Ch'ing dynasty rules into a republic
1640 John Harvard establishes university to educate clergy in Boston.
1648 Peace of Westphalia ends 30 Year War.
1649 King Charles I executed. England is a Republic until monarchy is restoed in 1660.
1663 Puritan John Eliot translates a Bible for the Massachusetts Indians.
(1628-1688) John Bunyan, English minister and preacher, writes Pilgrim's Progress.
12 September 1683 Ottomans under Kara Mustafa Pasha defeated by Polish King John III Sobieski (with funding from the Holy Roman Empire and German troops under 3Charles of Lorraine) at the 2nd Turkish siege of Vienna on the Danube.
1693 Jacob Ammon and his followers in Old Order Amish break from Mennonites.
1699 Guru Gobind Singh organizes Sikhs into the Khalsa (brotherhood of man). ## Awakening 1648-1844 > Philadelphia in Revelation 3:7-13 Israel ben Eliezer (1700-1760) the Ba'al Shem Tov (Master of the Good Name) Hasidism from the Ukraine
1704 British Duke of Marlborough limits French power in Battle of Blenheim, Germany.
1709 Peter the Great of Russia defeat Swedes under Charles XII to control the Baltic Sea in the Battle of Poltava, Ukraine.
(1703-1791) John and Charles Wesley (author of Easter hymn "Christ The Lord Is Risen Today" initiate the Methodist movement.
1734-1770 Great Awakening led by Jonathan Edwards from Boston, MA. On 8 July 1741 delivers Sinners in the Hands of an Angry God and other other sermons
Easter, 1742, Handel's Messiah first performed in Dublin, Ireland.
1752 England and the American colonies had 354 days becuase of a calendar change lost 11 days.
1756-1763 England and Prussia wins Seven Years War against Austria and France over control of Germany.
1759 Britain gains control of Canada in the Battle of Quebec.
April 1, 1775 "Boston Tea Party" rebellion for British Stamp Act under King George III.
April 19, 1775 the first shot of the American Revolutionary War begins after Paul Revere rides from Boston toward Lexington and Concord, shouting "the Regulars" (English army, 700 strong) are coming. Over a 1,000 militia poured onto the Battle Road killed over 270 British soldiers vs. 95 colonists.
July 2, 1776 Declaration of Independence from Britain is signed by 2nd Continental Congress meeting since May in Philadelphia.
July 4, 1776 Declaration of Independence is read from the Old State House in Boston.
October 17, 1777 British Gen. Burgoyne surrenders 5,800 men to Americans after the Battle of Saratoga, New York. This turning point convinced the French of U.S. strength.
October 19, 1781 Cornwallis, trapped on the Yorktown, Virginia peninsula, surrends to George Washington's American and French forces in this final victory over Britain.
November 30, 1782 Articles of Peace officially frees America from England. See Liberty! (the PBS series)

1788 William Carey starts the India Missionary movement.
1788 The Constitution of the United States is ratified by the states with the Bill of Rights.
1793 William Carey goes to India as a missionary from England. Besides building schools and hospitals, he translates and prints portions of the Bible in 45 languages and dialects of India.
1792-1815 Napoleonic Wars are fought by Napoleon's France against Austria, Britain, Russia, Prussia, and Sweden.
1793 American Eli Whitney invents the cotton gin.
1798 Nepolean's general enters Rome to depose pope (Rev. 13:15, 17:10), ending 42 months=years (Ezekiel 4:6) of papal supremecy.
1797 Napoleon conquers Venice
1799 Rosetta Stone found in Egypt during Napoleon's campaign in Egypt. Went to Berlin, then to the British Museum in 1802. The three languages saying the same things was the key to deciphering Egyptian hieroglyphics. It's now in the Grand Egyptian Museum in Cairo (GEM).
1805 Unitarians take over Harvard University board
1805 British admiral Nelson destroys French and Spanish fleet in battle of Trafalgar (South of Spain).
Feb. 23 1807 Wm. Wilberforce gets Brit. Parliament to abolish slave trade.
1806 Frances II renounces the title of Roman Empire.
1808 importation of slaves from other countries banned by U.S. Congress
1821-1829 Greek War of Independence from Turkey.
June 18, 1815 Napoleon defeated by British Duke Wellington at Waterloo, Belgium. ;)
1821 Charles Finney (1792-1875) conducts evangelist campaigns through New England before pastoring Oberlin, Ohio.
1825-1830 Java War of Indonesians against Dutch.
1830 Mormon church is organized by Joseph Smith at Nauvoo, Illinois.
1839 The first baseball game is played in Cooperstown, NY. Phtography invented.
1839-1842 Opium War in China results in Britain taking Hong Kong and Portugal taking Macao.
1840 Horace Mann establishes Unitarian public school in Massachusetts.
1841 Dr. David Livingstone (1813-1873) evangelizes southern Africa
1844 The Turkish Empire's Edict of Toleration allow Jews to live in their original homeland. 1844+
"Modern" History of Apostasy and Lukewarm Church Laodicea in Revelation 3:14-19

May 23, 1844 (Islamic year 1260) young Persian Mirza Ali Muhammad (later executed July 1850), declares himself the promised Qa'im of Shi'ah Islam and assumes the title of The Báb (Gate) and initiates the unifying Baha'i faith.
1844 Brigham Young becomes president of the 'Quorum of Twelve Apostles' after Smith is killed by a mob.
1845-6 fungus on potatoes from America (and British rule) creates a famine in Ireland.
1846-1848 Mexican-American War.
June 19, 1846 first baseball game played at Elysian Fields in Hoboken, New Jersey
1848 Karl Marx and Frederick Engels publish the Communist Manifesto in London
1848 Gold discovered at Sutter's Mill (Sacramento, CA)
1850 U.S. Congress passed the Fugitive Slave Law. The Underground Railroad is formed in response.
1853-1856 Crimean War in the Black Sea. Turkey, Britain, France, and Sardinia fight Russia.
1853 American Admiral Matthew Perry's black ships (kunefune) enter forbidden Tokyo Bay to demand terms.
Feb. 1854 Perry returns to demand regulated trade with Japan
1858 The 15th shogunate steps down in Japan.
Jan 1, 1859 - First Modified Julian Date
1859 Darwin publishes The Origin of Species with forward by Karl Marx
Apr. 12, 1861 Charleston's Fort Sumter in S.C. starts the American Civil War.
October 24, 1861 Western Union completes the transcontinental telegraph service
July 21, 1861 Confederates under Irvin McDowell lose at the first Battle of Bull Run.
September 17, 1862 Battle of Antietam, Maryland is the bloodiest one-day fight during the Civil War, with more than 20,000 men killed, wounded, or missing.
Summer, 1862 The Union's Paninsula Campaign in the Shenandoah Valley and Williamsburg toward Richmond, VA fails. General John Pope is sent West to deal with a Sioux uprising.
17th September, 1862 Ambrose Burnside replaces McClellan and attacks the armies of Robert E. Lee and Thomas Stonewall Jackson at Antietam.
Sep. 22, 1863 Emancipation Proclamation (of slaves only in rebellious states) issued by Abraham Lincoln.
1862 Constantine von Tischendo
1869 the Codex Sinaiticus Greek manuscript is discovered
1863 Bahá'u'lláh (The Glory of God) whom Bahá'ís follow is announced as the One for Whom The Bab had prepared the way.

Nov. 19, 1863 Abe Lincoln delivers Gettysberg Address on the Civil War
1864 “In God We Trust” first appears on US coins.
April 14, 1865 Lincoln assassinated
1868 Emporor moves from Kyoto (Western capital) to Tokyo (Easter capital)
1869 Meiji Restoration (of the Japanese emperor to power for the first time since the Heian Period)
1870-1871 Franco-Prussian War ends with establishment of Germany.
1886 Dr. J. Pemberton sells his new drink, Coca-Cola, as a “brain tonic”.
1873 Remington Company mass-produces in America the first modern typewriter.
1878 Petah Tikvah in Judea and Rosh Pinnah in Galilee are first Jewish villages in Palestine, the planting of modern Israel.
1882 Chinese Exclusion Act bars (for 60 years) Chinese immigration into the US.
1892 Beginning of Zionist return to Jerusalem
1893 Henry Ford builds his first car (automobile).
1894-5 Japan invades Korea, China in Sino-Japanese War
1895 The Niagara Bible Conference listed five unalterable requirements of belief for a fundamentalist individual or group
1895 Sigmund Freud publishes first work on psychoanalysis, determinism
Hudson Taylor evangelizes Inland China
1896 Billy Sunday begins leading revivals in America
1896 Theodor Herzl (1860-1904) becomes the father of political Zionism by publishing Der Judenstaat (The Jewish State), which proposes a Jewish state in Palestine.
April, 1896 First modern Olympics held in Athens, Greece with 484 athletes from 13 nations.
Feb. 15, 1898 bombing of USS Maine starts Spanish-American War
10 Dec 1898, in the Treaty of Peace in Paris, Spain renounced all rights to Cuba, ceded Puerto Rico and Guam to the US, and gave up its possessions in the West Indies, and sold the Philippine Islands.
August 29—31, 1897 First Zionist Congress meets in Basel, Switzerland led by Theodor Herzl
1899-1902 Boer War ends with British control of South Africa.
Dec. 17, 1903 Wright brothers of Akron, Ohio fly first motorized bicycle/airpline named "Bird of Prey" at SC.
April 18, 1906, 700 San Franciscans die in the deadliest earthquake in North American history.
Speaking in tongues initiates the Azusa Street Pentecostal Revival in Los Angeles.
1913 U.S. Federal income tax law passes
1914-18 on Tisha B'Av, WWI sparked by murder of Ferdinand in Yugoslavia, starts.
May 7, 1915 United States enters WW I after a German U-boat sinks the passenger ship Lusitania owned by JP Morgan. 123 Americans were among 1,195 lives lost.
1916 Battle in Somme, France kills 1,265,000 men in less than a week.
Jan 17, '17 Virgin Islands becomes a US territory.
Dec. 8, 1917 (7 times 360 years or 2520 years punishment of apostate Israel for her unfaithfulness prescribed in Leviticus 26: 24 & 28) British general Lord Allenby enters Jerusalem after the Turks panicked and left Jerusalem without a shot being fired. An Islamic prophecy predicted that the Turks would lose the city when a man of Allah delivered a notice. The Propaganda leaflets dropped on the Turks were signed by Lord Allenby. When the Turks fled, they left behind a letter of surrender which was brought to the Christian General Allenby when he and his officers were praying.
1917 British Balfour Declaration "His Majesty's Government view with favor the establishment in Palestine of a National Home for the Jewish people" begins second Jewish Exodus.
November 11, 1918 Armistice Day end of World War I when Allied powers signed a cease-fire agreement (truce) with Germany in the Forest of Compiegne at Rethondes, France. Renamed to "Veterans Day" in 1954.
1921 Prohibition in America
July, 1925 schoolteacher John Scopes is found guilty of violating the Tennessee Butler bill against teaching evolution in the "Monkey Trial." The first American trial to be nationally broadcast on radio. Christian fundamentalism lost ground.
1928 Alexander Fleming discovers penicillin. ### Lateran Rome Recovery
1926 controversial Father Coughlin creates a radio congregation in the US.
Feb. 11, '28 Dictator Mussolini signs Lateran Pact to settle the "Roman Question" by establishing Catholic Vatican as a sovereign state within Italy. (healing the wound).
Jan 30 '33 President Paul von Hindenburg appoints Hitler Chancellor of 3rd Reich of Germany
Nov 10 '38 Kristallnacht (Night of Broken Glas) riots destroy Jewish businesses and synagogues throughout Germany
'36 African-American Jesse Owens wins Berlin Olympics
Jan 13 '41 Puerto Rico becomes a US territory.
April 6 '41 Nazis begin bombing Belgrade, Yugoslavia
Dec 7 '41 Japanese bomb Pearl Harbor, US enters WW II
Dec 25 '41, British-Canadian garrison at Hong Kong surrenders to Japanese.
4–7 June '42 Japan fail to capture Midway Island from the US, the turning point for the Pacific war.
June 6 '44 D-Day, Allied troops land at Normandie, France.
May 8 '45 Victory in Europe (VE) Day when Germany surrendered to the Allies.
June 26, '45 United Nations charter (in Chinese, English, French, Russian, and Spanish) was signed by 50 countries in San Francisco.
5:29 a.m. MWT (11:29:21 GMT) July 16, 1945, the first atomic bomb was tested by the Mahattan Project at the Trinity Site near Alamogordo, New Mexico.
Aug. 6 45 atomic bomb dropped by "Engola Gay" on Hiroshima, Japan, killing 140,000 people.
Aug. 9, 45 atom bomb dropped by "Bock's Car" B-29 on Nakasake, Japan. Victory in Japan (VJ) Day.
'47 Evangelist Billy Graham begins crusades in Charlotte, NC
'49 Russia detonates their first atom bomb, beginning the Cold War. NATO forms.
May 12, 49 Blockade of Berlin ends.
Jul 4, 47 UFO crash outside nuclear air force base in Roswell, New Mexico May 14, 1948 Israel declares Independence to avoid being Ezekiel+37:19 - partitioned (fulfills Ezekiel 4:3-6, Ezekiel 48, Leviticus 26:18) after 2nd seige by Egypt (Ham), TransJordan, Labanon, Saudi Arabia (Sheba & Dedan), Syria & Iraq (Shem).
'48 Essenes' Dead Sea scrolls from before 68 AD found in Qumram caves
Oct 1, 49 The People's Republic of China is formally established.
June 25, 50 US-Korean War begins when North Koreans cross 38th parallel.
'52 Bishop Sheen draws 30 million viewers to his "Life Is Worth Living" TV show.
Feb 28 '53 Watson and Creek model the DNA.
'53 Edmund Hillary and guide Tenzing Norgay make first ascent of Mt. Everest
June 25 '62 Supreme Court bans prayer in school in in Engel vs. Vitale, the first case in which the Supreme Court did not cite any previous precedents or legal cases in making its decision, creating the phrase "separation of church and state".
60's Vietnamese War, Peace marches,
April 12, 1961 Soviet Cosmonaut Yuri Gagarin is the first human put into space.
Feb 2, '62 The Earth's moon, Mercury, Venus, Mars, Jupiter, and Saturn all align in the constellation Aquarius.
1965 Jewish atheist psychologist Helen Schucman writes A Course in Miracles
October 30 1961 USSR detonates 50 megaton (2600 times the Hiroshima bomb) over Novaya Zemla Islands. June 5-10 '67 Israel regains Jerusalem after 3rd seige "6 Day War". —the 'Sign of the End of the Age' Luke+21:24 "Times of the Gentiles" fulfilled by the Matthew+24:32-34 "leaves spouting from the Fig Tree" with young Israel at 19 years of age.
June 8 '67 Isreali troops reenter temple area (1035 yrs after 632 AD) as predicted in Zecharia 2.
'67 Martin Luther King delivers "I Have a Dream" speech in Wash. DC
__ KSFG, first Christian radio station starts broadcasting from Los Angeles.
__ Roe [Mary McDonald?] vs. Wade legalizes abortion
November 22, '63 John F. Kennedy is assassinated
July, '69 Neil Armstrong and Buzz Aldrin are the first men on the Moon
'69 California is the first state to adopt no-fault divorce.
October 1969 The Internet is born with a message transported across the ARPAnet from UCLA's Network Measurement Center to Stanford University.
Apr 29 '75 Saigon falls when Americans leave.

Sept. 17 '78 Israel makes peace with Egypt (Is this Ezekiel 29:6-7)
Nov. '78 Jim Jones orchestrates the mass suicide of 912 People's Temple followers in Jonestown, Guyana.
Nov 4 '79 - 52 American hostages begin 444 days in Teheran, Iran
'80 Supreme Court removes 10 Commandments from Kentucky schools
'84 Yogi Shri Haidakhan Babaji (b. 1970) dies in Haidakhan, India after predicting a Great Revolution. He taught Truth, Simplicity, and Love with Karma Yoga (service to humanity)
Nov 4, '86 Virgin Islands becomes a US territory.
'87 Supreme Court bans Creationism from Lousiana high schools
Jim & Tammy Bakker
Aug. 2, 1990 Iraq invades Kuwait to spark US Desert Storm war
Aug. 7, '90 American forces arrive in Saudi Arabia — what some see as violating the "one religion" in the holy muslim land of Mecca and Medina.
Nov. 17 '90 Non-Aggression pact signed between NATO and the Warsaw Pact countries.
Dec. 25 '91 Gorbachev announces "I cease my activities as President of the U.S.S.R." — ending the Soviet Union.
'91 Promise Keepers started by coach McCartney
Aug. 21-22 '92 FBI kills "white separatist" Randy Weaver and family at Ruby Ridge, Idaho
Sep. 13 '93 Jimmy Carter arranges a 7-year “Peace Accord” Oslo Accords & handshake between Anwar Sadat & Menakim Bagin (fulfills Daniel 9:27?)
'93 FBI burns down Waco, TX compound of David Koresh and his Branch Dividians
Apr '94 Mandela (age 75) elected first black President of South Africa

May 5, '94 Palestinians take Israeli controlled Jericho and 25 square miles of the Gaza strip. (See Joshua 6:26)
Black churches are burned.
U.S. withdraws from Somalia after an attack supported by Bin Laden.
Louis Farakah's Million Man March to Washington DC
Apr. 19 '95 Tim McVay bombs federal building in Oklahoma City, killing 168.
'96 O. J. Simpson tried and acquitted (media circus)
'96 Matching christian charity money scheme collapses
Oct. '96 First Promise Keepers rally at Washington DC
'97 Hale-Boppers commit suicide
'97 Monica and Bill Clinton - All the President's Women
Jan 1 '99 Single European currency (with 11 of the 15 EU member states)
Columbine High School shooting.
Jan 1 2000 Millenium madness doesn't happen. Boris Yeltzin hands power to KGB Director Putin.
March 20, '00 the Internet bubble bursts as NASDAQ peaks at 5,500.
June '00 human genome is mapped.
Sep 11, '01 Al Queda — led by Bin Laden, a Saudi Sunni in Afgahnistan — sends 4 plane into NY WTC, Pentagon.
2002 Isreal's Jubilee year in the traditional calendar.
2002 US invades Iraq to replace Iraq's Sunni-led dictatorship with an elected government dominated by the country's Shiite majority. Ironically, Iraqi democracy strengthens Shiites in Iran and Lebanon.
July 7, 05 Four bombs go off in London
Feb 06 Syria leaves Lebanon.
July 06 (9th of Av, Tisha b'Av) Israel failed to decisively win Iranian-Syrian backed Shiite Hezbollah in Lebanon.
2007-8 US subprime mortgage crisis followed by a recession
2009-10 US healthcare reform
2010-11 US Tea Party
2011-12 US Occupy Wall Street
Biblical signs in the sky on September 23, 2017 based on Stellarium.org software. A month later Trump announced moving the US embassey to Jerusalem. Some use that as the beginning of "7 good years" before the "7 bad years" of the Tribulation.
2023-05-06 King Charles III coronated in England
2024-04-08 "Blood moon" "Eclipse of the Century" over the Eastern US.

## Predictions about the Future Apophis asteroid Apr 13, 2029.

## References Those who receive God's seal upon their foreheads are "God's commandment-keeping people." "Here is the patience of the saints: here are they that keep the commandments of God, and the faith of Jesus" (Rev 14:12; Testimonies, 6:15). Jack Finegan, Handbook of Biblical Chronology, Revised Edition, Hendrickson, 1998. _{25-12-13 v026 + vienna :2023-09-02-history.md 2025-12-13 00:00:00 +0000}

(Dates in) History was originally published by Wilson Mar at Index on December 13, 2025.

Xcode (install on MacOS)

2025-12-13T00:00:00+00:00

Homebrew, Python, and other development tools require utilities included in Apple’s Xcode IDE or in Command-Line utilities installed separately. Thus the conflicts.

Overview

XCode on Mac Deskbooks are used to develop and test apps running iPhones and iPad.

Overlapping utilities installers!

PROTIP: Apple’s XCode is installed with several utilities:

gcc - the C language compiler
cc
make
git

These are needed by developers running HomeBrew, Python, and other programs on Macs.

CAUTION: The confusion is that these utilities needed (above) can be installed two different ways into two different folders:

If utilities were installed using Apple’s Xcode IDE (GUI):

$HOME/Applications/Xcode.app
Developers NOT developing apps to run on an Apple platform (macOS, iOS, etc.) don’t need the XCode IDE GUI, so can install just the CommandLineTools into:

/Library/Developer/CommandLineTools

Install steps

Apple provides a command that either installs CLI tools or show the path of the CLI installed.

Open a Terminal (by pressing command+spacebar and typing “T” to select Terminal).

In the Terminal Shell Window, type:

xcode-select --install

Alternately, copy and paste this Apple’s osascript:

xcode-select --install > /dev/null 2>&1
if [ 0 == $? ]; then
 sleep 1
 osascript <<EOD
tell application "System Events"
 tell process "Install Command Line Developer Tools"
     keystroke return
     click button "Agree" of window "License Agreement"
 end tell
end tell
EOD
else
 echo "Command Line Developer Tools are already installed!"
fi

If already installed you would see one of the two paths above.

If NOT installed, you’ll see:

xcode-select: note: No developer tools were found, requesting install.
If developer tools are located at a non-default location on disk, 
use `sudo xcode-select --switch path/to/Xcode.app` to specify 
the Xcode that you wish to use for command line developer tools,
and cancel the installation dialog.
See `man xcode-select` for more details.

Press command+Tab as many times as needed to select the utility icon. This dialog should appear:
Click “Install” for “Downloading”.
If “Stop” is clicked, the install would resume where it was interrupted.
Click “Done” when “The software was installed.” appears.
Repeat the command above
- If XCode CLI was installed, you should see:
- If XCode.app was installed, you should instead see:
Path of gcc
To identify the path to one of the utilities listed above, such as gcc, use the xcrun utility that comes with macOS:
```
xcrun --find gcc
```
If Command Line Utilities are installed, the response would be:

/Library/Developer/CommandLineTools/usr/bin/gcc

If Xcode.app is installed, the response would be:

/Applications/Xcode.app/Contents/Developer/usr/bin/gcc

If neither is installed:
```
xcrun: error: active developer path ("/Library/Developer/CommandLineTools") does not exist
Use `sudo Xcode-select --switch path/to/Xcode.app` to specify the Xcode that you wish to use for command line developer tools, or use `Xcode-select --install` to install the standalone command line developer tools.
See `man Xcode-select` for more details.
```
The same for make and other utilities.

Again, if “Command not found” appears, either install CommandLineTools or install XCode.app, then return here.

Which version has been installed?

Verify the version of GCC installed:

gcc --version

If the response is “command not found”, it’s not installed.

If the program is running on an Apple Silicon ARM chip and using CommandLineTools, you would see (at time of this writing):

Apple clang version 15.0.0 (clang-1500.1.0.2.5)
Target: arm64-apple-darwin23.3.0
Thread model: posix
InstalledDir: /Library/Developer/CommandLineTools/usr/bin

If the program is running on an Intel x86_64 and using CommandLineTools, you would see (at time of writing):

Apple clang version 15.0.0 (clang-1500.1.0.2.5)
Target: x86_64-apple-darwin22.6.0
Thread model: posix
InstalledDir: /Library/Developer/CommandLineTools/usr/bin

Note that Intel hardware are stuck on Ventura.
Only ARM hardware can run on Sonoma, the latest macOS version.

In previous OS versions, it was instead:

Configured with: --prefix=/Library/Developer/CommandLineTools/usr --with-gxx-include-dir=/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/c++/4.2.1
Apple clang version 13.0.0 (clang-1300.0.29.3)
Target: x86_64-apple-darwin21.1.0
Thread model: posix
InstalledDir: /Library/Developer/CommandLineTools/usr/bin

Configured with: --prefix=/Library/Developer/CommandLineTools/usr --with-gxx-include-dir=/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/c++/4.2.1
Apple clang version 11.0.3 (clang-1103.0.32.62)
Target: x86_64-apple-darwin19.4.0
Thread model: posix
InstalledDir: /Library/Developer/CommandLineTools/usr/bin

Apple LLVM version 10.0.1 (clang-1001.0.46.4)
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

If Xcode.app was installed, you would see (at time of writing):

Apple clang version 14.0.3 (clang-1403.0.22.14.1)
Target: x86_64-apple-darwin22.5.0
Thread model: posix
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

Files and Folders

Let’s see what is in those folders:

If CommandLineTools was installed:

ls -al /Library/Developer/CommandLineTools

The response would be:

Library      SDKs    usr

If Xcode.app was installed:

ls -al /Applications/Xcode.app/Contents/Developer/

The response would have more than what’s in CommandLineTools:

Applications Library      Makefiles    Platforms    Toolchains   Tools        usr

How many folders and files were installed?

If you have the tree utility installed:

tree /Library/Developer/CommandLineTools | tail -1

Would yield (at time of writing):

16143 directories, 72910 files

See the link’s location using a Linux utility:
```
which gcc
```
On an Intel Mac, the response is a path to the file at:
```
/usr/bin/gcc
```
See it’s a binary executable if you view the file:
```
cat /usr/bin/gcc
```
Press q to exit from the multi-page viewer.

Xcode.app Version
Identify, from within a Terminal:
```
/usr/bin/Xcodebuild -version
```
If Command Line Tools was installed, you would see:

This message means that it’s not installed:

Xcode-select: error: tool ‘Xcodebuild’ requires Xcode, but active developer directory ‘/Library/Developer/CommandLineTools’ is a command line tools instance

If Xcode is installed, you would get a version code that should match up with the Build Number on Apple’s web page:
```
Xcode 14.3.1
Build version 14E300c
```

For a more precise version number and other info (macOS Mavericks version and up):

pkgutil --pkg-info=com.apple.pkg.CLTools_Executables

A sample response, at time of writing:

package-id: com.apple.pkg.CLTools_Executables
version: 14.3.1.0.1.1683849156
volume: /
location: /
install-time: 1686936570

Previously:

package-id: com.apple.pkg.CLTools_Executables
version: 13.1.0.0.1.1633545042
volume: /
location: /
install-time: 1637303193
groups: com.apple.FindSystemFiles.pkg-group

BTW The previous command was constructed based on a search of tools package names:

pkgutil --pkgs | grep -i tools

The response:

com.apple.pkg.CLTools_Executables
com.apple.pkg.CLTools_SDK_macOS1015
com.apple.pkg.CLTools_SDK_macOS1014
com.apple.pkg.CLTools_macOS_SDK
...

Specifying the XCode utility to use

PROTIP: Xcode.app cannot be installed if Command Utilities has already been installed. So the installation program needs to first check whether XCode.app or CommandLineTools is installed.

Choose which one you want to use:

Reset:
```
sudo xcode-select -r
```
The command provides no response.

To specify the use of Xcode.app (IDE):
```
sudo xcode-select --switch /Applications/Xcode.app
 
```
Enter Password for the sudo.

To specify the use of CommandLineTools:

sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer

Enter Password.

UnInstall Command Line Tools

PROTIP: Deleting the “Command Line Tools” folder is also how to uninstall and reinstall.

Open a new window or tab shell in your Terminal app.
Go to the parent folder where Command Line Tools is installed:
```
cd /Library/Developer/CommandLineTools
```
Remove all files in that folder, provide a password for elevated permissions to get all the files:
```
sudo rm -rf /Library/Developer/CommandLineTools
```
Input your password when prompted.

The response is a lot of files removed (to the Trash).

Now install CommandLineTools (or install the full Xcode IDE).

CAUTION: On a Mac M1 (Apple Silicon chip, macOS 12.0 Monterey), after installed the Command Line Tools then uninstalled them by deleting /Library/Developer/CommandLineTools and running sudo xcode-select -r, I was still getting updates to the tools in System Preferences > Software Update.

The files below are protected by SIP: to delete them, I had to disable SIP first (ie disable SIP, delete the files, re-enable SIP).

Indeed, the receipts are at /Library/Apple/System/Library/Receipts, in the form of files:
- com.apple.pkg.CLTools_Executables.{bom,plist}
- com.apple.pkg.CLTools_SDK_macOS*.{bom,plist}
- com.apple.pkg.CLTools_macOS_SDK.{bom,plist}
Software Update

To get to “Software Update”:
Click the Apple icon or press command+, (comma).

Click Settings. Click General. Click Software Update.

A shell script uses these commands to not require manual clicking on the dialog that pops up (below):

#!/bin/sh
# Create placeholder file checked by CLI updates' .dist code in Apple's SUS catalog:
touch /tmp/.com.apple.dt.CommandLineTools.installondemand.in-progress;
# Find the CLI Tools update:
PROD=$(softwareupdate -l |
  grep "\*.*Command Line" |
  head -n 1 | awk -F"*" '{print $2}' |
  sed -e 's/^ *//' |
  tr -d '\n')
# Unless "No new software available.", install it:
softwareupdate -i "$PROD" -v;

If you see this pop up, manually click “Install”, “Agree”, then “Install”. It says “Finding software”, then “Downloading software”. Finally, “Updates Available” appears.

CAUTION: The large number of files means this can a long time. It took 13 minutes on my 10mbps line.
When you see “The software was installed.”, click “Done” to dismiss the pop-up.

Set license
If you try to confirm the versions installed, you’ll see:

You have not agreed to the Xcode license agreements. You must agree to both license agreements below in order to use Xcode. Press the ‘return’ key to view the license agreements at ‘/Applications/Xcode.app/Contents/Resources/en.lproj/License.rtf’
Press q, then type “agree”.
Press spacebar several times until it says:

Agreeing to the Xcode/iOS license requires admin privileges, please run “sudo xcodebuild -license” and then retry this command.
Run the command suggested to set Apple’s licensing agreement bit:
```
sudo xcodebuild -license
```
Enter your password for the sudo.
Confirm the versions installed.

About Xcode.app

Xcode is Apple’s free IDE developers use to create custom programs for an Apple platform.

There is no Windows PC version of XCode. XCode only works on macOS. This limitation has served to increase the need for MacBooks.

Increasingly, Machine Learning developers are using Apple’s Swift language.

Visit Apple’s Xcode marketing page at

https://developer.apple.com/Xcode

Xcode “includes everything you need to create amazing apps for all Apple platforms. Now Xcode and Instruments look great in the new Dark Mode on macOS Mojave. The source code editor lets you transform or refactor code more easily, see source control changes alongside the related line, and quickly get details on upstream code differences. You can build your own instrument with custom visualization and data analysis. Swift compiles software more quickly, helps you deliver faster apps, and generates even smaller binaries. Test suites complete many times faster, working with a team is simpler and more secure, and much more.”.

PROTIP: Newer versions of Xcode installer also installs a Git client.

How big is the XCode installer?
To see how big the XCode installer is, visit Apple’s fancy “downloads” web page:

https://developer.apple.com/download/applications

Scroll down to a version that doesn’t say “beta”.

Notice the size, such as “(7.01 GB)”.

Because XCode.app is several Gigabytes large, developers who do not create Apple programs can save disk space and time to install it by not installing it.

Also, installer size is also why Xcode does not come with macOS.

Since the Apple Store only handles individual .app files, other mechanisms are needed to install additional programs needed as a pre-requisite by Homebrew, Python, and other development programs.
Make sure you have at least 13GB free on your hard-drive before attempting installation.
1. Click the Apple icon to select “About this Mac”.
2. Click “Storage” tab.

There are other IDEs used by developers (such as Visual Studio, Eclipse, IntelliJ, PyCharm, etc.).

Xcode IDE install

There are two ways to install XCode:

Install from Apple Store - the simplest way
Install using Terminal

Update XCode from Terminal CLI

Open a Terminal.app console window.

At any directory, invoke Apple’s Software Update Tool”:

softwareupdate --install -a

If you see this:

Finding available software
No updates are available.

Install XCode from Apple’s web App Store

In an internet browser, go to:

https://developer.apple.com/download
Sign in to Apple Developer with your email address, then click the arrow icon.
Enter your password, then click the arrow icon.

Below is the “Software Update” approach:

You’ll need to establish an Apple ID if you haven’t already.
Click the cloud icon Download and provide your Apple ID.
Go through Apple’s location verification if prompted.
Confirm your account.
Click “Allow” to the pop-up “Do you want to download?”.

CAUTION: Make sure that your machine has enough free space available.

These are massive files that may take a while to download if you don’t have a fast internet connection.

NOTE: Each version of Xcode is related to a specific version of the Apple OS Mac operating system.

File	Date	Download	Unpacked
Xcode_12.1	2020-10-01	10.5 GB	11.5 GB
Xcode_11.5	2020-06-01	7.5 GB	? GB
Xcode_10.2.1	2019-04-17	? GB	6.1 GB
Xcode_9.0	2017-09-19	. ? GB	? GB
Xcode_8.2.1 8C1002	2016-12-19	? GB	? GB
Xcode_8_beta_2.xip	2016-07-05	5.9 GB	12.32 GB
Xcode_7.31	2016-05-03	3.8 GB	?
Xcode_4.1	2014-	2.9 GB	?
Xcode_3.2.4	2014-	2.? GB	?

Switch to Finder Downloads folder to watch progress on the file name ending with “Download”. The one with a clock icon which signifies downloading.
Return to the versions instructions above to view the updated version.
Delete the installer after you’re done, to reclaim disk space.
In an internet browser, get to the “Mac App Store Preview” for Xcode at

https://apps.apple.com/us/app/Xcode/id497799835?mt=12
Click View in Mac App Store, then “Open App Store.app” in the pop-up.
Click the download icon at the upper-left corner.
Provide your Apple ID and password. Get one if you don’t already have one.

PROTIP: DO NOT install a beta version of Xcode.

The blue “OPEN” icon appears at the upper-right when the app is installed. But don’t click it because we are done.
In Finder, look for Xcode.app in the /Applications folder.

Alternately, on the Touchpad pinch 4 fingers together to click the App Store. Type enough of “Xcode” to filter out others.
To view the version, cursor to the top of the screen and click the program name next to the Apple icon to select “About Xcode”:

Xcode IDE Upgrade

Over time, Apple updates Xcode and its command line utilities.

Click the Apple icon, then click System Settings. Click “Continue” it that’s shown. Here is an example notification:
Search for “Software Updates” or click the icon.
Click “Update Now” if that appears. (but first do a backup.)
Click “Agree” to the EULA.
When done, view the version numbers installed.

Swift version

Regardless of whether Command Line Utilities or Xcode.app is installed:

Get the version of the Swift program used to develop iOS mobile apps:

swift -version

If you are on an ARM (M1/M2/M3) CPU, a sample response at time of this writing:

Apple Swift version 5.9.2 (swiftlang-5.9.2.2.56 clang-1500.1.0.2.5)
Target: arm64-apple-darwin23.3.0

Previously:

swift-driver version: 1.75.2 Apple Swift version 5.8.1 (swiftlang-5.8.0.124.5 clang-1403.0.22.11.100) Target: x86_64-apple-macosx13.0

Previously:

swift-driver version: 1.45.2 Apple Swift version 5.6 (swiftlang-5.6.0.323.62 clang-1316.0.20.8)
Target: arm64-apple-macosx12.0

Alternately, if you are on an older Intel CPU, a sample response (at time of this writing):

Apple Swift version 5.9 (swiftlang-5.9.0.114.6 clang-1500.0.27.1)
Target: x86_64-apple-darwin22.5.0

Previously:

Apple Swift version 5.6 (swiftlang-5.6.0.323.62 clang-1316.0.20.8)
Target: x86_64-apple-darwin21.4.0

If jamf installed Xcode, you’ll also see:

[1]+ Done sudo rm -rf /Library/Developer/CommandLineToolsjamfselfservice://content?entity=policy

Xcode FileMerge tool

Xcode graphically compares files and directories.

Open Xcode. This takes a few seconds.
Right-click on Xcode icon. Select “Open Developer Tool”. Select “FileMerge”.
Specify one file to compare.
Specify the other file to compare.
Click “Compare”.

Apple Platforms

Use an internet browser (such as Safari) to view Apple’s page for developers at:

https://developer.apple.com/

Apple’s products and operating systems include:
- macOS on MacBook laptops
- iOS to run iPhone mobile phones
- iPadOS to run iPad tablets
- watchOS to run Apple Watch wearable products
- tvOS to run Apple TV devices
- visionOS to run vision visors introduced in 2023

XCode UI Tricks

https://augmentedcode.io/xcode-tips/

Testing apps

References:

https://developer.apple.com/documentation/xctest/defining_test_cases_and_test_methods
https://www.youtube.com/watch?v=_wLdNSvGPB8&list=PLvUWi5tdh92zaJIMa65f8G2aWTytY3rN3&index=1

More on MacOS

This is one of a series on macOS:

Xcode (install on MacOS) was originally published by Wilson Mar at Index on December 13, 2025.

Acronyms

2025-12-11T00:00:00+00:00

Here in one page, are all 1,000+ acronyms covering Business, Finance, Marketing as well as: AI/Quantum/Web3 IT, Security, Networking, Amazon, Azure, GCP, OMG!

A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

#

2FA = Two-Factor Authentication (MFA)
2SA = Two-Step Authentication
3DES = Triple Digital Encryption Standard
4IR = Fourth Industrial Revolution (automation of business processes to make data the primary commodity in your business)
5IR = Fifth Industrial Revolution (introduction of AI agents to find patterns and suggest solutions to business problems)
86 = NSFW slang for kicking someone out

A

a11y = accessibility (numeronym of 11 letters between a and y)
AAC = Azure Architecture Center (Microsoft)
AAI = Autonomous Agent Interface (operating system instead of CLI or GUI)
ABAC = Attribute-Based Access Control
ABI = Application Binary Interface (on Apple operating systems)
AC = Alternating Current (as in electrical wall plugs)
ACE = Access Control Entries (determines which subjects - user accounts, host IP addresses, and so on - are allowed or denied access to the object and the privileges given)
ACI = Azure Container Instance (Microsoft)
ACL = Access Control List (defines CRUD permissions for an identity)
ACM = AWS Certificate Manager (Amazon)
ACR = Azure Container Registry (substitute for GitHub within Microsoft Azure cloud)
ACS = Azure Communication Service (to send emails)
AD = Active Directory (Microsoft’s branding for technologies that control access by users and groups)
ADC = Analog to Digital Converter (converts continuos analog to digital values on microprocessor boards)
ADC = AWS Direct Connect (Amazon)
ADE = Automated Device Enrollment (Microsoft 365 Intune auto configuration of macOS)
ADAS = Advanced Driver Assistance Systems
ADF = Azure Data Factory (part of Microsoft Fabric)
ADLS = Azure Data Lake Storage (Microsoft cloud Fabric storage)
ADR = Architectual Decision Record
AEAD = Authenticated Encryption with Associated Data (cipher used in TLS)
AES = Advanced Encryption Standard (symmetric encryption algorithm)
AFAIK = As Far As I Know (internet slang)
AFK = Away From Keyboard (gamer slang)
AFR = Annual Failure Rate
AGI = Artificial General Intelligence (AI that surpasses human intelligence)
AHOD = All Hands On Deck
AI = Artificial Intelligence
AIB = Azure Image Builder (to run within Azure VMs)
AIS = Automated Indicator Sharing (of threats, from cisa.gov)
AICPA = Association of International Certified Professional Accountants
AISIC = AI Safety Institute Consortium
AJAX = Asynchronous Javascript and XML
AKA = Also Known As (common vernacular)
AKE = Authenticated Key Exchange
AKS = Azure Kubernetes Service (Microsoft)
AKV = Azure Key Vault
ALB = Application Load Balancer (Amazon)
ALE = Annualized Loss Expectancy
ALEER = Adopt Land Expand Extend Renew (sales strategy)
ALM = Application Lifecycle Management (all that goes into managing building and maintaining software applications)
ALZ = Azure Landing Zones (Microsoft)
ALU = Arithmetic Logic Unit (within classical CPUs)
AM = Account Manager
AMA = Ask Me Anything (slang)
AMA = Azure Marketplace Application (such as HashiCorp Consul Service)
AMA = Azure Monitoring Agent (Microsoft)
AMBA = Azure Monitor Baseline Alerts (Microsoft)
AMI = Amazon Machine Image (Amazon and Azure image containing operating system and apps)
AMO = Atomic, Molecular, and Optical physics (Quantum IT)
AMQP = Advanced Message Queuing Protocol
AMSI = Antimalware Scan Interface (Windows logging mechanism)
AMZN = (Amazon corporation stock market symbol and URL shortener host name)
ANI = Artificial Narrow Intelligence
ANN = Artificial Neural Networks (emulating the 80 billion neurons in human brains)
AO = Authorizing Official (in RMF)
APFS = Apple File System (since macOS High Sierra in 2017, optimized for SSDs instead of Mac OS Extended HFS+ file system for HDDs)
API = Application Programming Interface
APJ = Asia + Pacific + Japan
APM = Application Performance Monitoring
APT = Advanced Persistent Threat
APT = Advanced Package Tool
ARG = Azure Resource Graph (of Microsoft Container Registry)
ARM = Advanced RISC Machine (type of computer chip)
ARM = Azure Resource Manager (Microsoft)
ARN = Amazon Resource Name (Amazon)
ARO = Annual Rate of Occurrence
ARP = Address Resolution Protocol (Networking)
ARR = Annual Recurring Revenue
ASAP = As Soon As Possible (can be an initialism where each letter is pronounced)
ASB = Azure Security Benchmarks (Microsoft)
ASC = Azure Security Center (Microsoft)
ASCII = American Standard Code Information Interchange (defined binary values to display letters and special characters)
ASG = Auto Scaling Group (AWS)
ASG = Application Security Group (Azure)
ASI = Artificial Super-Intelligence (sentient AI prioritizing of its own needs and desires)
ASIC = Application-Specific Integrated Circuit
ASIM = Advanced Security Information Model (schemas by Microsoft Sentinel)
ASM = AWS Secrets Manager (Amazon)
ASN = Autonomous System Number (AWS unique endpoint identifier)
ASO = Application Security Orchestration and Correlation (integrated security tools and processes)
ASOC = Azure Service Operator
ASPM = Application Security Posture Management
ASR = Automatic Speech Recognition (an AI capability)
ASR = Automated System Recovery
AST = Abstract Syntax Tree (a structured representation of source code used by compilers and tools to catch bugs and refactor code automatically)
ASVS = Application Security Verifiation Standard (levels defined by OWASP)
ATA = Advanced Threat Analytics (Microsoft)
ATARC = Advanced Technology Academic Research Center (non-profit collaborative forum on emerging technology challenges like zero trust)
ATO = Authority To Operate (FEDRAMP designation for production-ready state)
AUP = Acceptable Use Policy (for using company assets)
AuthN = Authentication (contraction)
AuthZ = Authorization (contraction)
AVM = Azure Verified Module (meets standards for good IaC)
AWS = Amazon Web Services (cloud services provider)
AZ = Availability Zone

B

B2B = Business to Business (marketing)
B2C = Business to Consumer (marketing)
BANT = Budget + Authority + Need + Timeframe (framework for buyer readiness)
BATNA = Best Alternative To a Negotiated Agreement
BAU = Business Administration Unit
BAU = Business As Usual (pejorative slang)
BBS = BitBucket Server (self-managed edition of BitBucket source version manager from Atlassian)
BCDR = Business Continuity and Disaster Recovery
BCI = Brain Computer Interface
BCP = Business Continuity Plan
BEC = Business Email Compromise
BDM = Business Decision Maker
BDR = Business Development Representative
BEC = Business Email Compromise (spoofing emails to impersonate managers, vendors, customers, govt)
BERT = Bidirectional Encoder Representations from Transformers (Google GenAI pre-trained model)
BFLA = Broken Function Level Authorization
BFS = Breadth-First Search
BFP = Bi-Directional Forwarding Detection (networking)
BGP = Border Gateway Protocol (networking)
BHAG = Big Hairy Audacious Goal
BIA = Business Impact Assessment
BIOS = Basic Input Output System
BJT = Single Bipolar Junction Transistor
BKM = Best Known Method
BLE = Bluetooth Low Energy
BLF = Business Logic Flaw
BNPL = Buy Now Pay Later (debit credit offering from Klarna, Affirm, etc.)
BOD = Board of Directors
BOLA = Broken Object Level Authorization
BOPLA = Broken Object Property Level Authorization
BOM = Bite Order Mark (used in Unicode to define which UTF page a grapheme is located)
BOM = Bill of Material (for manufacturing)
Borsh = Binary Object Representation Serializer for Hashing (faster alternative than Serde for Rust)
BPM = Beats Per Minute (in music)
BPCS = Basic Process Control System (responsible for process control and monitoring of the industrial infrastructure)
BPMN = Business Process Model Notation
BPT = Business Process Technology (OutSystems workflow engine)
BRB = Be Right Back (internet slang)
BRG = Blue, Green, and Red (color space instead of RGB by OpenCV)
BRM = Business Requirements Management
BSI = Business-Sensitive Informatioin (used in TPM)
BSM = Basic Security Module (used in TPM)
BSOD = Blue Screen of Death (on Windows machines)
BSON = Binary JSON (used only within MongoDB)
BTP = Behavioral Threat Protection
BTP = Business Technology Platform (previously SAP Cloud Platform)
BTW = By The Way (internet slang)
BU = Business Unit
BVA = Business Value Assessment
BYOD = Bring Your Own Device
BYOK = Bring Your Own Key
BYOIP = Bring Your Own IP address
BYOK = Bring Your Own Key

C

C2 = Command and Control
C&C = Command and Control
C2E = Commercial Cloud Enterprise
C2PA = Coalition for Content Provenance and Authenticity (c2pa.org)
CA = Certificate Authority (issues cryptographic certificates)
CaaS = Container as a Service (such as AWS ECS or Azure AKS or Docker Cloud)
CaC = Configuration as Code
CAF = Cloud Adoption Framework (multi-cloud)
CAGR = Compound Annual Growth Rate
CAI = Cloud Asset Inventory (Google)
CAIQ = Consensus Assessments Initiative Questionnaire
CAM = Corporate Account Manager (role)
CARML = Common Azure Resource Modules Library (Open Source project)
CAP = Common Alerting Protocol (XEP-127)
CAP = Cybersecurity Assessment Plan (FISMA)
CAPEX = Capital Expenditures (impacts Asset Balance Statements and can be amortized over time)
CAPTCHA = Completely Automated Public Turing (test) to tell Computers and Humans Apart
CAR = Content Addressable aRchive (used in IPFS)
CASB = Cloud Access Security Broker (provides IAM services to mediate cloud service access)
CBC = Cipher Block Chaining (used by AES openssl encryption)
CBD = Component Based Development (by reusing pre-existing loosely-coupled modular components)
CBK = Common Body of Knowledge
CBRN = Chemical, Biological, Radiological, and Nuclear (risks)
CCB = Change Control Board (organization)
CCE = Critical Customer Escalation
CCM = Cloud Controls Matrix (from CSA)
CCM = Continuous Controls Monitoring
CCM = Customer Communications Management
CCMP = Cipher block Chaining Message authentication code Protocol (AES-based encryption mode with strong security)
CCP = Common Control Provider (per RMF)
CCP = Crisis Communication Plan
CCS = Complete Corresponding Source (code)
CCTV = Closed-circuit TeleVision
CD = Continuous Deployment (into Production for Productive use)
CDK = Cloud Development Kit (AWS)
CDM = Common Data Model (Microsoft Dataverse for their Power apps)
CDM = Continuous Diagnostics and Mitigation
CDN = Content Delivery Network (Amazon)
CDPI = Control Data-Plane Interface (between SDN Datapath and Controller)
CE = Community Edition
CEO = Chief Executive Officer (position title)
CF = CloudFormation (AWS IaC)
CFAA = Computer Fraud & Abuse Act (of 1986)
CfCT = Customizations for Control Tower (Amazon)
CFET = Complementary FET
CFS = Completely Fair Scheduler (Kubernetes CPU allocation among cgroups)
CFT = Cloud Foundation Toolkit (Google Forseti Config Validator managed by Scorecard CLI utility)
CFT = CloudFormation Templates (Amazon)
CG = Customer Gateway
CI = Continuous Integration
CIAN = Customer Identity and Access Management
CIDR = Classless Inter-Domain Routing (networking)
CIEM = Cloud Infrastructure and Entitlement Management (invented by Gartner)
CIM = Common Information Model (Splunk)
CID = Content Identifier (hash from content used in web3 IPFS)
CIP = Critical Infrastructure Protection (plan)
CIRP = Cyber Incident Response Plan
CIS = Center for Internet Security
CISA = Cybersecurity and Infrastructure Security Agency (US government organization)
CISO = Chief Information Security Officer
CKL = Compromised Key List
CKMS = Cryptographic Key Management System
CLI = Command Line Interface (used to run Linux shell scripts)
CLU = Conversational Language Understanding (Azure AI Language)
CMDB = Configuration Management Database (ITIL term for where all aspects of the system is defined)
CMK = Customer-Managed Key (for encryption)
CMO = Chief Marketing Officer
CMP = Cloud Management Platform (for easier use of multiple clouds)
CN = Common Name (a human-readable name of the subject in certificates)
CNAME = Canonical Name Record (DNS)
CNI = Container Network Interface (Kubernetes)
CNN = Convolutional Neural Networks (Machine Learning)
CNNS = Convolutional Neural Networks (Machine Learning)
CNSS = Committee on National Security Systems
COGS = Cost of Goods Sold (Financial Accounting)
COMINT = Command Intelligence (from intercepted SIGINT)
CMOS = Complimentary Metal Oxide Semiconductor (Type of metal–oxide–semiconductor field-effect transistor fabrication process using complementary and symmetrical pairs of p-type and n-type MOSFETs)
COOP = Continuity of Operations (plan)
CORS = Cross-Origin Resource Sharing (used by browsers to allow web apps to access resources from other origins)
COSO = Committee of Sponsoring Organization (of the Treadway Commission)
CoT = CoT (Chain of Thought - reasoning in AI)
COTS = Commercial Off-The-Shelf (Software vs. custom-built)
CPA = Certified Public Accountant
CPIC = Capital Planning Investment Controls
CPS = Customer Profitability Score
CPRA = California Privacy Rights Act
CRDT = Conflict-free Replicated Data Type (for local-first multi-user systems)
CPSM = Cloud Security Posture Management
CPE = Common Platform Enumeration (see Wikipedia)
CPU = Central Processing Unit
CQL = Cassandra Query Language
CRA = Cyber Resilience Act (EU security law that requires companies to report breaches and puts liability on software flaws)
CRD = Custom Resource Definition (Extends Kubernetes API)
CRDTs = Conflict-free Replicated Data Types (resolves concurrent changes in collaborative apps)
CRI = Container Runtime Interface (Kubernetes)
CRR = Cross-Region Replication
CRL = Certificate Revocation List
CRM = Customer Relationship Management
CRR = Cross-Region Replication (AWS S3 capability)
CRR = Cyber Resilience Review (defined by DHS)
CRT = Common Release Tooling (built on top of GitHub Actions CI/CD)
CRUD = Create Read Update Delete (basic operations)
CS = Customer Success (organization)
CSA = Cloud Security Alliance
CSAF = Common Security Advisory Framework (defined by OASIS)
CSB = Cloud Service Broker
CSC = Cloud Service Customer
CSC = Critical Security Controls
CSE = Customer Success Engineer
CSF = Cyber Security Framework (NIST ISO 27018)
CSI = Container Storage Interface (Kubernetes)
CSIRC = Computer Incident Response Center
CSIRT = Computer Incident Response Team
CSM = Customer Success Manager
CSO = Cloud Security Officer
CSP = Cloud Service Provider
CSP = Content Security Policy (defines which origins browsers are allowed to load resources)
CSP = Cryptographic Service Provider
CSPM = Cloud Security Posture Management (Azure Defender, Palo Alto Prisma Cloud, Qualys CloudView, Trend Micro Cloud One Conformity)
CSQL = Customer Success Qualified Lead (HashiCorp internal term)
CSR = Certificate Signing Request
CSRF = Cross-Site Request Forgery
CTA = Call To Action (marketing)
CTAP = Client To Authenticator Protocol
CTF = Capture The Flag (in a cybersecurity tournament)
CTF = Cyber Threat Framework
CTI = Cyber Threat Intelligence
CTO = Chief Technology Officer
CTS = Consul-Terraform Sync (HashiCorp product)
CUA = Computer Using Agent (OpenAI’s working AI agent Operator controlling your computer)
CUDA = Compute Unified Device Architecture (parallel computing platform & API developed by NVIDIA)
CVD = Color Vision Deficiency (aka Color Blindness)
CVE = Common Vulnerabilities and Exposures (identified through the US CISA database)
CVRF = Common Vulnerability Reporting Framework (defined by OASIS)
CVSS = Common Vulnerability Scoring System
CWE = Common Weakness Enumerations (known in programming source code)
CWPP = Cloud Workload Protection Platform (Microsoft, Palo Alto)

D

DaaS = Data as a Service
DA = Developer Advocate
DAAT = Dangerous Asymmetric Advanced Technologies
DAC = Digital to Analog Converter
DAC = Discretionary Access Control (for Security)
DAG = Directed Acyclic Graph
DAO = Decentralized Autonomous Organization
Dapps = Decentralized Applications (run on peer-to-peer networks, such as a blockchain using smart contracts)
DART = Detection and Response Team (Microsoft)
DAX = Data Analysis Expressions (Microsoft formula language)
DAX = DynamoDB Accelerator (Amazon)
DB = Database
DBMS = DataBase Management System
DC = Data Center (in the context of Consul - a set of Consul nodes within a region)
DC = Domain Controller (Microsoft server that authenticates user identities and authorizes their access to resources)
DCAP = Data-Centric Audit Protection
DCL = Data Control Language (to GRANT, REVOKE SQL data)
DDP = Dual Data Plane (Cisco Digital Twin running CI/CD blue/green patching)
DDD = Domain Driven Design
DDL = Data Definition Language (to CREATE, ALTER, DROP SQL data)
DDoS = Distributed Denial of Service Attack
DDPM = Denoising Diffusion Probabilistic Models (Generative AI)
DDR4 = Double Data Rate generation 4 (at 2133-3200 MT/s, a type of SDRAM that each generation doubles the data transfer rate of traditional SDR memory, at lower voltage of 1.2V)
DEI = Diversity + Equity + Inclusion
DEK = Data Encryption Key (secret generated from Customer Managed keys to protect data)
DES = Digital Encryption Standard (56 bits)
DEX = Decentralized Exchanges (Blockchain)
DFC = Distributed Fragments Cryptography (by AKeyless.io)
DFIR = Digital Forensics and Incident Response
DFS = Depth-First Search (programming algorithm)
DGO = Data Governance Organization/Officer (for security)
DHCP = Dynamic Host Configuration Protocol (automatically assigns IP addresses to devices on a network)
DHS = Department of Homeland Security (US government organization)
DiFi = Distributed File Integrity
DiD = Defense in depth (for security)
DIR = Detection and Incident Response (security workflow)
DIY = Do It Yourself
DKIM = DomainKeys Identified Mail (provides public keys for signing of emails to prevent spoofing)
DLP = Data Loss Prevention
DMARC = Domain-based Message Authentication Reporting and Conformance (policies for VMC about what to do when SPF and DKIM fails)
DMCA = Digital Millennium Copyright Act
DMI = Direct Media Interface (the bus connecting the chipset and the CPU)
DML = Data Manipulation Language (to INSERT, UPDATE, DELETE SQL data)
DMS = Database Migration Service (AWS & Microsoft Azure)
DMZ = Demilitarized Zone (networking)
DMV = Dynamic management views (Microsoft SQL query lifecycle insights monitoring)
DNC = Do Not Connect
DNN = Deep Neural Network
DNS = Domain Name Service (networking)
DoD = Definition of Done
DOD = Department of Defense (US government organization)
DODAF = Department of Defense Architecture Framework
DoH = DNS over HTTPS
DoR = Definition of Ready
DPO = Direct Preference Optimization (technique to optimize models based on preference data or ranking)
DPIA = Data Protection Impact Assessment (required by EU GDPR)
DPL = Data Protection Officer (job role required by GDPR)
DQL = Data Query Language (to SELECT SQL data)
DR = Disaster Recovery
DRAM = Dynamic Random Access Memory
DRI = Directly Responsible Individual (Coined by Apple for the person to make sure that a task is completed)
DPP = Digital Product Passport (a blockchain to collect and share product sustainability, environmental, and recyclability attributes from raw material sourcing and manufacturing process to end-of-life disposal)
DRP = Disaster Recovery Plan (to transition from alternative business processes back to regular processes.)
DRPO = Defense Research & Development Organization
DRY = Don’t Repeat Yourself
DRDoS = Distributed Reflection Denial-of-Service
DSC = Digital Signature Algorithm (algorithm for signatures)
DSC = Desired State Configuration (declarative DevOps)
DSL = Domain-Specific Language (custom data structure to control processing such as Apache Kafka streams)
DSL = Digital Subscriber Line
DSP = Digital Signal Processing
DSSE = Dead Simple Signing Envelope (signing methods and formats used by Secure Systems Lab)
DSSS = Direct-Sequence Spread Spectrum
DST = Daylight Saving Time
DTLS = Datagram Transport Layer Security
DUT = Device Under Test
DVIA = Damn Vulnerable iOS Application (written in Swift, on GitHub)
DVWA = Damn Vulnerable Web Application (by OWASP)
DWaaS = Data Warehouse as a Service
DWeb = Decentralized Web
DWBH = Don’t Worry Be Happy (internet slang)
DX = Developer eXperience

E

E2E = End-to-End
E2EE = End-to-End Encryption
EA = Enterprise Architect
EAL = Evaluation Assurance Level (1-7 of Common Criteria)
EAM = Externalized Authorization Management
EAP = Extensible Authentication Protocol (a framework for port-based access control that uses the same three primary components that are used in the RADIUS standard)
EAR = Export Administration Regulations (US)
EBITDA = Earnings Before Interest, Taxes, Depreciation, and Amortization
EBS = Elastic Block Storage (Amazon)
EC2 = Elastic Cloud Compute (AWS)
ECR = Elastic Container Registry (Amazon service)
ECS = Elastic Container Service (Amazon service)
ECU = EC2 compute unit (Amazon)
EDA = Event Driven Architecture (Serverless)
EDA = Exploratory Data Analysis (an iterative process to understand data through investigative analysis of the data)
EDM = External Dependency Management (NIST)
EDPB = European Data Protection Board (EU GDPR)
EDR = Endpoint Detection and Remediation (Defender for endpoints)
ECDSA = Elliptic Curve Digital Signature Algorithm (algorithm for signatures)
ECU = Electronic Control Unit (Embedded system in autos)
EDA = Exploratory Data Analysis (Microsoft MLOps)
EDR = Endpoint Detection and Response (security)
EDI = Electronic Data Interchange
EE = Enterprise Edition
EEA = European Economic Area
EEC = European Economic Community
EIN = Employer Identification Number
EFA = Elastic Fabric Adapter (AWS)
EFF = Electronic Frontier Foundation
EFS = Elastic File System (Amazon file storage service for EC2 instances)
EFT = Electronic Funds Transfer
EiB = Exbibyte (exa binary byte)
EIP = Elastic IP
ELA = Enterprise License Agreement
ELB = Elastic Load Balancer (AWS)
EMR = Elastic Map Reduce (AWS)
EKM = Extensible Key Management (HashiCorp Vault feature)
EKS = Elastic Kubernetes Service (AWS)
ELB = Elastic Load Balancer
ELT = Extract Load Transform
EMCOMM = Emergency Communications
EMEA = Europe + Middle East + Africa
EMI = Electro-Magnetic Interference
EMP = Electro-Magnetic Pulse
EMR = Elastic Map Reduce (AWS ETL)
EMRFS = EMRFS (on AWS S3 encryption at rest)
ENA = Enhanced Networking Adapter (in AWS EC2 AMI instances)
ENIAC = Electronic Numeric Integrator And Computer (first general purpose computer)
ENI = Elastic Network Interface (AWS)
ENS = Ethereum Name Service (provides names to wallet addresses to simplify token transactions)
EPS = Earnings Per Share
ESPR = Ecodesign for Sustainable Products Regulation (European Green Deal launched December 2019)
ETL = Extract Transform and Load
EOF = End of File
EOQ = End of Quarter
EOM = End of Month
EO = Executive Order (from US White House)
EOP = Exchange Online Protection (Microsoft)
EOY = End of Year
EPSS = Exploit Prediction Scoring System (to predict the likelihood of a vulnerability being exploited)
ERM = Enterprise Risk Management
ERP = Enterprise Resource Planning (SAP does this)
ESB = ???
eSRAM = embedded Static Random-Access Memory (TSMC memory coupled with the GPU of Microsoft Xbox One gaming console’s architecture)
ESNI = Encrypted Server Name Indication (with TLS 1.3)
ETDR = Endpoint Threat Detection and Response (security)
ETW = Event Tracing for Windows (Microsoft EventPipe)
EU = European Union
EUC = End-User Computing (includes SSO, MFA, RBAC, IAM)
EUV = Extreme Ultraviolet (lithography to make semiconductor chips)
EV = Extended Validation (certificate)
EVM = Ethereum Virtual Machine (Ethereum)
EVMS = Ethereum Virtual Machine Suite (Ethereum)
EVMOS = Ethereum Virtual Machine Operating System (Ethereum)

F

FaaS = Functions as a Service
FAISS = Facebook AI Similarity Search (and clustering of dense vectors, implemented in C++ with Python wrappers using CUDA)
FAQ = Frequently Asked Questions
FBL = Feedback Loop
FCEB = Federal Civilian Executive Branch (US government departments and agencies)
FCI = Failover Cluster Instance (Microsoft SQL Server)
FDE = Full Disk Encryption
FEA = Federal Enterprise Architecture (by OMB)
FEDRAMP = Federal Risk and Authorization Management Program
FEA = Finite Element Analysis (generate a computer model of components within actual system to analyze response to stresses)
FEM = Finite Element Method (method for numerically solving differential equations)
FFB = Force Feedback (on gaming consoles)
FFT = Fast Fourier transform
FGAC = Fine-grained Access Control (AWS)
FHE = Fully Homomorphic Encryption
FHRP = First Hop Redundancy Protocol (for shared IP routing redundancy)
FHS = Filesystem Hierarchy Standard (directory structure of Linux distributions)
FIDO2 = Fast IDentity Online (Spec for web authorization using devices with PKI instead of passwords)
FIFO = First In - First Out
FIM = Federated Identity Management
FIM = File Integrity Monitoring (for Intrusion Detection)
FinFET = Fin (as in fish) FET
FIPS = Federal Information Processing Standards (aligns with ISO/IEC 19790 to specify encryption, key management, etc. to protect data over 4 levels)
FISMA = Federal Information Security Management Act (US government)
FLC = Fuzzy Logic Control
FM = Foundation Model (LLM for Generative AI)
FMCG = Fast-Moving Consumer Goods
FN = False Negative (test result that missed catching a bad/malicious sample)
FOMO = Fear Of Missing Out
FP = False Positive (test result that identified a legitimate sample as bad/malicious)
FPGA = Field Programmable Gate Array
FPS = Flexible Payments Service
FQDN = Fully-Qualified Domain Name
FPV = First Person View (in 3D games)
FRAP = Facilitated Risk Analysis Process (analyze impact of each individual org unit)
FSFET = ForkSheet Field-Effect Transistor
FTE = Full Time Employee/Equivalent
FTK = Forensic ToolKit (drive imager tool from AccessData to preserve evidence)
FQDN = Fully Qualified Domain Name
FSBP = Foundational Security Best Practices (defined by AWS)
FSD = Full Self-Driving (by autonomous vehicles)
FSM = Finite State Machine
FTW = For The Win (a big contributor to great success)
FYE = Fiscal Year End
FYI = For Your Information
FUD = Fear Uncertainty and Doubt

G

GAPP = Generally Accepted Privacy Principles (developed by accountants)
GA = General Availability
GAA = Gate All-Around (transitor technology used in FinFET & MBCFET)
GAI = Generative Artificial Intelligence
GAM = Global Account Manager (job role)
GANS = Generative Adversarial Networks (Generative AI)
GAR = Geoogle Artifact Registry (in GCP)
GB = Gigabytes (173741824 bytes or 1024 megabytes)
GCE = Google Compute Engine
GCN = Graph Neural Network
GCM = Galois/Counter Mode (mode of operation for symmetric-key cryptographic block ciphers)
GCP = Google Cloud Platform
GDPR = General Data Protection Regulation (EU Regulation 2016/679)
GEOINT = Geospatial Intelligence (from analysis and visualization of security activities on a map)
GG = Good Game (gamer digital handshake to convey sportsmanship)
GGML = GPT-Generated Model Language (Early Tensor library designed for machine learning large models at high performance)
GGUF = GPT-Generated Unified Format (model for sharing LLMs with Ollama or LM Studio using JSON-RPC)
GHA = GitHub Actions (SVM cloud purchased by Microsoft)
GID = Group Identifier (used in Kubernetes)
GIL = Global Interpreter Lock (removed in Python 3.13)
GKE = Google Kubernetes Engine (manages container images within Google cloud)
GKS = Google Kubernetes Service (runs container images within Google-managed Kubernetes)
GLB = Global Load Balancing
GLBA = Gramm-Leach-Bliley Act (US regulation of financial data privacy protection)
GNM = Global Network Manager (HashiCorp product feature)
GNU = GNU is Not Unix (a recursive acronym for the set of commands in Linux Bash scripts)
GPG = GNU Privacy Guard (software program to handle encryption)
GPIO = General Purpose Input/Output (on an Arduino board)
GPO = Group Policy Object
GPS = Global Positioning System
GPT = Generative Pre-trained Transformer (LLM used in ChatGPT by OpenAI for GenAI)
GPT = GUID Partition Table (used with UEFI)
GQA = Generalized Question Answering (a dataset for visual question answering tasks)
GRC = Governance and Risk and Compliance
gRPC = Global Remote Procedure Call (a protocol to connect services)
GRPO = Generalized Reinforcement Policy Optimization (advanced variant in reinforcement learning optimization)
GRS = Geo-Redundant Storage (replication of 3 copies in an Availability Zone in each of two Azure regions)
GSI = Global Secondary Index (AWS DynamoDB)
GSI = Global System Integrator
GTM = Go To Market
GUI = Graphical User Interface
GUID = Globally Unique Identifier (a code generated to be unique across space and time for use as an object identifier)
GW = Gateway
GZRS = Geo-Zone-Redundant Storage (replication synchronously to 3 Availability Zones in a primary and 3 copies asynchronously in one Availability within a secondary Azure region accessed only after a failover)

H

H2M = Human to Machine (interface)
HA = High Availability
HADR = High Availability Disaster Recovery
HAL = Hardware Abstraction Layer
HAML = HTML Abstraction Markup Language (a template used in Ruby Rails views to simplify writing HTML)
HANA = High-performance ANalytic Application (SAP’s in-memory column-oriented relational DBMS)
HBD = Happy Birth Day
HBI = High Business Impact (flag for Azure to add encryption and limit diagnostics collection on sensitive data)
HNSW = Hierarchical Navigable Small World (graphs)
HCL = HashiCorp Configuration Language
HD = High Definition
HDFS = Hadoop Distributed File System
HEC = HTTP Event Collector (Splunk)
HCM = Human Capital Management (system for HR processes)
HCP = HashiCorp Cloud Provider
HCS = HashiCorp Consul Service (SaaS on Azure)
HE = Homomorphic Encryption (Privacy-Preserving technology)
HIDS = Host-Based Intrusion Detection System
HIPAA = Health Insurance Portability and Accountability Act
HiPPO = Highest Paid Person’s Opinion (deference between high and low status employees)
HLS = HTTP Live Streaming (Apple video streaming protocol)
HMI = Human-Machine Interface
HMM = Hidden Markov Model (AI used for speech recognition)
HNDL = Harvest Now, Decrypt Later (store encrypted data for decrypting later using post-quantum computers)
HPA = Horizontal Pod Autoscaler (Kubernetes)
HPC = High-Performance Compute
HQL = Hibernate Query Language (object-oriented ORM SQL with inheritance polymorphism used by Java)
HR = Human Resources
HRMS = Human Resource Management System
HRU = High-Risk User(s)
HSM = Hardware Security Module
HSTS = HTTP Strict Transport Security (web security policy that protects HTTPS websites against MITM attacks)
HTAP = Hybrid Transaction and Analytics Processing (Microsoft Azure Synapse Link capability)
HTML = HyperText Markup Language
HTTPS = HyperText Transfer Protocol Secure (the protocol that uses port 443)
HUMINT = Human Intelligence (from human sources such as interviews or spying)
HVA = High-Value Asset
HVNC = Hidden Virtual Network Computing (used by ShadowVault malware to provide unauthorized access to vulnerable machines)
HVP = Hybrid Vault Platform (AKeyless Encryption as a Service)
HVM = Hardware Virtual Machine
HVN = HashiCorp Virtual Network
HXM = Human Management (SAP SuccessFactors HRMS suite)

I

i18n = Internationalization (numeronym - 18 letters between i and n)
IA = Interoperability Agreement (between enterprises)
IaaS = Infrastructure as a Service
IaC = Infrastructure as Code
IAB = Internet Architecture Board (maintains an ethics-related statement concerning the use of the Internet. A technical advisory group of researchers and technical professionals responsible for Internet growth and management strategy and standards oversight.)
IAM = Identity and Access Management
IAP = Identity-Aware Proxy (Google Cloud)
IASAE = Information Assurance Security Architecture and Engineering
IAST = Interactive Application Security Testing
IBN = Internet-based Networking (for SDN)
IC = Integrated Circuit
ICFR = Internal Control over Financial Reporting
ICMP = Internet Control Message Protocol (used by the Linux ping command)
ICS = Industrial Control System (aka Operational Technologies)
ICT = Information and Communication Technology
ICT = Ideal Cycle Time (maximum achievable performance for OEE Fully Productive Time)
ICYMI = In Case You Missed It
ID = Identifier
IDaaS = Identity as a Service (for central management of users and groups)
IDE = Integrated Development Environment
IDN = Unicode Domain Names
IDOR = Insecure Direct Object Reference
IdP = Identity Provider (such as Okta)
IDP = Internal Developer Platform
IDS = Intrusion Detection System (A detective control used to detect attacks after they occur. A signature-based IDS (also called definition-based) uses a database of predefined traffic patterns. An anomaly-based IDS (also called behavior-based) starts with a performance baseline of normal behavior and compares network traffic against this baseline. An IDS can be either host-based (HIDS) or network-based (NIDS)
IDS = Influencer Dynamics Simulator (predicts how followers react to influencers)
IEC = International Electrotechnical Commission (counterpart to the US NIST)
IEM = Infrastructure Event Management (AWS service to ensure high traffic can be accommodated)
IETF = Internet Engineering Task Force
IYDMMA = If you don’t mind me asking (chat slang)
IFS = Internal Field Separator (to define character used to split strings in Bash shell scripts)
IGA = Identity Governance and Administration
IGPT = Insulated Gate Bipolar Transistor
IGW = Internet Gateway
IIFE = Immediately Invoked Function Expression (by Webpack)
IIoT = Industrial Internet of Things
IKE = Internet Key Exchange
ILB = Internal Load Balancer (Microsoft)
ILT = Instructor-Led Training
IM = Internet Messaging
IMINT = Imagery (Photography) Intelligence (from satellite or drone photos)
IMHO = In My Humble Opinion
IMO = In My Opinion
IMSI = International Mobile Subscriber Identity (15-digit ID unique to each mobile phone)
IOA = Indicator of Attack
IOC = Indicator of Compromise
IOPS = Input Output Per Second (AWS)
iOS = (Mobile operating system for Apple iPhone)
IOT = Internet of Things
IP = Internet Protocol
IPAM = IP Address Manager (AWS feature that manages CIDR ranges)
IPFS = InterPlanetary File System (a decentralized, peer-to-peer file storage protocol to store and access content without a central server)
IPC = Inter-Process Communication
IPE = Information Produced by the Entity
IPS = Intrusion Protection System (detect or prevent brute force & other attacks on security)
IPsec = Internet Protocol security
IPO = Initial Public Offering
IR = Integration Runtime (compute infrastructure used by Microsoft’s Azure Data Factory)
IR = Incident Response (Security)
IRDP = ICMP Router Discovery Protocol
IRL = In Real Life (internet slang)
IRM = Information Rights Management
IRM = Insider Risk management (Microsoft 365 compliance solution)
IRT = Incident Response Team
ISAC = Information Analysis Sharing Centres (for threat intelligence)
ISCP = Information System Contingency Plan
ISBN = Intelligent Spend and Business Network (SAP offering)
ISA = Instruction Set Architecture (defines interface between software and different implementations of a processor)
ISD = Internet Service Provider
ISMS = Information Security Management System (ISO 27001)
ISO = International Standards Organization
ISP = Internet Service Provider (company providing access to the internet)
ISQ = International System of Quantities
ISSO = Information System Security Officer (in RMF)
ISV = Independent Software Vendor
IT = Information Technologies
ITAR = International Traffic in Arms Regulations (US)
ITIL = Information Technology Infrastructure Library
ITSM = IT Service Management (implemented of Service Now)
ITU = International Telecommunication Union (defined X.509 certificate format)

J

J2EE = Java Enterprise Edition
JIT = Just-In-Time (access for Zero Trust)
JEA = Just-Enough-Access (for Zero Trust)
JND = Just Noticeable Difference (The minimum amount of change or difference required for a change to be perceptible to the human eye)
JOSE = Javascript Object Signing and Encryption (standard)
JSON = JavaScript Notation (data format)
JWT = JSON Web Token (Internet standard for creating data with optional signature and/or optional encryption whose payload holds JSON that asserts some number of claims)

K

k8s = Kubernetes (numeronym of 8 letters between k and s)
kanban = Japanese word for visual signal (adopted for managing software workflow)
KCL = Kinesis Client Library (AWS)
KDC = Key Distribution Center
KEDA = Kubernetes-based Event Driven Autoscaler
KEK = Key Encryption Key (key to encrypt the DEK)
KMIP = Key Management Interoperability Protocol
KMS = Key Management Service (AWS)
KNOB = Key Negotiation of Bluetooth (MITM attack on paired Bluetooth devices’ security mechanisms)
KOL = Key Opinion Leader
KPI = Key Performance Indicator
KPL = Kinesis Python Library (AWS)
KPU = Kinesis Processing Units (AWS streaming memory and compute)
KQL = Kusto Query Language (to access Microsoft Azure Data Explorer)
KTLO = Keep/Keeping The Lights On (minimal necessary effort and income)
KTS = Kubernetes Threat Detection (Google service)
KRI = Key Recovery Information
KSAs = Knowledge, Skills, and Abilities (Work Roles)
KV = Key-Value (data storage format)
KYC = Know Your Customer (requiring identity verification)

L

l18n = Localization (numeronym of 18 letters between l and n)
LAM = Large Action Models (multihop & multimodal data type for agentic/action on LLMs)
LAMP = Linux OS + Apache web server + MySQL DB + PHP/Perl/Python (open-source web development technology stack)
LAN = Local Area Network
LCEL = LangChain Expression Language (chain series of AI models and parsers)
LCM = Large Concepts Model (Meta’s approach for reasoning)
LDAP = Lightweight Directory Access Protocol (used by Linux to manage user and group access)
LED = Light-Emitting Diode
LF-TBAC = Lake Formation tag-based access control (AWS)
LGPD = Lei Geral de Proteção de Dados Pessoais (privacy/data protection law in Brazil)
LGTM = Looks Good To Me
LGTM = Loki + Grafana + Tempo + Mimir (Grafana’s integrated stack for logs, metrics, and traces to be collected and visualized)
LI = Lead Implementer
LIFO = Last In - Last Out
LIMS = Laboratory Information Management System
LINDDUN = framework to ensure privacy
LLC = Limited Liability Company
LLM = Large Language Model (such as GPT-x for Generative AI)
LMM = Large Multimodal Model (Meta’s approach for reasoning)
LLMNR = Link-Local Multicast Name Resolution (Microsoft protocol for name resolution)
LMS = Learning Management System
LOL = Laughing Out Loud (internet slang)
LoRA = Low-Rank Adaptation (reducing the number of trainable parameters and enabling efficient adaptations by decomposing weight matrices into low-rank matrices)
LotL = Living off the Land (type of attack)
LPU = Language Processing Unit (AI Agent OS component)
LRM = Large Reasoning Models
LRS = Locally-Redundant Storage (within same Azure Availability Zone)
LSD = Least Significant Digit
LSI = Local Secondary Index (AWS DynamoDB)
LTM = Last Twelve Months
LUKS = Linux Unified Key Setup (root + boot + swap partition encryption)
LUN = Logical Unit Number (within a physical storage device volume manager)
LVM = Logical Volume Management
LVM = Large Vision Model (such as Stable Difussion for Generative AI)
LWE = Learning with errors (cryptographic algorithm)

M

m8g = Monitoring (numeronym - 8 letters between m and g)
M&A = Mergers and Acquisitions (business)
MAC = Media Access Control (address of NIC card)
MAC = Message Authentication Code (a tag appended to a message to verify its authenticity)
MAE = Mean Absolute Error (to calculate the accuracy of a regression model)
MAGA = Make America Racist Again
MAP = Minimum Acceptable Product
MASINT = Measurement and Signatures Intelligence (of weapons capabilities and industrial activities)
MASTG = Mobile Application Security Testing Guide (defined by OWASP)
MASVS = Mobile Application Security Verification Standard (defined by OWASP)
MBR = Master Boot Record
MBCFET = Multi-Bridge Channel Field Effect Transister (Samsung)
MCSB = Microsoft Cybersecurity Security Benchmark (best-practice framework using Microsoft Defender for Cloud. Successor of Azure Security Benchmark v3)
MCR = Microsoft Container Registry
MCRA = Microsoft Cybersecurity Reference Architectures
MCU = Microprocessor Unit (integrated circuit that contains one or more CPUs and supporting electronics for general-purpose computing)
MDFC = Microsoft Defender for Cloud
MDP = Markov Decision Process
MDT = Microsoft Deployment Toolkit (to install Windows 11 from file shares)
MDTI = Microsoft Defender Threat Intelligence
MDM = Master Data Management (for a single source of truth about critical corporate data)
MDM = Mobile Device Management (for security)
MDW = Modern Data Warehouse (Microsoft)
MDR = Managed Detection and Response (for security)
MDX = Multidimensional Expressions (multi-axis formula language for Microsoft SSAS to retrieve OLAP cubes)
MEF = Mission Essential Functions
MEI = Merit, Excellence, and Intelligence (anti DEI)
MELT = Metrics + Errors + Traces + Logs (for Observability)
MES = Manufacturing Execution System (track material movement through the shop floor)
MFA = Multi-Factor Authentication (security)
MFS = Mutable File System (to read and write files on web3 IPFS)
MGT = Microsoft Graph Toolkit (to read the Outlook calendars and log of actions by each Microsoft user)
MHA = Multi-Head Attention (traditional mechanism to MQA in transformers where the model jointly attend to information from different representation subspaces)
MIG = Managed Instance Group (for autoscaling within Google Cloud)
MIP = Microsoft Information Protection (sensitivity labels)
MIT = Most Important Task
MitC = Man-in-the-Cloud (performed by abusing cloud file synchronization services such as Google Drive or DropBox for Data compromise, command and control (C&C), data exfiltration, and remote access)
MitB = Man-in-the-Browser (attack vector such as Port stealing that exploits the binding between a port and a media access control (MAC) address)
MitM = Man-in-the-Middle (an attack in the form of active interception allowing an attacker to intercept traffic and insert malicious code sent to other clients. Kerberos provides mutual authentication and helps prevent MITM attacks)
MISP = Malware Information Sharing Platform (open-source threat intelligence platform)
ML = Machine Learning
M-LAG = Multi-chassis Link AGgregation (synchronization protocols over a peer control link to enable multiple switches to aggregate links, for redundancy and load balancing, improving network performance and reliability*)
MLDR = Machine Learning Detection and Response
MLM = Masked Language Model (such as BERT for Natural Language Processing)
MLLP = Minimal Lower Layer Protocol (the leading and trailing delimiter HL7v2 healthcare data is transmitted using TCP/IP within VPNs)
MMU = Memory Management Unit (to manage VM memory)
MNC = Multi-National Corporation
MNO = Mobile Network Operator (ATT, Verizon, T-Mobile)
MOD = Manager on Duty (incident manager - security and hospitality industry)
MoE = Mixture of Experts (in AI)
MOSFET = Metal Oxide Field Effect Transitor
MPC = Model Predictive Control
MPP = Massively Parallel Processing (on databases)
MQA = Multi-Query Attention (a transformer encoding, used by PaLM and Falcon, that uses less memory and bandwidth than MHA, without sacrificing accuracy, by shareing Keys and Values across all heads but keeps separate transformations for each Query)
MRO = Method Resolution Order (in Python multiple inheritance hierarchy using C3 linearization algorithm which uses the method from the first parent class in the inheritance list)
MS = Microsoft
MSA = Master Service Agreement
MSK = Managed Streaming for Kafka (AWS)
MSI = Managed Service Identity
MTD = Month-To-Date
mTLS = Mutual TLS
MOR = Minimum Operating Requirements (describes the minimum environmental and connectivity requirements in order to operate computer equipment)
MOSFET = Metal Oxide Semiconductor Field Effect Transitor
MSI = Microsoft Software Installer (file extension for Microsoft Windows installer files)
MTD = Maximum Tolerable Downtime
MQTT = MQ Telemetry Transport
MSAL = Microsoft Authentication Libraries
MSD = Most Significant Digit
MSE = Mean Squared Error (to calculate the accuracy of a regression model)
MSK = Managed Streaming for Kafka (AWS using Apache)
MSP = Managed Service Provider
MSSP = Managed Security Service Provider (A provider of outsourced SOC services)
MTA = Mail Transfer Agent
MTBF = Mean Time Between Failures
MTTA = Mean Time To Acknowledge
MTTD = Mean Time To Detect (anomaly)
MTTI = Mean Total Time of Impact (to operations)
MTTR = Mean Time To Restore/Remediate
MTU = Maximum Transmission Unit (networking)
MVP = Minimum Viable Product
MVP = Most Valuable Professional (Microsoft)
MY = Multi-Year
MVNO = Mobile Virtual Network Operator
MYOB = Mind Your Own Business (internet slang)

N

NA = Not Applicable
NA = North America (United States)
NAC = Network Access Control
NAC = Network Admission Control/Controller (Cisco)
NAD = Network Access Devices
NAS = Network Attach Storage (device)
NAT = Network Address Translation (allows devices on a private network to communicate with a public network through a networking gateway)
NB = No Problem
NDA = Non-Disclosure Agreement
NDAA = National Defense Authorization Act of 2020 and 2021
NDE = Net Dollar Expansion
NER = Named Entity Recognition (identifying and extracting names of persons, organizations, locations, dates from text and media)
NeRF = Neural Radiance Fields (for generating 3D content from 2D images)
NHI = Non-Human Identities (security)
NDI = National Defense Information (classified secrets)
NDRR = Net Dollar Retention Rate
NER = Named Entity Recognition (AI)
NFR = Non-Functional Requirements
NFS = Network File System
NFT = Non-fungible Tokens (currently defined as investments rather than consumer goods)
NFV = Network Function Virtualization
NGC = NVIDIA GPU Cloud
NGFW = Next-Generation firewall (Originally from Palo Alto - it examines application data to filter traffic at the highest application layer of networks)
NIA = Network Interface (HashiCorp product feature)
NIACAP = National Information Assurance Certification and Accreditation Process
NIAP = National Information Assurance Partnership (Common Criteria)
NIC = Network Interface Card
NIM = NVIDIA Inference Microservices
NISQ = Noisy Intermediate-Scale Quantum (device)
NIST = National Institute of Standards and Technology (US)
NLB = Network Load Balancer (Amazon)
NLP = Natural Language Processing (interaction between computers and human language such as Alexa and Google Assistant)
NLU = Natural Language Understanding (Alexa & Generative AI)
NOC = Network Operations Center
NoSQL = (Nonrelational database system such as key-value pair document storage in DynamoDB)
NPD = Non-Production (vs PRD for production in keeping with a consistent number of letters)
NPS = Net Promoter Score (rating by customers willing to promote to others)
NPU = Neural Processing Unit (specialized for processing AI neural networks in parallel, especially on edge/hand-held devices and on Microft’s AI laptops)
NSA = National Security Agency (conducts SIGINT)
NSFET = Nanosheet Field-Effect Transistor
NSFW = Not Safe For Work (slang one should avoid repeating)
NSG = Network Security Group (Azure)
NSP = Next Sentence Prediction (GenAI for BERT Natural Language Processing)
NTA = Network Traffic Anomaly
NTM = Next Twelve Months
NTP = Network Time Protocol
NUI = Natural User Interface
NVIDIA = (the corporation which produces GPUs for AI and graphics)
NVMe = Non-Volatile Memory Express (protocol to connect SSDs to the CPU via high-speed PCIe bus)

O

o11y = Observability (numeronym - 11 letters between o and y)
O3DE = Open 3D Engine (open-source 3D game development engine from Amazon. Successor to Amazon Lumberyard)
OAC = Origin Access Control (for AWS CloudFront)
OAI = OpenAI (Microsoft’s partner in AI ChatGPT)
OAI = Origin Access Identity (virtual identity used to require users to access content via AWS CloudFront URl instead of S3 URL)
OASIS = Organization for the Advancement of Structured Information Standards (defined CSAF and CVRF)
OCI = Container Open Initiative (to replace Docker Compose and Docker containers)
OCSP = Online Certificate Status Protocol
OCM = Organizational Change Management
ODNI = Office of the Director of National Intelligence
OECD = Organization for Economic Cooperation and Development (published trans-border privacy guidelines in 1980)
OEE = Overall Equipment Effectiveness (the percentage metric of making only good parts as fast as possible (Good Count x Ideal Cycle Time) / Planned Production Time. OEE OEE does not provide information about loss-related factors in the preferred metric consisting of Availability, Performance, and Quality)
OEL = Oracle Enterprise Linux
OEM = Original Equipment Manufacturer
OEP = Occupant Emergency Plan
OFDM = Orthogonal Frequency-Division Multiplexing (method of digital modulation of data in which a signal, at a chosen frequency, is split into multiple carrier frequencies at right angles to each other)
OG = Original Gangster (slang to praise someone as exceptional, authentic, or old-school)
OIDC = OpenID Connect
OKR = Objectives and Key Results
OODA = Observe Orient Decide Act (decision making sequence used by US Air Force for agility)
OOM = Orders Of Magnatude (where 10x = 1 OOM)
OLA = Observe - Orient - Decide - Act (acrostic for the rapid decision-making strategy used by US fighter pilots during aerial combat)
OLAP = OnLine Analytical Processing (A business intelligence approach that allows users to analyze large amounts of data from different points of view)
OLTP = OnLine Transaction Processing
OMS = Operations Management Suite (Microsoft product for datacenter administration)
OOM = Out of Memory
OOP = Object Oriented Programming
OPA = Open Policy Agent (Policy as Code agent from Styra used in Kubernetes Admission Controller and Terraform)
OPEX = Operating Expenditures (impacts Profit and Loss statement for current periods)
ORC = Optimized Row Columnar (data format used within Apache Hadoop databases)
ORM = Object-Relational Mapping (to simplify interaction between OOP CRUD apps and SQL databases)
OOS = Out of Stock (when a retail store is out of inventory to sell of an item)
OOV = Out-Of-Vocabulary (words or terms that a LLM has not encountered during its training phase)
OS = Operating System
OSCAL = Open Security Controls Assessment Language (NIST-defined format for communicating CVEs)
OSCP = Online Certificate Status Protocol (used to obtain the revocation status of X.509 digital certificates)
OSI = Open Systems Interconnection
OSINT = Open Source Intelligence (from social media)
OSS = Open Source Software
OT = Operational Technology
OTA = Over The Air
OTCSA = Operational Technology Cyber Security Alliance
OTOH = On the Other Hand (chat slang)
OTP = One-Time Password (for security)
OTR = Off The Record (privacy)
OVAL = Open Vulnerability and Assessment Language
OU = Organizational Unit

OUI = Organizational Unique Identifier

The first three bytes of the six-byte field of the MAC address the IEEE identifies as vendor of the network adapter.

OWA = Outlook Web Application (Microsoft Exchange web interface)
OWASP = Open Web Application Security Project

P

P2P = Person to Person or Point to Point
PaC = Policy as Code
PaaS = Platform as a Service
PaLM = Pathways Language Model (built based on Google’s Pathways system as a dense decoder-only transformer LLM with 540 billion parameters for a wide range of AI tasks including reasoning, natural language understanding, text generation, multi-step logical inference reasoning, arithmetic, code generation, and translation)
PAM = Privileged Access Management
PAN = Primary Account Number (PCI DSS)
PAP = Permissible Actions Protocol (defines actions to avoid attackers detecting investigation - RED for non-detectable actions, AMBER for passive, GREEN for active, WHITE for no restrictions)
PASTA = Process for Attack Simulation and Threat Analysis
PAT = Personal Access Token (to authenticate GitHub static access)
PAT = Port Address Translation (networking)
PAW = Privileged Access Workstation (Microsoft)
PAYG = Pay-As-You-Go (such as for cloud services billing)
PBC = Printed Control Board
PBC = Provided By Client (SOC term)
PBL = Project-Based Learning
PC = Personal Computer (refers to a Microsoft Windows machine)
PCA = Principal Component Analysis (dimensionality reduction algorithm that identifies the hyperplane variance closest to the data to project data onto it)
PCI = Peripheral Components Interconnect
PCI DSS = Payment Card Industry Data Security Standard (private regulation by credit card processors to prevent identity theft)
PCIe = Peripheral Component Interconnect Express (bus to connect solid-state drives directly to the CPU)
PDCA = Plan Do Check Act (created by Deming to iterate improvement, adopted for Agile development)
PDD = Project Delivery Document (containing IS project scope prerequisites scheduling info etc.)
PDF = Portable Document Format (the format created by Adobe to create a universally accessible file containing graphics and text)
PDW = Parallel Data Warehouse (Microsoft SQL 2012 Analytics Platform System that became Azure SQL Data Warehouse)
PE = Pre-installed Environment (a bootable image of Microsoft Windows used to automate install)
PEFT = Parameter-Efficient Fine-Tuning (techniques such as LoRA to update a small subset of an AI ML model’s parameters)
PEM = Privacy Enhanced Mail (AWS private key certificate encoding file type)
PEP = Python Enhancement Proposal
PEP = Policy Enforcement Point (filters requests and makes eXtensible Access Control Markup Language (XACML) to a Policy Decision Point (PDP)
PETM = Parameter-Efficient Tuning Methods (in Generative AI)
PF = Privacy Framework
PFAS = Per- and polyfluoroalkyl Substances (carcinogenic forever chemicals)
PFS = Perfect Forward Secrecy
PHD = Personal Health Dashboard
PHE = Partially Homomorphic Encryption
PHI = Protected Health Information
PHP = (recursive acronym for PHP: Hypertext Preprocessor. A web scripting language used in WordPress)
PHS = Password Hash Synchronization (Microsoft Azure AD Connect)
PIA = Privacy Impact Assessment
PID = Process Identifier
PID = Proportional Integral Derivative (keeps a variable within a set of parameters/conditions, such as auto cruise control)
PII = Personally Identifiable Information
PIM = Privileged Identity Management
PIN = Personal Identification Number (a secret consisting of a small number)
PIO = Programmable Input Output (An Arduino feature to create hardware interfaces using GP IO pins)
PIOPS = Provisioned Input Output Operations Per Second
PIR = Passive Infra-Red (electronic sensor)
PIV = Personal Identity Verification (uses tokens like YubiKeys)
PKE = Public Key Encryption
PKI = Public Key Infrastructure (manages cryptographic certificates)
PM = Product Management/Manager
PLA = Polyactic Acid (filament for 3D printing. Made from organic materials. Has low melting point and absorbs moisture.)
PLC = Programmable Logic Controller
P&L = Profit and Loss
PMM = Product Marketing Manager (organizational role)
PMO = Program Management Office
PMS = Pantone Matching System (to select colors)
PNAC = Port-Based Network Attack
POA&M = Plan of Action and Milestones
PoC = Proof of Concept
POGIL = Process Oriented Guided Inquiry Learning
POLP = Principle of Least Privilege
POM = Production Operations Management
POR = Process of Record
PPE = Personal Protective Equipment
PPE = Poisoned Pipeline Execution (of CI/CD pipeline configuration files such as Jenkinsfile, .gitlab-ci.yml, makefile, etc.)
PPE = Pre-Production Enviornment
PPG = Point-to-Point Tunneling Protocol (networking)
PPG = Proximity Placement Group (Azure VMs)
PPK = Putty Private Key (AWS private key certificate encoding file type for Windows PuTTY SSH client)
PPO = Proximal Policy Optimization (A reinforcement learning algorithm that improves training stability and reliability)
PPTP = Point-to-Point Tunneling Protocol
PQC = Post-Quantum Cryptography (encryption resistant to crackers on fast quantum computers)
PR = Pull Request (GitHub feature for suggesting code changes and integrating them into the main code base)
PRD = Production (vs NPD for non-production in keeping with a consistent number of letters)
PS = Professional Services
PSD = Power Spectral Density (for vibration spectrum analysis)
PSE = Professional Services Engineer
PSIRT = Product Security Incident Response Team (protects customers of products)
PSK = Pre-Shared Key
PTA = Pass-Through Authentication (agents in Microsoft Azure AD Connect)
PTAL = Please Take A Look
PTES = Penetration Testing Execution Standard
PTT = Platform Trust Technology (on Intel chips for Windows PCs)
PTZ = Pan-Tilt-Zoom (Cameras)
PUA = Potentially Unwanted Application
PV = Persistent Volume (Kubernetes)
PV = Paravirtual Virtualization (type of Linux AMI boot loader)
PVM = Python Virtual Machine
PVC = Persistent Volume Claim (Kubernetes)
PWA = Progressive Web Application (application intended to work on any platform with a standards-compliant browser, including desktop and mobile devices)
PWC = Price Waterhouse Coopers (International Global Integrator Consulting firm)
PWM = Pulse Widthe Modulation

Q

QA = Quality Assurance
QBR = Quarterly Business Review
QEC = Quantum Error Correction (IT)
QFT = Quantum Field Theory (combines quantum mechanics, special relativity, and classical field theory to describe the mechanics of higher dimensional math)
QIR = Quantum Intermediate Representation (Microsoft)
QKD = Quantum Key Distribution (secures communication using a cryptographic protocol involving quantum computing with lasers)
QLDB = Quantum Ledger Database (AWS)
QML = Quantum Ledger Database (Microsoft)
QoQ = Quarter on Quarter
QoS = Quality of Service
QPU = Query Processing Unit (to bill CPU capacity in Microsoft Azure Analytics Services)
QPU = Quantum Processing Unit (Quantum IT)

R

RACI = Responsible + Accountable + Consulted + Informed (Responsibility Assignment Matrix)
RAD = Rapid Application Development (methodology)
RAG = Retrieval Augmented Generation (extension such as PostgreSQL pgvector to add proprietary knowledge to foundation models without retraining)
RAID = Redundant Array of Independent Disks
RAM = Random Access Memory
RAM = Resource Access Manager (AWS)
RAN = Radio Access Network
RASP = Runtime Application Self-Protection
RAT = Remote Access Trojan (malware)
RBAC = Role-Based Access Control
RBG = Random Bit Generator
RBVM = Risk-Based Vulnerability Management
RCA = Root Cause Analysis
RCS = Rich Communication Services (messaging, voice, video)
RCE = Remote Code Execution
RCE = Root Code Execution
RDD = Resilient Distributed Dataset (native data structure underlying Apache Spark Dataframes used by Pandas)
RDF = Resource Description Language (W3C standard for graph databases)
RDL = Report Definition Language (XML representation of a paginated report definition from Microsoft SQL Server Reporting Services)
RDMA = Remote Direct Memory Access (to share liquid-cooled memory in parallel connected by low-latency Ethernet fabric by SMCI)
RDP = Remote Desktop Protocol (Microsoft technology for users to access a Windows computer remotely)
RDS = Relational Database Service (AWS cloud SQL service to host databases)
REST = Representational State Transfer
REEs = Rare Earths Elements (mining and processing, mostly in China, for minerals needed in modern electronics)
RFI = Request for Information
RFP = Request for Proposal
RFQ = Request for Quote
RGB = Red Green Blue (colors)
RGDD = Reliable Group Data Delivery (SDN)
RRA = Rapid Risk Assessment (NIST)
RIP = Rest In Peace
RISC = Reduced Instruction Set Computing
RLAIF = Reinforcement Learning with AI/LLM Feedback (Anthropic’s Constitutional AI)
RLHF = Reinforcement Learning with Human Feedback (to fine-tune ML rates after initial training)
RLS = Row-Level Security (in SQL database tables)
ReLU = Rectified Linear Unit (in Artificial Intelligence)
RMF = Risk Management Framework (for controls defined in NIST SP 800-53)
RMM = Remote Monitoring and Management (utilities)
RMSE = Root Mean Squared Error (to calculate the accuracy of a regression model)
RNG = Random Number Generator
RNN = Recurrent Neural Network (in Deep Learning)
ROA = Return on Assets
ROC = Report on Compliance (issued by DCS PSI auditors)
ROE = Return on Equity
RoHS = Restriction of Hazardous Substances Directive (EU Feb 2003)
ROI = Return on Investment
ROIC = Return on Invested Capital
ROM = Read-only Memory
ROS = Return on Sales
ROSA = Red Hat OpenShift Service on AWS (containers)
RoT = Root of Trust
RPA = Robotic Process Automation
RPC = Remote Procedure Call
RPO = Recovery Point Objective
RPS = Requests Per Second
RRA = Rapid Risk Assessment
RRS = Reduced Redundancy Storage (AWS)
RSA = Resident System Engineer (role within HashiCorp)
RSA = Rivest + Shamir + Adleman (an encryption algorithm and company name based on the initials of its inventors)
RSS = Real Simple Syndication (web feed format)
RSVP = répondez s’il vous plaît (French for Respond Please - an initialism where each letter is pronounced)
RTC = Real Time Clock
RTFM = Read The Fine Manual (slang)
RTO = Recovery Time Objective
RTOS = Real-Time Operating System (for IoT/Edge Computing)
RTSP = Real-Time Streaming Protocol (AWS Kinesis)
RUM = Resources Under Management (HashiCorp Terraform at scale)
RUP = Rational Unified Process (phased software development methodology from 2003 using object UML)
RaMP = Rapid Modernization Plan (Microsoft Zero Trust)

S

S3 = Simple Storage Service (AWS file object service)
SaaS = Software as a Service
SAIF = Secure AI Framework (Google)
SAM = Serverless Application Model (Amazon CLI)
SAML = Security Assertion Markup Language (XML-based standard for authentication and authorization)
SAN = Storage Area Network
SAP = Systems Applications and Product (large German ERP software company)
SAP = System Assessment Plan
SAQ = Self-Assessment Questionaire (of DSS PCI)
SAR = Security Assessment Report
SARIF = Static Analysis Results Interchange Format (standard by OASIS for sharing static vulnerability analysis results)
SARs = System Assessment Results
SAS = Shared Access Signature (secure token URI to Azure accounts and storage resources)
SASE = Secure Access Service Edge (Microsoft & Trust Broker SaaS by Palo Alto Prisma zScaler Cato Cloudfare)
SAST = Static Application Security Testing
SBC = Single-Board Computer (like the ZimaBoard 832)
SBI = Service-Based Interface
SBOM = Software Bill of Materials
SCA = Software Composition Analysis (identify vulnerable components in containers)
SCADA = Supervisory Control And Data Acquisition
SCAP = Security Content Automation Protocol
SCC = Security Command Center (Google’s SOC service)
SCEP = Simple Certificate Enrollment Protocol
SCF = Secure Controls Framework (SEC)
SCIM = System for Cross-Domain Identity Management (IT security)
SCM = Source Control Manager (such as GitHub)
SCP = Service Control Policy (in AWS to govern the use of other IAM policies)
SCRM = Cyber Supply Chain Risk Management (defined by NIST)
SCSS = Sidecar Container Security Stack
SCT = Schema Conversion Tool (AWS)
SDD = Spec Driven Development (Vibe coding Kiro and Spec Kit platform from GitHub)
SDE = Standardized Development Environment
SDK = Software Development Kit
SDL = Schema Definition Language (in GraphQL)
SDN = Software-Defined Networking (used by AWS - an advancement to BGP used on public networks)
SDLC = System Development Life Cycle
SDMN = Software-defined Mobile Network (for SDN)
SDR = Single Data Rate (memory)
SDRAM = Synchronous Dynamic Random Access Memory
SDP = Software Defined Perimeter
SDP = Software Delivery Platform
SEB = Secure Enterprise Browsers
SEC = Security and Exchange Commission (regulates US financial markets)
SERP = Search Engine Results Page
SES = Simple Email Service (AWS)
SEU = Single Event Upset (a soft error caused by a random alpha particle flipping a bit)
SF = Service Fabric (Azure)
SFC = Sequential Function Charts
SFT = Supervised Fine Tuning (a pre-trained model on labeled data for a specific task)
SG = Security Group
SGD = Stochastic Gradient Descent (AI technique to iteratively optimize)
SHA = Secure Hash Algorithm (a method to identify whether a file has been altered - also used by GitHub to create an index)
SHD = Service Health Dashboard (AWS)
SI = Systems Integrator
SIA = Storage Infrequent Access (AWS)
SIEM = Security Information and Event Management
SIG = Special Interest Group
SIGINT = Signals Intelligence (of electronic transmissions)
SIP = Session Initiation Protocol (real-time multimedia communication sessions over IP networks)
SIRP = Security Incident Response Plan (for SOC2)
SIRT = Security Incident Response Team (work in a SOC department)
SIS = Safety Instrumented System (automated control system that safeguards manufacturing environment in case of any hazardous incident in the industry)
SKSKSKSK = (internet slang expressing excitement)
SLA = Service Level Agreement
SLAM = Simultaneous Localization and Mapping (of image file contents by OpenCV)
SLE = Single Loss Expectancy
SLI = Service Level Indicator
SLM = Small Language Model
SLO = Service Level Objective
SLR = Service Linked Role (in IAM for Amazon Lightsail)
SLSA = Supply chain Levels for Software Artifacts (framework of standards and controls for a secure supply chain to build secure resilient software)
SMB = Server Message Block (storage)
SMB = Small or Mid-sized Business
SME = Subject Matter Expert
SMF = Session Management Function
SNDL = Store Now Decrypt Later (for malicious decryption when quantum enables it)
SMI = Service Mesh Interface
SNMP = Simple Network Management Protocol
SMaaS = Service Mesh as a Service
SMTP = Simple Mail Transfer Protocol
SNI = Server Name Indication (SSL)
SNS = Simple Notification Service (to send and receive notifications in AWS)
SOA = Service Oriented Architecture
SOAP = Simple Object Access Protocol (uses XML)
SOAR = Security Orchestration Automation and Response
SOW = Statement of Work
SOC = Security Operations Center
SoC = System on a Chip
SOC2 = Systems and Organization Controls (AICPA ISO 27701)
SOP = Standard Operating Procedure
SORN = System of Record Notice
SOTA = State of the Art
SOX = Sarbanes-Oxley Act
SPA = Single Page Application
SPF = Sender Policy Framework (lists IP address of servers allowed to send email for a domain - for email authentication)
SPI = Service Provider Interface
SPI = Secure Personal Information
SPI = Serial Peripheral Interface (master/slave protocol that requires a clock signal to transmit any information)
SPICE = Super-fast, Parallel, In-memory Calculation Engine (used in AWS QuickSight)
SPIFFE = Secure Production Identity Framework for Everyone (spec used by Consul Connect service mesh for establishing service identities)
SPK = Spacecraft and Planet Kernel (files from NASA containing ephemeris data for solar system bodies, spacecraft, and other objects)
SPOC = Single Point of Contact
SPOF = Single Point of Failure
SPLK = Splunk’s stock ticker symbol
SPN = Service Principal Name (Unique identifier for a service instance within Kerberos)
SPSCR = Security, Privacy, and Supply Chain Risks (in RMF)
SPAN Port = Port configured to receive a copy of every packet that passes through a switch.
SQL = Structured Query Language
SQS = Simple Queue Service (AWS hosted queues of messages)
SRA = Security Reference Architecture
SRE = Site Reliability Engineer (job role)
SRG = Security Requirements Guides (general guidelines for STIGs, from DISA)
SRP = Single Responsibility Principle
SRTM = Software Requirements Traceability Matrix
SRUM = System Resource Utilization Monitor (on Windows machines)
SSAE = Statement on Standards for Attestation Engagements
SSAS = SQL Server Analysis Services (from Microsoft)
SSD = Solid-State Drive (data storage)
SSE = Server-Sent Events (A one-way channel from server to client. The client subscribes to a stream of events, and the server continuously sends updates as text-based messages.)
SSDT = SQL Server Data Tools (Microsoft SQL Server)
SSE = Security Service Edge (Microsoft conditional access mechanisms for Zero Trust)
SSE = Server Sent Events (machine-level protocol used between MCP components)
SSE = Server-Side Encryption
SSG = Static Site Generator
SSDLC = Secure Software Development Lifecycle
SSH = Secure Shell (a Linux feature to enable remote access of computers)
SSI = Sensitive Security Information
SSIS = SQL Server Integration Services (Microsoft)
SSL = Secure Sockets Layer (deprecated by TLS networking protocol)
SSML = Speech Synthesis Markup Language
SSMS = SQL Server Management Studio (Microsoft app)
SSN = Social Security Number (issued by the US government to unique identify an individual for taxes)
SSO = Single Sign On (IAM MFA)
SSoT = Single Source of Truth
SSP = System Security Plan
SSPR = Self-Service Password Reset (Security)
SSRF = Server Side Request Forgery
SSRM = Shared Security Responsibility Model
SSRS = SQL Server Reporting Services (Microsoft)
STA = State of The Art (most modern)
STAR = Security Test Audit Report
STIG = Security Technical Implementation Guide (specific to each product used by DoD, from DISA)
STIX = Structured Threat Information eXpression (XML API to share threat models by OASIS)
STRIDE = Spoofing of user identity; Tampering; Repudiation; Information disclosure (privacy breach or data leak); Denial of service (DoS); Elevation of privilege
SLD = Secondary Level Domain (the letters before the last dot on URLs processed by DNS)
STS = Security Token Service (AWS)
STS = StatefulSets (Kubernetes)
SUT = System Under Test
SVD = Singular Value Decomposition (standard matrix factorization NumPy function to decompose training set)
SVID = SPIFFE Verifiable Identity Document (cryptographic file used by a workload to prove its identity to a resource or caller)
SWF = Simple Workflow (service from AWS for developers to run tasks in parallel or sequentially)
SWG = Secure Web Gateway

T

TAED = Target Actual Efficiency Downtime
TAM = Technical Account Manager
TAM = Total Addressable Market (marketing)
TaS = Test as Service
TAXII = Trusted Automated eXchange of Intelligence Information (how to share)
TB = TerraByte
TBD = To Be Decided (common vernacular)
TBH = To Be Honest (Gen Z slang)
TCB = Trusted Computing Base (secure boot kernel and other isolation tech)
TCC = Trusted Cloud Computing (Microsoft)
TCC = Transparency, Consent, and Control (for user data protection within Apple OS)
TCO = Total Cost of Ownership
TDE = Transparent Data Encryption (encrypt database without altering app interactions by substituting encrypted values in the background outside apps)
TDIR = Threat Detection and Incident Response (security workflow)
TDP = Thermal Design Power (avg. max. power a processor dissipates heat while running)
TDM = Technical Decision Maker (vs. Business Decision Maker)
TEE = Trusted Execution Environments (to provide secure runtime)
TFC = Terraform Cloud (SaaS Terraform offering)
TFE = Terraform Enterprise (self-installed/managed Terraform)
TFW = The Feeling When
TIA = Thanks In Advance (chat slang)
TIC = Trusted Internet Connection
TIN = Tax Identification Number
TIP = Threat Intelligence Platform
TIPS = Treasury Inflation-Protected Securities (BLOG)
TCSEC = Trusted Computer System Evaluation Criteria
TCO = Total Cost of Ownership
TDD = Test-Driven Development
TDM = Technical Decision Maker
TDS = Tabular Data Stream (network protocol for communication between Microsoft SQL Server and its clients)
TEEP = Total Effective Equipment Performance (the actual percentage of calendar hour asset utilization versus theoretical 24x365 maximum)
TEMPEST = (not an acronym for analyzing unshielded equipment emissions to steal information) pdf
TFE = Terraform Enterprise
TLP = Traffic Light Protocol (defines levels of information sharing with contractors - CLEAR, GREEN, AMBER, RED)
TTFN = Ta Ta For Now (chat)
TGW = Transit GateWay (in AWS cloud)
TH = Threat Hunting
TIP = Threat Intelligence Platform
TLD = Top Level Domain (the letters after the last dot on URLs processed by DNS)
TLDR = Too Long Don’t Read
TLS = Transport Layer Security
TMI = Too Much Information (common vernacular)
TOE = Target of Evaluation (what is being evaluated by the Common Criteria EAL)
TOFU = Trust On First Use
TOML = Tom’s Obvious Minimal Language (config text file format)
TOON = Token-Oriented Object Notation (more compact than JSON for reading by models)
TOPI = Tensor Operator Inventory (pre-defined templates of common tensor operators e.g., conv2d, transpose)
TOPS = Tera Operations per Second (AI inference performance)
TOTP = Time-based One Time Password
TPISRM = Third Party Information Security Risk Management
TPM = Trusted Platform Module (on newer Microsoft Windows PCs)
TPRM = Third Party Risk Management
TSC = Trust Service Criteria
TSI = Trustworthy Software Initiative (UK)
TTE = Trusted Execution Environments (Microsoft Azure)
TTL = Time To Live
TTP = Trusted Third Party
TTP = Tactics + Techniques + Procedures (of security attack)
TTS = Text To Speech
TTT = Train the Trainer
TTV = Time to Value (marketing term)
TTX = TableTop eXercise (for security resilience)
TUI = Text-based User Interface (Command Line Interface)
TVM = Threat and Vulnerability Management (Microsoft)
TVM = Tensor Virtual Machine (fast Apache Python Deep Learning compilation framework)

U

U = yoU (chat slang)
UAC = User Account Control (on Windows)
UAT = User Acceptance Test
UART = Universal Asynchronous Receiver / Transmitter (protocol)
UCS = User
UDF = User-Defined Function
UDM = Unified Data Management
UDR = User-Defined Routes (used by Azure)
UDS = Unified Diagnostic Services (use in vehicles)
UDT = User-defined Data Types
UEBA = User and Entity Behavior Analytics (detect any anomalous behavior - deviations from normal patterns of usage which have security implications)
UEFI = Unified Extensible Firmware Interface (spec. replaces BIOS to boot-up disks larger than 2TB)
UEM = Unified Endpoint Management/Manager (Microsoft Intune and Config. Manager)
UDP = User Datagram Protocol (networking)
UML = Unified Modeling Language
UNS = Unified Namespace (for MQTT to integrate IIoT components)
UPF = User Plane Function
UPN = User Principal Name (Microsoft)
URI = Universal Resource Identifier
URL = Universal Resource Locator
URM = Under-Represented Minority
USB = Universal Service Bus
USDC = US Dollar Coin (digital stablecoin backed 1:1 with USD such as BitPay Card)
USP = Unique Selling Proposition
UTC = Coordinated Universal Time (the new compromise term for GMT)
UTF = Unicode Transformation Format
UUID = Universally Unique Identifier (to identify information objects)
UVM = Unified Vulnerability Management (Armorcode: aggregate, correlate and prioritize findings from security tools)
UX = User eXperience

V

v12n = Virtualization (numeronym of 11 letters between v and n)
VAE = Variational Autoencoders (uses encoder-decoder architecture to generate new data for image and video generation)
VADER = Valence Aware Dictionary and sEntiment Reasoner (A lexicon that includes informal words used for sentiment analysis to determine emotional negativity)
VAR = Value-Added Reseller
VAT = Value-Added Tax
VBO = Value-Based Outcome
VCDM = Verifiable Credentials Data Model v2.0 (W3C Candidate Recommendation 2024 defines a schema for issuing, exchanging, and verifying credentials in a decentralized ecosystem using cryptographic primitives such as JSON-LD proofs and JWT-based verifiable presentations)
VCS = Version Control System
VDI = Virtual Desktop Infrastructure (from Citrix, Microsoft, AWS, etc. to share desktop infrastructure)
VDP = Vulnerability Disclosure Program
VEX = Vulnerability Exploitability Exchange
VGW = Virtual Gateway (Amazon AWS)
VHD = Virtual Hard Drive (holds Page Blobs in Azure Storage of up to 8TB in size)
VIF = Virtual InterFace (networking)
VIM = Virtualized Infrastructure Manager (AWS)
VIP = Virtual IP (address)
VLAN = Virtual Local Area Network
VM = Virtual Machine
VMC = Verified Mark Certificate (anti-spoofing logo validation DMARC from DigiCert)
VMSS = Virtual Machine Scale Set (Azure)
VMM = Virtual Machine Manager (aka Hypervisor)
VNC = Virtual Network Computing
VNF = Virtual Network Function
VoIP = Voice over Internet Protocol
VRRP = Virtual Router Redundancy Protocol
VRM = Vendor Risk Management
VPA = Vertical Pod Autoscaler (Kubernetes)
VPC = Virtual Private Cloud (AWS)
VPG = Virtual Private Gateway (AWS)
VPS = Virtual Private Server (AWS)
VDP = Vulnerability Disclosure Policy (CISA Pledge)
VLM = Vision-Language Model (AI models that jointly understand and generate both visual and language data)
VPN = Virtual Private Network
VRP = Vulnerability Research Program (way for organizations to receive security vulnerabilities found)
VSM = Value Stream Mapping
VSTS = Visual Studio Team Services (Microsoft)
VTA = Versatile Tensor Accelerator (an extension of Apache TVM)
VTFET = Vertical Transport Field Effect Transitor (IBM)
VTOC = Volatile Organic Compounds
VTL = Virtual Tape Library
vTPM = Virtual Trusted Platform Module
VUI = Voice User Interface (Amazon Alexa & Google Home)
VUCA = Volatile + Uncertain + Complex + Ambiguous
VXLAN = Virtual Extensible Local Area Network (enables scalability)

W

w/o = without (common vernacular)
W3C = World Wide Web Consortium (defines standards for JavaScript, HTML, XML, RDF, OWL, etc.)å
WAAP = Web application and API protection (a comprehensive security approach as an enhancement over web application firewalls)
WABD = Well Architected By Design
WAF = Web Application Firewall (AWS)
WAF = Well-Architected Framework
WAL = Write-Ahead Log
WAN = Wide Area Network
Wasm = WebAssembly (binary instruction coding for a stack-based virtual machine in browsers)
WBS = Work Breakdown Structure
WDYM = What Do You Mean? (chat slang)
WEP = Wired Equivalent Privacy (mobile security)
WFA = Work From Anywhere
WFH = Work From Home
WIP = Work In Process
WMI = Windows Management Instrumentation (Microsoft)
WMS = Warehouse Management System
WoL = Wake-on-LAN (BIOS/UEFI setting so device can save battery yet be worken from sleep from a static IP address)
WOT = Web of Trust (security)
WPA = Wi-Fi Protected Access
WPF = Windows Presentation Foundation (Microsoft)
WS = Workspace
WSDL = Web Services Description Language
WSFC = Windows Server Failover Clustering/Cluster (Microsft)
WTF = What The F*ck (internet slang)
WVD = Windows Virtual Desktop (Microsoft VDI was rebranded to Azure Virtual Desktop)

X

X.509 = (certificate format used for HTTPS on web servers digitally sign application code secure email and authenticate devices to corporate networks)
XaaS = Anything as a Service
XKX = External Key Store (Amazon service to store secrets outside of AWS)
XDR = Extended Detection and Response (formerly Microsoft Security Center)
XML = Extensible Markup Language
XMPP = Extensible Message and Presence Protocol
XOR = Exclusive-Or (Assembly language instruction and symmetric encryption algorithm)

Y

YAML = YAML Ain’t Markup Language (Human-readable data-serialization text format)
YMMV = Your Mileage May Vary (chat slang)
YOLO = You Only Live Once (slang)
YTD = Year-To-Date

Z

ZKP = Zero-Knowledge Proof (cryptographic protocols where a prover demonstrates knowledge of a secret to a verifier without disclosing the actual secret or other information)
ZOPA = Zone Of Possible Agreement (in a negotiation)
ZRS = Zone-Redundant Storage (across 3 Azure Availability Zones)
ZT = Zero Trust
ZTA = Zero Trust Architecture
ZTDA = Zero Trust Data Access
ZTNA = Zero Trust Network Access/Architecture
ZTS = Zero Trust Security

Other Glossaries provide definitions:

VIDEO of acronyms takes 21 minutes
https://www.acronymfinder.com/
https://tryhackme.com/r/glossary
https://www.edglossary.org/
https://github.com/mikepound/tls-exercises/blob/master/glossary.pdf
https://docs.aws.amazon.com/glossary/latest/reference/glos-chap.html

_{25-12-11 v082 OOS :2024-12-28-acronyms.md created 2024-12-28}

Acronyms was originally published by Wilson Mar at Index on December 11, 2025.

Git Custom Commands

2025-12-10T00:00:00+00:00

Less typing means less mistakes, and more time on social media

Overview

On a Mac:
On Windows:
Try git echo
Try git c “message”
- View log
- Graphviz
Visualization of branches
- ASCII Art
- Flowchart using Mermaid.js
Resources
More

Here is a deep dive into how you can define custom commands for Git to use.

I’ve stored several examples in a git-custom-commands folder within my repo.

   https://github.com/wilsonmar/git-utilities

Fork it so you can make changes and add more files of your own.
Get my repo onto your machine using a Git UI or in a Git command line:
```
git clone https://github.com/wilsonmar/git-utilities
```
On a Mac:
cd into the repo.
```
cd git-custom-commands
```
The contents of this folder needs to be within the path where the operating system searches for programs and scripts.
Optionally, create a folder on the operating system’s path by copying the git-custom-commands folder from within the Git repository into a folder in your home directory.

Creating your own folder enables you to add more files to that.
```
cd $HOME
mkdir git-custom-commands
```
Linux people often use /opt/bin, but on a Mac that is a protected area requiring sudo access.
Switch to a text editor to edit file ~/.bash_profile. For example, to use Sublime Text:
```
subl ~/.bash_profile
```
At the bottom or wherever, ADD the path to your git-custom-command files.

PROTIP: Git automatically make files available as a subcommand, just like regular executable scripts.

An example of referencing where I cloned:
```
export PATH="$HOME/gits/wilsonmar/git-utilities/git-custom-commands:$PATH"
```
This adds the folder to the front of the PATH.
View the PATH:
```
echo $PATH
```
So the changes “take”, exit terminal session windows or re-run Terminal initialization:
```
source ~/.bash_profile
```
cd into the git-custom-commands folder.
Set permissions to execute each file:
```
chmod 555 *
```
Skip to Try Git Echo below.

On Windows:
If you haven’t already, install Chocolatey, then
```
choco install mysysgit
```

Look for the libeexec\git-core folder:


cd /
dir git-core /s

What I see:

 Directory of C:\Program Files\Git\mingw64\libexec
 
04/21/2016  11:09 AM    <DIR>          git-core
            0 File(s)              0 bytes
 
 Directory of C:\Program Files\Git\mingw64\share
 
04/21/2016  11:09 AM    <DIR>          git-core
            0 File(s)              0 bytes

cd into the folder:

C:\Program Files\Git\mingw64\libexec\git-core

Older 32-bit machines would use:

C:\Program Files (x86)\Git\libexec\git-core

List files in git-core.

Notice several files do not have an *.exe file extension:
- git-bisect
- git-cittool
- git-cvsimport
- git-cvsserver
- git-difftool
- git-gui
- git-instaweb
- git-merge-octopus
- git-mergetool
- git-rebase
- git-request-pull
- git-send-email
- git-sh-setup
- git-sh-i18n
- git-stash
- git-subtree
PROTIP: The first line of these files define them as shell files which Git can process because Git executable on Windows has the bits to process shell files in sh.exe:
```
start "" "%SYSTEMDRIVE%\Program Files (x86)\Git\bin\sh.exe" --login 
start "" "%SYSTEMDRIVE%\Program Files\Git\bin\sh.exe" --login
```
Copy the contents of git-custom-commands into Git client’s git-core folder found above:

Try git echo
Try the command git-echo, created just so we can verify whether we have it working:
```
git echo "hello world"
```
You should see response:
```
hello world
```
Instead of “hello world”, you can type in any phrase. Double quotes are not necessary if you only type one word.

PROTIP: The git echo command is handled by a file named git-echo, which has NO file extension (such as .sh). Git knows to add the dash in the name when it looks for a custom command.

The $1 is the place-holder for the message typed into the command.

Try git c “message”

The git-c custom command is the equivalent to typing this:

git add -A
git commit -m '@mac: message in command line'

The command to invoke it:

git c “message in command line”

A sample response:

[master 181b537] @mac: message in command line 1 file changed, 0 insertions(+), 0 deletions(-) create mode 100644 4

The underlying code:

git add -A git commit –message=”@${PWD##*/} $1”

The weird set of characters in the commit line produces the Present Working Directory (PWD).

It is not really needed to add the username because

Troubleshoot your path if you see this error message:

git: 'c' is not a git command. See 'git --help'.
 
Did you mean one of these?
        checkout
        clone
        commit
        gc

View log

View the messages:

git log –oneline

Graphviz

Seth House did several videos on Git and GitHub, in which he showed use of a utility to create a visualization from the command line. He was nice enough to share it with me.

Install GraphViz using a package manager. On a Mac:
```
brew install graphviz
```
This installs dependencies libtiff, webp, gd
- http://www.graphviz.org/Download_macos.php - graphviz-2.40.1.pkg
- http://www.graphviz.org/Download_windows.php
Save the file from a text editor into folder

Alternately, copy the file graph-dag into that folder from the cloned folder.
Set permissions to execute the file:
```
chmod a+x graph-dag
```
Run the graph-dag that outputs a commit graph using the GraphViz “dot” tool:
```
git graph-dag HEAD~10.. | dot -Tpng > mygraph.png
```
Additionally, look at the other utilities at:

https://git.wiki.kernel.org/index.php/ExampleScripts
- Sorting commits by commit message line count / changed lines ratio
- Copying all changed files from the last N commits
- Setting the timestamps of the files to the commit timestamp of the commit which last touched them

Visualization of branches

git log does a good job of illustrating branches, but GitKraken provides this colorful branch graphics:

The master branch is the light-blue line on the left.
The Bug fix branch is the darker-blue line to the right of that.
The develop branch is the purple line to the right of that.

ASCII Art

Make some ASCII art from (part of your) history

A - B - C
  \       \
    D - E - F

Flowchart using Mermaid.js

Text like this within GitHub Markdown (used by Azure DevOps project Wikis, GitLab, Notion, Obsidian):

graph TD;
    A[Start] --> B(Process Input);
    B --> C{Check Status?};
    C -- Yes --> D[Finish];
    C -- No --> B;

or created using an online editor are read by Mermaid.js (open sourced at https://github.com/mermaid-js/mermaid) to produce Git graphs like this:

gitGraph
  commit
  commit
  branch develop
  checkout develop
  commit
  commit
  checkout main
  merge develop
  commit
  commit

BTW Like Graphviz, Mermaid draws Flowcharts, Gantt charts, Bar charts, User Journey diagrams, Pie charts, UML: Sequence Diagrams, Class diagrams, State diagrams,

C4 diagrams (Context, Container, Component, and Code). The four levels of C4 diagrams:

Context Diagram: This is the highest-level overview, showing the entire software system as a single box and its interactions with people and other systems. It helps define the system’s scope and external integrations.
Container Diagram: This level zooms into the system and shows its containers (like a web application, mobile app, database, or microservice) and how they communicate with each other.
Component Diagram: This diagram drills down into a single container, detailing the components inside it and their interactions. For example, a web application container might be broken down into components for user authentication and account management.
Code Diagram: This is the most detailed level, showing the implementation details of a single component, often using a traditional UML class diagram or similar notation.

Resources

http://mfranc.com/tools/git-custom-command/

This is one of a series on Git and GitHub:

Git Custom Commands was originally published by Wilson Mar at Index on December 10, 2025.

Protect Your Credit

2025-12-01T00:00:00+00:00

How to block thieves from taking advantage of data leaks to steal your good credit and money.

Overview

Your data is exposed
Proactive defense
Block Credit
- UnBlock Credit
- Free credit report

Your data is exposed

Today, what used to be secrets that uniquely identify you (social security number, birth date, home address, etc.) are now exposed over the dark web.

Even the government agency (DISA) which processes applications for Top-Secret clearance for all branches of the US military has been hacked.

Yet, many companies still give anyone access to your information when given enough of your secrets.

Monitoring is not enough. What will you do if you find out if you’ve been exposed?

[_] Look yourself up at:

HaveIBeenPwned.com

Proactive defense

Here’s what can you do to guard your secrets: I can help you.

Avoid doing business with organizations which have been hacked or does not offer MFA.
On your mac, install and use a secure internet browser: Tor using brew install –cask tor-browser
Install a Password Manager/Generator (KeePassXC) to generate a new for each account.
Create a password database that works locally rather than over the internet cloud.
Store your password vault on a secure USB device.
Enable your trustee to access them if you are ever disabled or killed.
Install Authenticator App Aegis (Android) or Authy on your mobile phone for MFA (Multi-Factor Authentication).
Get a USB Yubikey (with custom markings) on your physical keychain to protect key accounts (emails, Paypal, banking, etc.).
Create a different email for signing up to utilities (phone, trash, electric, etc.).
Setup the phone number from your mobile carrier for Google Voice
Give out your Google number rather than the phone number from your mobile carrier.
Note in your Password Manager every account where you gave your private phone, so you can update them when that changes.
Generate random nonsense words as answers to account recovery, and write them in your Password Manager.
Give to medical personnel a birthdate that is a few days off because you’ll be asked to announce it publicly at medical offices.
Do not give out information to somone calling you.
Block thieves from using your social security number to apply for jobs.
Unblock it before you submit an I-9 before starting work.
Block thieves from opening credit in your name.
Unblock your credit before applying for a credit card or loan.
Open a POBOX to receive physical mail so your home address is not exposed.
Print bank checks with POBOX rather than your home address. Aoid writing paper checks.
Buy property using an Land Trust registed through a lawyer to avoid exposing your home address (but not jeopardizing Homestead protections).
Get a passport to show TSA during travel (both domestic and international).
Get a drivers license without your home address (not a Real ID).
Remove biometric capabilities before/while traveling.
Get a burner phone to use while traveling.
Open an email only for banks (so you can ignore emails about banking on your social email).
Create a different name and each account for social media.
Setup an alternative name and email address to make social media posts.
Setup blocks of calls from unknown numbers.
Add known callers to your allow list.
Ask those contacting you how they got your phone number.
Keep cash on hand for emergencies.
Hide valuables wisely.

Block Credit

In the US there are three companies that keep credit files which banks query before issuing credit:

WARNING: Do this at home rather than on an unsecure airport/hotel line.

[_] Equifax: Instructions at: https://www.equifax.com/personal/help/article-list/-/h/a/place-lift-remove-security-freeze/

For information, see https://www.equifax.com/personal/credit-report-services/credit-freeze or call 888-298-0045 or send a registered letter to: Equifax Information Services LLC, P.O. Box 105788, Atlanta, GA, 30348-5788 https://www.equifax.com/personal/products/credit/credit-lock-alert/
Use a secure browser to sign Up for an account online at
https://my.equifax.com/consumer-registration/UCSC/#/personal-info
Give your POBOX and phone.
Equifax challenges you with confirming historical trivia from your credit history.

QUESTION: Is there a PIN to make changes?

Optionally install the Equifax mobile app on iPhone or Android.
In your email app, add a star for any email from the “from email”.

[_] Experian (used by Capital One) https://www.experian.com/blogs/ask-experian/how-to-add-a-security-freeze-to-your-credit-file/

Use a secure browser to sign Up for an account online at
https://www.experian.com/freeze or 888-397-3742 (8AM - 7PM CST) or send a registered letter to: Experian Security Freeze, P.O. Box 9554, Allen, TX 75013
Click “Create a free account”.
Click in “Last 4 of Social Security Number” and type it.
Type in your secure phone number.
From the text message, copy the URL and paste in your secure browser.
Switch to the form and fill out your birth date, SSN.
Enter your banking email, POBOX mailing address
Generate a security question answer and random 4-digit PIN in your password manager.
Copy answers from the password manager and paste it in the form. Submit and Continue.
Call the company at 888-548-7878 if it cannot authenticate you.
Write down the confirmation number and PIN number in the mail. This is very important because even if people know all your info, they don’t know the PIN assigned to your account.
In your email app, copy the “from email” address and add a formula to star if when email comes from that email address.

[_] TransUnion (used by Capital One) 800-916-8800 M-F 8a-9p ET & SatSun 8a–5p ET. Instructions are at: https://www.transunion.com/credit-freeze/credit-freeze-faq#adding-freeze-0

PROTIP: Avoid using a secure browser to Sign Up for an account online at
https://www.transunion.com/free-credit-monitoring
Click “Sign Up for Free”. BLAH: I got stuck at their “Validating information”.
PROTIP: Sign up by phone: 833-806-1627 because I got rejected by their website.

QUESTION: Is there a PIN to make changes?

In your email app, add a star for any email from the “from email”.

“Although not required, including one proof of identity and two proofs of your current address with your request can help us locate your record more efficiently. If you include documents with your request, all documents should reflect your current name and be unexpired. Please only submit photocopies of your documents. These can include:

The above actions has no effect on credit cards you already own. A freeze does not block charges on your credit cards. You can still use the credit cards you have.

UnBlock Credit

If you forget to unfreeze you credit before applying, you will most likely be denied.

Credit agencies must lift the freeze within one hour of an unfreeze request made online or by phone, or within three business days when made by mail.

https://my.equifax.com/membercenter/#/home
Experian
https://service.transunion.com/dss/login.page?dest=freezeStatus

Free credit report

[_] Mark on your calendar a repeating appointment each year to request a credit report from each credit reporting agency.

According to https://consumer.ftc.gov/free-credit-reports Extra free reports qualify if denied credit/employment, suspecting fraud, or unemployed.

In a browser, go to AnnualCreditReport.com and select which bureau’s report you want (or all three).

WARNING: Other sites offering this service are scams. https://consumer.ftc.gov/free-credit-reports
Verify your identity with details like name, address, SSN, and account info—no credit card needed.
View reports instantly online, or request by phone (1-877-322-8228) or mail (form to P.O. Box 105281, Atlanta, GA 30348-5281; expect 15 days).

Protect Your Credit was originally published by Wilson Mar at Index on December 01, 2025.

Jekyll templates

2025-11-24T00:00:00+00:00

The most popular

Overview

Jekyll Theme shops
Jekyll.tips Templates
Responsive?
Gulp example
More on front-end styling

This article lists and evaluates templates for Jekyll, which drives GitHub.io static websites.

The structure of content (.md files) created for display using Jekyll makes it easy (with only a few edits) to switch the site to use any number of other Jekyll themes / templates.

Jekyll Theme shops

My personal favorite is:

jekyll.tips/templates by Mike Neumegen (@mikeneumegen, CEO of @CloudCannonApp, a SaaS services provider for Jekyll)

Within the Jekyll repository on GitHub:

github.com/jekyll/jekyll/wiki/Themes

Premium (paid) themes so you get updates and support, for less than $30.

jekyllthemes.io

This is an affiliate for other sites offering the same themes for less.

jekyllthemes.org

Jekyll.tips Templates

jekyll.tips/templates lists templates available at https://github.com/CloudCannon.

Bakery-store is in GitHub but not shown in the gallery.

Responsive?

To see responsive websites, get to it quicker on your mobile smartphone QR code is provided for you.

Themes from Michael Rose

Content on this website was created by editing markdown text (index.md files) stored on GitHub.com. The HTML sent to your browser for display is generated from markdown using Ruby running Jekyll 3.0 rendering modifications of the minimal-mistakes theme from GitHub by Michael Rose.

Michael also created the skinny-bones-jekyll theme demo forkable from GitHub. It features more use of graphics, and allows for localization.

Micheal blogs about his themes at https://mademistakes.com/articles/using-jekyll-2016/

Feature Comparison Table

Features by each template:

P	Feature	HPSTR	Minimal	Skinny	Simple
A	External links	YES	-	-	-
C	Floating menu	YES	-	-	-
A	Gallery layout	-	-	YES	-
B	I18n flags	-	YES+	-	-
B	AutoLocalization	-	YES+	YES	-
C	Multiple authors	-	YES	-	-
A	Page TOC	-	YES	-	-
A	Pages/Articles	-	*	YES	YES
A	Amazon links	-	-	-	-
B	Posts	YES	YES	YES	YES
A	Pagination	YES	-	-	-
C	Rakefile.rb	YES	-	-	-
B	Reading time	YES	-	-	-
A	Tags list	YES	-	-	-
A	Site search	+	YES+	-	YES
A	Social icons only	-	-	-	YES
A	Social names	YES	-	-	-
C	Timezones	YES	-	-	-
?	Game	-	-	-	-
?	Clickable Map	-	-	-	-
?	Shopping cart	-	-	-	-

All the themes feature:

YAML front matter in index.md files processed by Jekyll
404.md
feed.xml generation
Disqus support
Use of SASS
Theme setup page from the main menu / tab
Links to major social sites

PageTOC

A Table of Contents is displayed as a drop-down

\{\% include l18n.html \%\}

Installation and Generation

Michael Rose presents a concise description of how to install the minimal-mistakes theme. This post augments and clarifies it.

Begin by making a folder and populating it on my local machine.

There is both a Master branch and a Develop branch.

I don’t care about all the change history, so I click “Download ZIP” and unzip it into that folder rather than:

git clone https://github.com/mmistakes/minimal-mistakes.git

Grunt example

After downloading, have Maven pull in dependencies based on the Gemfile:

bundle install

This causes the list of dependencies in the Gemfile to be downloaded.

Behind the scenes is a running of the Gruntfie.js that comes with the theme. It defines the parameters of various tasks that are downloaded:

clean clears files and folders.
jshint validates files with JSHint, based on the .jshintrc configuration file at the root folder.
uglify minfies files with UglifyJS.
watch runs tasks whenever watched files change.
imagemin minifies PNG graphics files.
grunt-svgmin minifies SVG graphics files.

NOTE: File names beginning with a dot are hidden.

Gulp example

https://github.com/kriasoft/static-site-starter uses a gulpfile.js

More on front-end styling

This is one of several topics:

Jekyll templates was originally published by Wilson Mar at Index on November 24, 2025.

First-aid

2025-11-23T00:00:00+00:00

What is in an ideal field (first-aid) medical kit to prevent and treat accidents and trauma.

Overview

Common Medical Conditions
Kit
Medicines
Medicinal plants
Warmth (against Exposure & Shock)
Comms
AED
Oxygen

HSA/FSA Approved

Common Medical Conditions

$28.29 The Survival Medicine Handbook by Joseph and Amy Alton at doomandbloom.net & YouTube covers:

Appendicitis and Conditions that Mimic It
Urinary Tract Infections (UTI)
Mosquito-Borne Illnesses
Allergic Reactions and Anaphylaxis
Head Injuries
Animal Bites
Snake Bites
Head injuries
Kidney Stones
Dislocations and Fractures
Nosebleeds
Pain Medications
Natural Pain Relief

Kit

Medium kit.

The Alton’s 30 lb. FIRST AID KIT LARGE SIZE STOMP SUPREME™ is $1,699 plus:

$140 Full Dental Kit VIDEO and BOOK: “When There is No Dentist” by Murray Dickson.

We give large first aid kit as a house warming present.

At $259.99, the Scherber Fully-Stocked First Responder Professional Advanced EMT/EMS Trauma Kit Reflective Bag w/10+ Compartments, Zippered Pockets has 250+ items, including a neck brace, manual blood pressure cuff,

$45.99 for 333 items in a waterproof bag.

bandages, CPR face shield, gloves, iodine prep pads, instant cold pack, tourniquet, etc. Meets international medical standards, 100% latex free.

$200 Trauma kit</a> includes

ETQ Wide Tourniquet, Gen 1
Israeli Compression Bandage 4” for hemorhage control
Hemostatic Gauze
Slishman Wrap
Z Fold Compressed Gauze
Hyfin Compact Chest Seal
28F Nasal Airway incl Lube Pkt
Emergency Thermal Blanket
Trauma Shears
Abdominal Pad 5”x9”
Eye Shield Aluminum
Mini Black Sharpie
LED Flashlight
4x4 Burn Dressing
New Skin
$7.98 Bag Balm (Vermont) soothes and protects dry, cracked skin
Bug spray
Bug bite relief

Medicines

https://store.doomandbloom.net/first-aid-kits-hsa-and-fsa-eligible/?page=2

Alton’s Antibiotic Book ($27.99)

jasemedical.com sells medicines (antibiotics) from Canada. VIDEO:

Their $289.95 Jase case for those who complete a questionaire from ThomasLabs:

To treat bacterial infections of those without kidney conditions:

Amoxicillin-Clavulanate (Clavamox generic Augmentin) antibiotic 875-125mg $15 for 14, $17
Celecoxib (Generic Celebrex) 100mg capsules $10.59
Doxycycline $11.51
Metronidazole (generic Metrocream, Metrogel, Metrogel-Vaginal, Metrolotion, Flagyl, Nuvessa) $12.99 for 14 for Ghiadia.
Azithromycin (Generic Zithromax) 250mg (Pack of 6) $3.49 100mg (14 tabs)
Ciprofloxacin (Generic Cetraxal and Ciloxan and Cipro) $9.89 500mg (14 tabs) has side effects weakness of muscles
Clindamycin 150 mg (30 caps) = Fish Cin

For other conditions:

Loperamide (Imodium) $5.13 2mg x 30 caps for diarrhea.
Ondansetron (Generic Zofran) 4mg tablet $18.54 for nausea and vomiting caused by chemotherapy.
Triamcinolone 0.1% 30g cream $5.03 to reduce swelling and ulcers in the mouth.
Methylprednisolone (Generic Medrol) 4mg Dosepk (21 tablets) - US Only $10.93 for 4mg x 21 tabs to treat inflammation of the skin, joints, lungs, and other organs.

Go bag:

bacterial treatments above.
Trimethoprim-Sulfamethoxazole (Generic Bactrim and Septra and Sulfatrim) $8.67 800/160mg = Bird Sulfa to prevent some bacterial skin infections.
Scopolamine (Generic Transderm Scop antiemetics) $28.10 for 1 mg patch x3 to prevent nausea and vomiting.

$379.95

bacterial treatments above.
Acetaminophen (Generic Acephen and Mapap and Q-Pap and Tylenol) $2.61 325mg x 30 tabs to treat mild to moderate pain and reduce fever.
Dextromethorphan (Generic Delsym, Mucinex) $19.07 15mg x 180 caps to calm cough reflex.
Diphenhydramine (Generic Benadryl and Diphenhist and Unisom and Zzzquil) $2.70 25mg x 30 caps
Ibuprofen (Motrin) 200mg
Loperamide (Imodium) 2mg
Loratadine (Claritin)
Lubricant Eye Drops
Eye wash

Medicinal plants

VIDEO:

Hemlock looks similar to carrots, but paralyzes breathing
Foxglove (purpose cups) stops hearts
Death Camas looks like onions
Willow bark tea (bitter) has siliclic acid like aspirin
Plantain crushed leaves reduce swelling and itching
Dandellion tea has vitimin C
Yarrow promotes blood clotting & microbacterial

Warmth (against Exposure & Shock)

Tent
Cot
Sleeping bag
Wool blankets
Thick mylar to hide from UV cameras by hostiles.
Fire blanket
Tarps
Smoke Detector on ceiling
Carbon Mononxide Detector near the floor
Fire extinguisher (ABC rated)
Fire-Proof blanket
Fire escape ladder
Alcohol?
Pain killers

Comms

Get the frequency at https://noaaweatherradio.org has no Montana

GPRS walkie-talkie
Yaesu Ham radio YouTube @HamRadioCrashCourse
Rechargeable batteries (AA, AAA, C, D, 9V)
USB power bank

AED

Survival from an heart attack drops from 100% in 2 minutes to 20% in 12 minutes. So call 911 before starting.

Automated External Defibrillators (AEDs) provide critical emergency response for cardiac events. Wall-mounted cabinets ensure visibility and accessibility, while portable units offer mobility.

PROTIP: Keep a cloth-cutting sizzors and razor with your AED, for use dry. A hairy chest can prevent the AED pads from properly attaching and could cause an incorrect reading of the heart rhythm.

For $1,600 from Phillip’s HeartStart store, the Phillips HeartStart (HS1) M5066A-C02 has a self-test before use. When you install the battery for the first time the unit runs through a series of self diagnostics and will guide you through the setup process.

The FRX is for rugged enviornments. Insert its Infant/Child key for 0-8 year children under 55lbs.

It runs a self-check every 24 hours and makes voice prompts.

It offers a 8-yr warranty for AED, 4-year warranty for battery, pads are warrantied until expiration date. The kit comes with sticker to note expiration dates. But also add to your calendar.

After use, replace pads. Medical devices require professional training and maintenance per local regulations.

https://www.amazon.com/VBEGIN-Replacement-Battery-Compatible-Defibrillator/dp/B0DTHB9RCZ/ref=wilsonslifenotes $169.99 M5070A Replacement Battery Compatible with Philips Defibrillator, Replacement Battery for Models M5066A & M5068A - Made in USA (Model M5070-ABE)

An alternative is $2,195 ZOLL AED Plus (Fully Automatic)

Oxygen

$299.99 UQQU Portable Oxygen Generator-Stability Home Oxygen Generator,Easy to Operate. But only 1 year warranty.

First-aid was originally published by Wilson Mar at Index on November 23, 2025.

Weather information

2025-11-22T00:00:00+00:00

How to capture weather-related readings and display those metrics for your microclimate.

Overview

Measurements and Instruments
- Channels
Maps of Neighborhood Variation
Trends Over Time
Home Assistant
Internet Weather Reports
Python Program Code
Latitudes & Longitudes
Instrument Technologies
Ambient Weather Instruments
Weather on Roads in Each State
DIY Weather Stations
Cameras
Weather Prediction
Weather Forecasts
Ambient Weather API

Click “OVERVIEW” to minimize the Index

When a local weather station is installed, it needs primary and backup power and additional collector devices such as measurement of solar radiation. Ambient Weather devices have channels 1-8 to which Arduino or Raspberry Pi DIY can be added locally. MAC addresses are used to configure internet to the Ambient Weather Network service which displays a website. There is also local dashboard from a Home Assistant server. In a similar way, external websites display what Inductive Ignition, Palantir, and other enterprise-scale systems built with industrial-strength forecasting algorithms and a wide set of alerts. When alerts are sent to your local Listener service can trigger actuators to take physical action. Such exposure to the external public internet requires a firewall to filter out suspicious senders.

Measurements and Instruments

This display above is from the Ambient Weather WS-5000 series after installation/configuration:

(-) and (+) adjust values: Glossary

(-)
Minus
Brightness

(+)
Plus
Brightness
Adjust

Backlight
On/Off
toggle

Background
On/Off
toggle

Pressure
Absolute
/Relative
toggle

Channel

History

Set
Mode

The icon is the AmbientWeather.net dashboard for a sample location. (FAQ)
Wi-Fi signal strength icon. An exclamation point ! indicates the display is connected to Wi-Fi but not the Internet.
Outdoor Sensor Array Low Battery Indicator
Outdoor Sensor Array Signal Quality
Outdoor Temperature (shown with the larger ring) is measured in Centigrade or Fahrenheit by therometers. Above and below the current temp. in large numbers in the middle is the high of the day on top and low temp. of the day on the bottom. The time of day when that’s recalculated can be set in Settings.
Humidity is the percentage of water vapor in the air divided by the Dew Point.

A manual psychrometer (aka “sling psychrometer”) uses two thermometers. One has a wet wick around the bulb. The thermometer with the wet wick becomes cooler when water evaporates. The temperature difference on the two thermometers provides the Dew Point.

Manual hygrometers use a polished mirror. As air within the hygrometer is cooled to the dew point, moisture forms on the mirror, which blocks some of the reflected light, indicating that the dew point temperature has been reached.

The Heat Index shows how humidity adds to the danger of high perceived temperature:

These values are calculated for shady locations only. Exposure to full sunshine can increase heat index values by up to 15°F. Also, strong winds, particularly with very hot, dry air, can be extremely hazardous as wind adds heat to the body. Know Heat Illness Prevention.

“…your body starts to lose the ability to clot @ 95 degrees…”
Wind:
- Wind direction (blue arrow) is measured in compass degrees by wind vanes (looks like an airplane)
- Wind speed and Gust in mph is measured by anemometers within 10-minute average wind direction (larger gray arrow).
- Old anemometers have spinning cups
- New anemometers have ultrasonic technology that has no moving parts.
Leak detector status (channels 1-4, if installed)
Soil moisture, leaf wetness CH4 (Channel 4 among channels 1-8 for each of 8 WH31 Temp/Humidity remote sensors that can be added).
Current date and time
Lighting detector last strike, last strike time and strikes per hour (if installed).

Channels

PROTIP: Define you custom list if you install additional detectors:

Indoor
T&H CH1 = Pool (hard-coded)
T&H CH2 = unused
T&H CH3 = unused
T&H CH4 = unused
T&H CH5 = Upstairs freezer
T&H CH6 = unused
T&H CH7 = Downstairs leak detector
T&H CH8 = Downstairs freezer
Indoor, Channel 1-8 humidity
Indoor, Channel 1-8 temperature from additional instruments such as Ambient Weather’s WH31PF Wireless Waterproof Floating Pool and Spa Thermometer
CH (Channel) scroll mode indicator
Channel indicator.
Rain icon: maximum is 1.4 inch.
- “Rate”, daily, hourly, weekly, monthly and yearly rain inches
Forecast icon based on rate of change of pressure
“Barometer Reading”: BLOG: Atmospheric pressure is also called Barometric pressure because it’s measured by legacy barometers that measure the compression of mercury due to the weight of air above a square inch. The absolute pressue measured at Mean Sea Level (MSL) is 14.696 PSI (pounds per square) inch of mercury (due to gravity). That’s a constant 1013.25 hPa (hectoPascals) aka “millibars”, also designated as “1 ATM” by the International Standard Atmosphere (ISA) standard. That’s the equivalent of 29.92 inHg (inches of mercury, symbol Hg).

Wikipedia notes that the highest sea-level pressure on Earth occurs in Siberia, where record highs are 1,085 hPa (15.74 psi; 32.0 inHg). The lowest measurable sea-level pressure is found at the centres of tropical cyclones and tornadoes, with a record low of 870 hPa (12.6 psi; 26 inHg). The lowest place on Earth, the Dead Sea at 430 metres (1,410 ft) below sea level, has a typical atmospheric pressure of 1,065 hPa.

CALCULATOR: Temperature and humidity also affect the density of the air, which in turn affects atmospheric pressure. Pressure is proportional to temperature and inversely related to humidity, and both of these are necessary to compute an accurate figure.

Relative (REL) pressure readings decrease as you gain altitude AND as heavier clouds move away. To differentiate between altitude and weather impact, weather reports of locations are normalized relative to sea level. In the US, three digits are all that are transmitted: decimal points and the one or two most significant digits are omitted: 1,013.2 hPa (14.695 psi) is transmitted as 132; 1,000 hPa (100 kPa) is transmitted as 000; 998.7 hPa is transmitted as 987; etc.

REMEMBER: A system transmitting the last three digits transmits the same code (800) for 1080.0 hPa as for 980.0 hPa.

In technical terms, “Atmospheric pressure is thus proportional to the weight per unit area of the atmospheric mass above that location.”

BTW The weight of a column of freshwater of approximately 10.3 m (33.8 ft) is also “one atmosphere” (101.325 kPa or 14.7 psi). Thus, a diver 10.3 m under water experiences a pressure of about 2 atmospheres (1 atm of air plus 1 atm of water). Conversely, 10.3 m is the maximum height to which water can be raised using suction under standard atmospheric conditions.
“Max Daily Gust” of wind in MPH.
Moon Phase
“10 MinAvg” (10-minute average) wind speed and compass direction
“UV Index” (Ultraviolet Index) is measured by a UV meter (if installed).
Under arc: am: Sunrise, pm: sunset. On the website is this tile:

FUN FACT: About 5 minutes is lost or gained each day.
Solar Radiation, measured in W/m^2 (Watts per square meter), aka Lux or FC (Foot Candles) by pyranometers that have a dome-shaped sensor that can be seen from all angles, resembling a “UFO saucer”.

The measurement is used to calculate evapotranspiration - the potential for evaporation of moisture from the soil (or the reverse of rainfall) as a function of solar energy, wind, and temperature.

https://power.larc.nasa.gov/data-access-viewer

Solar Radiation is not displayed by default on Ambient Weather’s website. Can it be obtained from API?

Historically, sunshine intensity is measured thru direct solar radiation using pyrheliometers which have a tubular structure that needs to be aimed at the sun, mounted on a solar tracker. BTW Before electronic photoelectric sensors are used by computers, the Campbell-Stokes and Jordan Sunshine Recorders (in the UK) used a glass sphere to focus sunlight onto a recording card replaced each day, creating burn marks that indicate the duration of sunshine that day.
“IN “(Indoor) air quality in ug/m3 by a PM2.5 sensor (if installed)
“OUT” (Outdoor) Particulate monitor in ug/m3 by a PM2.5 sensor (if installed)
Dewpoint is calculated for measuring the comfort level from moisture in the air. A Simplified version of the Magnus-Tetens Formula is:

AirTemp - ( ( 100 − RelHumidity ) / 5 )

According to NOAA at weather.gov:

At 45 degrees or below, air feels “refreshing”.
At 50, it’s “comfortable”. At 55, it’s “not bad”.
At 60, it’s “muggy”. At 65 it’s “Very Humid”. At 70 it’s “tropical”.

Technically, Dew Point is the temperature to which air must be cooled (at constant pressure) in order for it to become saturated (have 100% relative humidity). Dewpoint is the maximum amount of water vapor air can hold at a given temperature. When air cools to its dew point, it reaches 100% relative humidity, and any further cooling causes water vapor to condense into droplets, forming dew or fog.

In other words, “The dew point is the temperature at which a given parcel of humid air must be cooled, at constant barometric pressure, for water vapor to condense into water. The condensed water is called dew. The dew point is a saturation temperature.”

For example, if the temperature is 80 and the dew point 70, the relative humidity is 72%. Much more water is in the air at 100% humidity at a temperature of 70 degrees than at 30 degrees.
“Feels Like” will always be cooler than the air temperature because it is calculated based on the impact of wind speed (Wind Chill Factor in cold temperatures) or humidity (Heat Index in hot temperatures) on human skin. high humidity can intensify the sensation of cold by increasing heat loss from your body. Likewise, a cloudy sky prevents sunlight from providing even slight warmth, making the chill feel even sharper. PROTIP: On cold windy days, wear “wind-proof” coats instead of woven sweaters because wind whisks away the thin layer of warm air your body creates to stay cozy, leaving you feeling the full bite of winter’s chill.
The lightning icon appears when when conditions make it possible for lightning storms to form in the area. The dew point is the temperature at which air becomes saturated with moisture at a given pressure, leading to the formation of dew, fog, or frost. BLOG
Daily Rain Icon: Rainfall is measured by rain gauges. Modern ones use ultrasonic technology that has less moving parts.

Tide levels?
Soil moisture is measured by soil moisture sensors (if installed).

Maps of Neighborhood Variation

This map of temperatue around a location shows the extent of variation among microclimates within just a mile or two – generated by AmbientWeather.net

Comparison vs. other weather stations (upwind, downwind, etc.).

Trends Over Time

This meteograph shows the relationship of changes among several metrics over time:

The temperature (brown line) warms up (by the sun) during the day. Temperature cools down at night.

As air cools, humidity (purple line) rises to condensate as morning fog or clouds.

Condensation is likely to occur when the air temperature reaches the Dew point (green line) rises to the temperature when air becomes saturated with moisture (at a given pressure). That’s when rain and snow occurs.

But remember that temperature (brown line) and dew point (in green) change independently of each other. Each can change without affecting the value of the other.

To see metrics over time with multiple metrics overlaid together, click “Graphs & Tables” on the AmbientWeather.net dashboard for a sample location:

Outdoor temperature, Dew Point, Feels like
Wind Speed with Wind Gusts overlaid
Wind direction (toward the direction of the wind
Daily Rain with Rain Rate
Relative Pressure: An upward trend indicates a high pressure system moving in with clear skies, while a downward trend indicates a low pressure sucking in bad weather.
Humidity
Sun Height (in yellow line) and Moon Height (in white line)

The highest point is not exactly Noon.
Air quality with Particulate matter overlaid
Rain with Snow overlaid
UV Index with Solar Radiation overlaid

AWN+ subscription unlocks premium features like degree day tiles, enhanced graphing, text alerts, and a 10-Day Hourly Forecast.

Advanced map layers are now free.

d3.js is a JavaScript library for producing dynamic, interactive data visualizations in web browsers. VIDEO

Upwind locations on the map would experience weather patterns (such as rain) before you (n=in a downwind location).

Home Assistant

Home Assistant integration. for smart Home display trends.

Internet Weather Reports

Ambient Weather has its own cloud (AWN) Network to receive weather reports for its devices.
- https://ambientweather.com/mwdownloads/download/link/id/1223
WeatherUnderground.com also accepts video from Ambient Weather AirCams.
WeatherBug.com (USA)
pwsweather.com (USA) Weather For You
windfinder.com (USA)
wxqa.com (Citizens Weather Observation Program) USA
openweathermap.org USA
wow.metoffice.gov.uk
awekas.at (Austria)

Python Program Code

I wrote a Python program to retrieve and format weather info from an API calls to openweather.com.

The program makes use of external modules, so can’t be run within ProgramWiz.

So run my program within Google’s Colab like the pros:

Open a Terminal app.
Bring the openweather.py file to the Terminal.

Type an exclamation point character in front of each Bash CLI command such as git.

In Google CoLab???

To copy a file from your Google Drive:

!cp /content/drive/My\ Drive/Importing\ Scripts\ as\ Modules/utils.py /content

Alternately, you can manually select the file using:

files.upload()

Set permissions:
```
chmod +x openweather.py
```
Set .env file containing the API keys ???
Because T-Mobile does not correctly identify your physical location, provide your US Zip Code when requesting the weather there:

openweather.py program:

Execute the program:

!./openweather.py -z 59041

The weather service converts your Zip Code to a latitude and longitude:

openweather.org
id: 5661766    at: 06:29 PM (18:29:44) 2025-04-01 TZ: -21600
       Sunrise: 06:55 AM (06:55:20) 2025-04-01 local time
        Sunset: 07:43 PM (19:43:30) 2025-04-01
overcast clouds at Laurel , country=US "lat=45.4959619&lon=-108.9589351"
  Latitude:  45.4959619° North of the Equator &
  Longitude: -108.9589351° East of the Meridian at Greenwich, UK
comfortable Dew Point of 25.78°F vs. 45.91°F at 45% humidity
  Feels like 39.42°F from Wind: 22.01 mph from NNW (313°)
  Visibility to 10000 meters
low -16 pressure at 997 hPa (HectoPascals = 9.97 millibars)
       vs. normal 1013.25 hPa at sea level
                  866    hPa at ground level

VIDEO: Readings from outlying weather stations are combined to provide a more accurate reading. During WWII, the Allies used stations in Iceland, and Ireland to forcast the weather for the Normandie Invasion on June 6, 1944.

Latitudes & Longitudes

A latitude and longitude make use of the Web Mercator Projection (EPSG:3857) which display spherical forms because it is much simpler to calculate than WGS 84 degrees (EPSG:4326) ellipsoidal datum. Land near the poles, such as Greenland, are distorted and appear larger than VIDEO: when moved to the equator for actual size. Google Maps, which uses it since 2005, cut off coverage at 85.051129° north and south. But the United States Department of Defense through the National Geospatial-Intelligence Agency has declared to be unacceptable for any official use.

Instrument Technologies

There are several technologies to measure your weather:

Build your own weather station on a Raspberry Pi, ESP32, etc.

Instrument manufacturers:

AcuRite “fell apart after a year”
- VIDEO
Ambient Weather
Davis Instruments
https://www.scientificsales.com/6252-Davis-Wireless-Vantage-Pro2-Weather-Station-p/6252.htm
$339 Tempest MAP
The $159.50 Ambient Weather Bridge updates (without the use of a PC or networking fees) weather servers real-time to Twitter, MySQL, EMail Summaries and Alerts, and aircams. See http://www.meteobridge.com/wiki/index.php/Push_Services

Several locally-run servers receive and display weather information:

The Ignition server
“Home Assistant”

Ambient Weather Instruments

Ambient Weather is a company that provides weather stations and data for consumer use.

$449.99 WS-5000 series has WiFi and no moving parts and a TFT color display manual VIDEO User Observations
$299.99 WS-2000 has WiFi & display
$144.99 WS-1965 is a entry-level monitor has moving parts.

Other Ambient Weather devices sold separately, with manuals online:

$77.99 Network WeatherHub to set up alerts, access your data remotely, and program your home based on weather conditions using IFTTT, Google Home, Alexa, and more. manual http://www.meteobridge.com/ using HTUhttps://angryip.org/download/
PM25 Particulate Monitor manual
PM25IN Indoor Particulate Monitor manual
AQIN Air Quality Monitor manual
WH3ILA Leak Detector manual
WH3ILC Infrared Motion Detector manual
WH3ILM Lightning Detector manual
WH315M Soil Monitor Sensor (part of garden bundle) manual
Pool manual
AirCam camera for feeding weather websites manual

Weather on Roads in Each State

https://www.511mt.net/#&zoom=5.669649843806675&lon=-110.0832903124836&lat=45.86084166111809

DIY Weather Stations

Others made their own weather stations using Raspberry Pi and other components that include sensors like wind, rainfall, UV Index, Lux Level.

VIDEO:Solar-Powered WiFi Weather Station V20 follows the Book: on Off-Grid Solar Power from Amazon by Debasish Dutta at @opengreenenergy. Features:

Monitoring Weather parameters like Temperature, Pressure, Humidity, altitude and UV level, etc.
Connect to Wi-Fi, and upload the data to the web ( Blynk App and Thingspeak)
Extra ports to add more sensors
Remote Battery Status Monitoring
Uses a powerful Li-Ion Battery ( 3400 mAh ) and Solar Panel (1W) for independence from external power source

Cameras

https://www.youtube.com/live/8E84ogCRg8Y&t=1m OpenMV cameras meetup

Weather Prediction

NVIDIA provides a free 3-hour beginner tutorial: “Applying AI Weather Models with NVIDIA Earth-2” to explore state-of-the-art FourCastNet AI weather prediction models and learn how to integrate them into custom workflows.

Weather forecasts suffer from two main sources of uncertainty

Measurement uncertainty: Observations are sparse and noisy
Model uncertainty: Models are not an exact representation of reality

This uncertainty is modeled through multiple forecast runs Start from slightly perturbed initial conditions Ensembles of several models allow making probabilistic statements about the future.

In contrast to deterministic forecasts, probabilistic forecasts attempt to model the uncertainty of the future. For weather forecasting, we are facing two main sources of uncertainty. The first one is measurement uncertainty. Weather observations come from weather stations, balloons, buoys, satellites, radar stations, and so on. But these measurements are sparse and not perfect, which introduces uncertainties. The second source of uncertainty are our models, which are not a perfect representation of the physical processes. This is true for both AI and numerical models. Models are used for forecasting but also for assimilating observations into a consistent analysis or reanalysis dataset.

We can make probabilistic statements about the future with the help of ensemble forecasts. Ensembling is a Monte Carlo-like approach where multiple similar but slightly perturbed forecasts are run to produce a distribution of future weather trajectories. For example, if we run 100 forecasts and 23 of these 100 ensemble members predict rain, we can estimate the chance of rain to be 23%. The forecasts cover the same time horizon but are started from slightly different initial conditions. Furthermore, variance is introduced into the forecasting process by either using a probabilistic model or an ensemble of multiple independent models.

Large ensembles are a prime area of application for AI weather models. While numerical systems are usually limited to ensemble sizes of up to 50 or 100 members because of computational constraints, AI systems can easily produce thousands of ensemble members. This makes it possible to characterize high-impact, low-probability events like hurricanes and compound events like heat waves with high humidity.

https://github.com/NVIDIA/earth2studio provides an easy interface for AI weather and climate model inference - from initial testing to projection deployment. It comes with a range of pre-trained models for various applications. Its modular components – data sources, perturbation methods, models, and IO handlers – are combined into custom applications without having to touch any of the other parts.

Forecast Prediction Validation is a transferrable skill: Set up the model, fetch data from sources like GFS, and run deterministic forecasts efficiently.

https://github.com/NVlabs/FourCastNet is a global AI weather model based on Spherical Fourier Neural Operators (SFNO) to create medium-range weather forecasts.

Weather Forecasts

Weather forecasts are indispensable for planning and decision-making in the public and private sector, with weather affecting anything from supply chain resiliency to energy production.

To conduct Monte Carlo probability analysis, we analyze the impact of intentional perturbations. Earth2Studio offers noise-based and model-based perturbation strategies to make this process easier. sample of plausible values

Noise-based perturbation e.g., Gaussian, Brownian, Perlin, Spherical Gaussian Pure noise generated independent of data Spatially correlated, with “natural” pattern Ideally taking spherical geometry into
More sophisticated, model-based methods use the forecast model to determine the amount and spatial structure of noise to be added to the perturbed variables. e.g., vector breeding, singular vectors Apply model to unperturbed and noise-perturbed data Iteratively calculate difference, use as new perturbation Identifies variables showing fastest growth/instability

For our exercise, we will perturb initial conditions and skip adding noise to the forecasting process. Initial condition perturbation captures the uncertainty inherent in the measurements and assimilation system. The simpler class of methods adds noise from a defined distribution and of a certain amplitude to some or all of the atmospheric variables.

Downscaling with CorrDiff (and StormCast)

Traditional numerical weather prediction systems are difficult to operate and place heavy demands on time and compute resources. Recent advances in AI weather modeling enable non-expert practitioners to run forecasts tuned to their own needs, validating model outputs, and explore how super-resolution AI models can make fine-grained predictions.

To build a custom AI weather pipeline:

Learn the fundamentals of AI weather simulation and understand the difference between AI-based and numerical weather prediction.
Gain hands-on experience running AI weather simulations with Earth2Studio for weather forecasting, historical analyses, and downscaling.
Get familiar with the individual parts of a weather inference pipeline: Data sources, perturbation, forecast and diagnostic models, and IO handling.
Validate the skill and calibration of weather forecasts with metrics commonly applied to deterministic and ensemble weather forecasts.
Build a custom AI weather model inference pipeline, using the example of coupling a global forecast model with a regional downscaling model.
Combine AI-generated weather data with downstream applications, following examples related to energy demand and production forecasts.

Ambient Weather API

The API (Application Programming Interface) allows programmers to use RESTful interactions in applications.

Get the MAC address of your model (such as “12:34:56:AB:CD:EF”) at:

https://ambientweather.com/faqs/question/view/id/1450/
Type the MAC address for your account at:
- https://ambientweather.net/devices
- https://ambientweather.net/account
Get the AMBIENT_API_KEY value to authenticate all REST API requests.
```
AMBIENT_API_KEY=1234567890abcdefb642b77c9d2c1b5df497a8c1f44f4b4e8fdf11c002ef2113
```
AMBIENT_API_KEY grants access to past/present data for a given user’s devices. A typical consumer-facing application will initially ask the user to create an apiKey on their AmbientWeather.net account page (https://ambientweather.net/account) and paste it into the app. Developers for personal or in-house apps will also need to create an apiKey on their own account page.
Get the AMBIENT_APPLICATION_KEY to identify the developer / application. To create an application key
```
AMBIENT_APPLICATION_KEY='your-application-key-here'
```
Enable the Ambient Weather app on your Amazon Alexa devices for its voice-based interactions, such as:
- ”Alexa, ask Ambient Weather for a weather report”
- ”Alexa, ask Ambient Weather the weather yesterday” (a specific day, month or year)
- ”Alexa, ask Ambient Weather for indoor conditions”
However, at time of this writing, one cannot ask:
- … ask Ambient weather the outside temperature”
- … ask Ambient weather the forecast”
- … ask Ambient Weather about today’s rain”
Adapt the Python Module for interacting with the Ambient Weather API.

github.com/bachya/aioambient by [email protected]">Aaron Bach is a clean, async-friendly library.

It’s preferred over the
https://github.com/avryhof/ambient_api
This need not be a var because when it does change, program code will probably need to be tested if not changed as well:
```
AMBIENT_ENDPOINT=https://rt.ambientweather.net/v1
```
Device Data Specs Wiki lists all the parameters that a device might send.

https://github.com/ambient-weather/api-docs/wiki/Device-Data-Specs
Add code in the calling program to account for API requests being capped at 1 request/second for each user’s apiKey and 3 requests/second per applicationKey. When this limit is exceeded, the API will return a 429 response code. Please be kind to our servers :)

API requests are capped at 1 request/second for each user’s apiKey and 3 requests/second per applicationKey. When this limit is exceeded, the API will return a 429 response code. Please be kind to our servers :)

The devices returned from the /devices endpoint contain a lastData parameter that contains the most up-to-date data we have for the device. Most devices update every minute, some update less frequently. The timestamps are rounded to the nearest minute.

Queries for past data using the /devices/:macAddress endpoint are returned in 5 minute or 30 minute increments. There can be up to a 10 minute delay before the most recent data becomes available. If you need up-to-the-minute data please use the /devices endpoint or forthcoming realtime API.

https://ambientweather.docs.apiary.io/# is generated from https://github.com/ambient-weather/api-docs

25-11-22 v044 + clot :2023-04-03-weather-info.md

Weather information was originally published by Wilson Mar at Index on November 22, 2025.

Flutter development

2025-11-20T00:00:00+00:00

Use Google’s Dart language calling Firebase database & Riverpod to create Gemini apps on iOS, Android, SPAs, PWAs

Overview

Flutter offers a single codebase to build applications that run across many platforms:

Desktop apps on Windows, Mac, Linux
Mobile (smart phone) apps on Google Android vs. Java
Mobile (smart phone) apps on Apple iOS vs. Swift programming
PWAs (Progressive Web Apps) and stand-alone SPAs (Single Page Apps such as products) on internet browsers

This is a complicated and difficult business because different technologies are used on each platform:

iPhone and Android smart phones have more hardware than PC laptops:

Camera to take pictures (QR codes)
Audio (music app Topline by Abbey Road Studios)
Location (GPS)
Bluetooth to headphones and speakers
NFC
Sensors

But building with Flutter enables cross-device communication: control a browser from a phone app, or controllwhat plays on your TV from your phone. Play music on one device and controls the music on another.

CAUTION: Flutter is not as convenient to build for text-rich presentations on the web as static web page generators such as Jerkyll for github.io websites.

Popularity vs Competitors

From v1.0 in 2017, the Flutter framework now has the largest share (and growing) in the cross-platform app development services market:

The JetBrains State of the Developer Ecosystem survey, Flutter has been the most used multi-platform app framework, since 2021.
App intelligence provider AppTopia reports that, in 2024, Flutter accounts for nearly 30% of all new free iOS apps.
VIDEO: Flutter vs. React native by @RomanJustCodes

React Native (from Facebook/Meta) is based on the open JavaScript language, which more front-end (web) developers know.

It’s more difficult and expensive to hire and retain a developer to write native SwiftUI code on iPhones and Jetpack Compose code on Androids.

Despite the technical aspects, in the US, there seems to be a lot more jobs in Native Android coding than cross-platform:

WARNING: In 2019 Google also partnered with IDE developer JetBrains and made their Kotlin language (based on Java) the official language for Android JetPack Compose development. They then created the Kotlin Multiplatform (KMP) for sharing business logic between Android and iOS. This has resulted in rumors of Google dropping Flutter like it has hundreds of their other offerings.

BEWARE: Multi-platform frameworks will always lag behind changes on native platforms. So Apple’s Liquid Glass UI cloud kill cause more testing effort.

PROTIP: The amazing advance of vibe coding (on Claude Code, etc.) may make intermediate platforms irrelevant. But will AI be able to create complex apps? Those new to development may find debugging of KMP easier than native code.

Architectural Deep Dive

Reactive Native uses a “JavaScript Bridge” JNI to iOS on its V8 Engine, so VIDEO: it doesn’t do smooth auto scrolling on iPhones, according to a benchmark.

Flutter’s Dart compiler has both a Dart VM with just-in-time (JIT) compilation and an ahead-of-time (AOT) to produce machine code native device code. VIDEO: However, the APK file loaded on Android from Flutter and React Native are 2x the 6 MB from native-produced. Since 2022, React Native includes in downloads to the app its Hermes JavaScript engine.

VIDEO Nevertheless, amazingly, Flutter is 2X faster than Native on the Time to Full Display (TTFD) load.

VIDEO Flutter takes almost double the graphics memory than Android native code. This may not matter since modern mobile devices have a lot of memory.

VIDEO: Flutter renders basic animations at 120 frames-per-second, on par with Android native, but faster than 51 by KMP & 96 by React Native.

what?

HANDS-ON: Firebase Cross Device Codelab The Presence API on Firebase’s Realtime Database (RTDB) enables apps that let users see their device online/offline status. Use it with the Firebase Installations Service to track and connect all the devices where the same user has signed in.

Get the music player app starter code:
```
git clone https://github.com/FirebaseExtended/cross-device-controller.git
 cd cross-device-controller/starter_code
 flutter pub get
 
```

Sample Flutter apps

https://flutter.dev/showcase
https://github.com/fluttergems/awesome-open-source-flutter-apps
https://appgallery.io/
https://appgallery.io/walidashik
GE Appliances uses Flutter to display UIs on small LCD screens found on modern appliances.
8 Must-See Flutter App Examples For Inspiration
CodeCanyon.net’s Flutter Full Applications, some with live preview.
- Xianyu (Alibaba) and Tencent QQ is big in China
- Hamilton Musical app
- Google Ads
- Groupon
- Ebay & Ebay Motors
- New York Times
- BMW, Toyota
- Phillips Hue
- https://goodhabitz.com/
25 Top Apps Made with Flutter
- Selection Criteria for Top Apps: What makes an app not just good, but great?
- Detailed Descriptions of Selected Apps: A close look at apps that are turning heads.
- Flutter’s Advantages in App Development: Why Flutter is the go-to for developers.
- Flutter’s Impact on Business Outcomes: How Flutter is rewriting the rules of business efficiency.
- Flutter vs. Other Platforms: A side-by-side comparison with its contemporaries.
https://apps.apple.com/us/app/kodebook-notes-upgraded/id6739565636 KodeBook: Notes, upgraded by Mustaq Sameer at https://kodebook.io
https://kobe.io/ = Kobe Apps, a mobile app SaaS Platform built in Flutter, to design and build a proof of concept, in English and Portugese.

Smart Phone features in apps

PROTIP: The biggest benefit to using Flutter instead of native languages (such as Swift for iOS) is that no user action is needed to update the app. However, this “Hot Reload” causes a little delay for Flutter users as code is updated.

Over the years, developers have grown weary of “Write Once, Work Everywhere” promises from Microsoft Xamarin, Cordova, Kivy, Kendo, PhoneGap, Unity, Ionic, Capacitor, etc.

Google’s “Material” and Apple’s “Capistrano” design systems have fundamentally conflicting design UI standards.

Flutter is free and open sourced by Google at:

https://github.com/flutter/flutter
REMEMBER: https://dart.dev/resources/glossary
- “Bottom type” is a type that has no values and is a subtype of all other types.
- Closurization = The process of turning a method or function into a closure.
- Code asset = Compiled native code that is bundled with a Dart app using a build hook and can be used through dart:ffi.
Documentation

docs.flutter.dev

Ecosystem APIs

Using Flutter means adopting Google’s entire ecosystem, which includes the Dart language code Google invented.
API reference is at https://api.flutter.dev. Actions on Google Console

Developing using Flutter involves mastering several technologies within Google’s development ecosystem:
- Google’s Dart language
- Android
- ARCore
- ChromeOS
- Firebase database & console
- Flutter (this page)
- Google Assistant
- Google Cloud
- Google Maps Platform
- Google Pay & Google Wallet
- Google Play console
- TensorFlow
Other Google services:
- AdMob
- AlloyDB
- analytics
- Android TV
- Assistant
- Cast
- Cloud Key Management Service (KMS)
- Cloud Run
- Cloud SQL
- GKE Enterprise
- ML Kit
- Google Workspace (Gmail)
- TensorFlow
- Wear OS
Get Social

https://flutter.dev/ecosystem
Follow:

https://blog.flutter.dev articles on Medium.com where new releases are explained with images.
Subscribe:

https://www.youtube.com/@flutterdev

https://www.reddit.com/r/FlutterDev/ for trolls

https://developers.google.com/community/experts if you are an expert already, like Marcus Twichel at Billings, United States
Sign up for the Flutter Community Forum:

https://forum.itsallwidgets.com/latest

PROTIP: Save the account name and password to your Password Manager.
Join the official Discord channel (and complete the intro) at https://discord.com/invite/ht477J5PyH

https://github.com/flutter/flutter/blob/master/docs/contributing/Chat.md
Join Premium (for $24.99/monrh):

https://developers.google.com/program/plans-and-pricing

Dev Project Rolls Costs

Online calculators like Estimate My App and Cleveroad help users calculate upfront costs of development by a team that consists of:

Product owner – oversees app creation and serves as the link between the project team and organization.
Project manager – manages project progression, ensuring timely and on-budget delivery.
Business analyst – analyzes the project requirements to ensure it meets business goals.
UI designer – creates user experience, ensuring an attractive and user-friendly app.
Flutter app developers – build the application.
Quality Assurance specialists – test the app to ensure it meets project requirements.

Practical Flutter Architecture (PFA) by Thomas Burkhart: MVC, MVU, MVVM, RVMS (Reactive View Manager Services), PFA.

Professional Certifications

https://developers.google.com/certification/associate-android-developer has been retired.

Popular content creator are Google Experts:

https://cloud.google.com/learn/certification/cloud-architect Google Professional Cloud Architect certification ?

https://androidatc.com/pages/Eng/Flutter-Certified-Application-Developer

https://www.youtube.com/watch?v=xWV71C2kp38

Cloud-based IDE Tutorial

Install FlutterLab (Flutter Development course) by Hrishi Suthar for $3.9 on Android and on iPhones provides a wealth of information. But the free version has annoying pop-ups.
Install Flutter Tips (from Andrea Bizotto) on Android and on iPhones
See list of Google’s tutorials at https://www.skills.google/catalog?keywords=flutter
Create your first app at Google Skills Tutorial below
https://www.geeksforgeeks.org/flutter/creating-a-simple-application-in-flutter/ 13 Mar, 2025
https://learning.oreilly.com/course/learn-flutter-and/9781805122029/ 30-hour video course May 2023 by Maximilian Schwarzmüller from Germany (https://maximilian-schwarzmueller.com/)
Animations in Flutter - a developer’s guide: Automated Carousel, Parallax effect, Animated button, Bouncing View, Animated Wave, Instagram Story.
https://learning.oreilly.com/library/view/-/9781098154752/

Tutorial1

Follow the steps below for my enhancements to steps (Nov 7, 2024 edition) at “Flutter Development” (GSP885) 1.5-hour hands-on course.

Install Chrome browser (after brew install google-chrome).
Start Lab. Click the IDE.
Click the three dots at the upper-right and select “New Incognito Window” to avoid conflicts with cookies.
Copy this url: https://console.cloud.google.com/
Press command + ` to switch to the Lab window.
Scroll down to click the icon to copy the Username, such as [email protected]
Switch to the incognito window and paste the Email.
Switch to the Lab window.
Scroll down to click the icon to copy the Password, such as [email protected]
Switch to the incognito window. Click “Enter the Password” and paste.
Click “I understand”, then check under “Terms of Service”, “Agree and continue”.
Click “Create or select a project”.
Notice: Project number: 1030115194620 Project ID: qwiklabs-resources

If using VSCode IDE, search for “Flutter: New Project”.
Click the Cloud Shell icon at the upper-right corner. Click Continue.

Click Authorize to see lines like this:

 Welcome to Cloud Shell! Type "help" to get started, or type "gemini" to try prompting with Gemini CLI.
 Your Cloud Platform project in this session is set to qwiklabs-resources.
 Use `gcloud config set project [PROJECT_ID]` to change to a different project.
 student_03_2e9edc111c72@cloudshell:~ (qwiklabs-resources)$ 

Task 1: Open the Code Server editor

In this lab, we will use a custom editor that includes the Flutter and Dart extensions.

Switch to the Lab window.
Click the copy icon for IDE.
Switch to the incognito window and paste the URL

Task 2. Create Flutter template “first_app”
Switch to the IDE window.
REMEMBER: Click control + shift + ` or click the menu at the upper-left to select “Terminal”.
Copy and paste for the “Welcome”
```
flutter create first_app
```
The name should be all lowercase, with underscores to separate words, “just_like_this”.Use only basic Latin letters and Arabic digits: [a-z0-9_].

``` Creating project first_app… Resolving dependencies in first_app… (1.1s) Downloading packages… Got dependencies in first_app. Wrote 129 files.

All done! You can find general documentation for Flutter at: https://docs.flutter.dev/ Detailed API documentation is available at: https://api.flutter.dev/ If you prefer video documentation, consider: https://www.youtube.com/c/flutterdev

In order to run your application, type:

$ cd first_app $ flutter run

Your application code is in first_app/lib/main.dart.

1. View the flutter app's commands: <pre>flutter</pre>

Manage your Flutter app development.

Common commands:

flutter create Create a new Flutter project in the specified directory.

flutter run [options] Run your Flutter application on an attached device or in an emulator.

Usage: flutter [arguments]

Global options: -h, –help Print this usage information. -v, –verbose Noisy logging, including all shell commands executed. If used with “–help”, shows hidden options. If used with “flutter doctor”, shows additional diagnostic information. (Use “-vv” to force verbose logging in those cases.) -d, –device-id Target device id or name (prefixes allowed). –version Reports the version of this tool. –enable-analytics Enable telemetry reporting each time a flutter or dart command runs. –disable-analytics Disable telemetry reporting each time a flutter or dart command runs, until it is re-enabled. –suppress-analytics Suppress analytics reporting for the current CLI invocation.

Available commands:

Flutter SDK bash-completion Output command line shell completion setup scripts. channel List or switch Flutter channels. config Configure Flutter settings. doctor Show information about the installed tooling. downgrade Downgrade Flutter to the last active version for the current channel. precache Populate the Flutter tool’s cache of binary artifacts. upgrade Upgrade your copy of Flutter.

Project analyze Analyze the project’s Dart code. assemble Assemble and build Flutter resources. build Build an executable app or install bundle. clean Delete the build/ and .dart_tool/ directories. create Create a new Flutter project. drive Run integration tests for the project on an attached device or emulator. gen-l10n Generate localizations for the current project. pub Commands for managing Flutter packages. run Run your Flutter app on an attached device. test Run Flutter unit tests for the current project.

Tools & Devices attach Attach to a running app. custom-devices List, reset, add and delete custom devices. devices List all connected devices. emulators List, launch and create emulators. install Install a Flutter app on an attached device. logs Show log output for running Flutter apps. screenshot Take a screenshot from a connected device. symbolize Symbolize a stack trace from an AOT-compiled Flutter app.

Run “flutter help ” for more information about a command. Run “flutter help -v” for verbose help output, including less commonly used options.

1. To disable reporting of telemetry, run this terminal command:
    <pre>flutter --disable-analytics</pre>

1. Navigate to the app's folder and run:
   <pre>cd first_app; flutter run</pre>

Connected devices:
Linux (desktop) • linux  • linux-x64      • Debian GNU/Linux 11 (bullseye) 5.10.0-30-cloud-amd64
Chrome (web)    • chrome • web-javascript • Google Chrome 126.0.6478.61
[1]: Linux (linux)
[2]: Chrome (chrome)
Please choose one (or "q" to quit):     ```    ### Task 3. Exploring the Flutter code

Click the folder icon at the upper-left of the IDE window.
Click “Open Folder” at /home/ide-dev/.
Select “first_app” to see its folders.
Click “OK” to see its files and folders:
Click file pubspec.yaml to view it on the right-side pane.

Task 4. Running the Flutter web application
REMEMBER: Click control + shift + ` or click the menu at the upper-left to select “Terminal”.

REMEMBER: Set the directory to first_app:

fwr

 Launching lib/main.dart on Web Server in debug mode...
 Waiting for connection from debug service on Web Server...         25.5s
 lib/main.dart is being served at http://0.0.0.0:8080
 The web-server device requires the Dart Debug Chrome extension for debugging. Consider using the Chrome or Edge devices for an improved development workflow.

 🔥  To hot restart changes while running, press "r" or "R".
 For a more detailed help message, press "h". To quit, press "q".

Type R (for “r”) to reload, waiting until “Recompile” message appears.
Click “Open in Browser” pop-up at the lower-right to open a URL such as: https://ide-service-6rqup7ut6q-uk.a.run.app/proxy/8080/
Click Command+` to switch to the Lab window. </a>
Click the copy icon for “Live Server” at the left panel.
Click the “+” at the top to start another incognito window.
Switch to the incognito window and paste the URL. Rendering of the web application can take up to ten seconds. The view will show the application based on the code in the editor.
Right-click to select “View Page Source”. REMEMBER: Instead of a lot of HTML, when the flutter_bootstrap.js file loads, it looks into manifest.json to know what else to load:
```
<link rel="manifest" href="manifest.json">
</head>
<body>
<script src="flutter_bootstrap.js" async></script>
</body>
```
That is called “Hot Reload”.

Task 5. Flutter Hot reload lib/main.dart
In the EXPLORER menu click “lib”, then “main.dart”.
Mouse over the separator above the Terminal panel and drag it down.

IMPORTANT: Leave a line exposed so you can easily type R (“r”) to Reload (even though the instruction is no longer visible.
Press “Esc” to enter Edit mode, because this is VIM.
Click to highlight Flutter Demo and type in its place Flutter is awesome
REMEMBER: Click control + shift + ` or click the menu at the upper-left to select “Terminal”.
Switch to the browser tab displaying “https://browser-service-6rqup7ut6q-uk.a.run.app/
Press CTRL+R to reload the page
Click control + shift + ` or click the menu at the upper-left to select “Terminal”.
Click “End Lab”.
Close the Incognito browser window and Google Skills web page.

Google’s Dart language

Confirm the version of the Dart language installed.

3.10 released on: November 12, 2025

Dart code files have an extension of “.dart”, introduced in 2011 and got to v1.0 in 2013.
List past versions at:

https://dart.dev/resources/whats-new
Contributed code used for Google’s demos

https://github.com/flutter/demos
open source samples that illustrate best practices for Flutter

https://github.com/flutter/samples?tab=readme-ov-file
TODO: dart install tool.

Contents of /lib/main.dart from *

 // Importing important packages require to connect
 // Flutter and Dart
 import 'package:flutter/material.dart';

 // Main Function
 void main() {
 // Giving command to runApp() to run the app.

 // The purpose of the runApp() function is to attach
 // the given widget to the screen.
 runApp(const MyApp());
 }

 // MyApp extends StatelessWidget and overrides its
 // build method.
 class MyApp extends StatelessWidget {
 const MyApp({Key? key}) : super(key: key);

 // This widget is the root of your application.
 @override
 Widget build(BuildContext context) {
     return MaterialApp(
            
     // title of the application
     title: 'Hello World Demo Application',
        
     // theme of the widget
     theme: ThemeData(
         primarySwatch: Colors.lightGreen,
     ),
        
     // Inner UI of the application
     home: const MyHomePage(title: 'Home page'),
     );
 }
 }

 // This class is similar to MyApp instead it
 // returns Scaffold Widget 
 class MyHomePage extends StatelessWidget {
 const MyHomePage({Key? key, required this.title}) : super(key: key);
 final String title;

 @override
 Widget build(BuildContext context) {
     return Scaffold(
     appBar: AppBar(
         title: Text(title),
         backgroundColor: Colors.green,
         foregroundColor: Colors.white,
     ),
        
     // Sets the content to the
     // center of the application page
     body: const Center(
            
         // Sets the content of the Application
         child: Text(
         'Welcome to Visual Studio Code!',
     )),
     );
 }
 }

Install for local Development on MacOS

https://docs.flutter.dev/get-started/custom#target-platform

Install Homebrew for Mac
Install git, XCode
Install Flutter for CLI with brew install –cask flutter
Install Visual Studio Code with extras for Flutter: https://marketplace.visualstudio.com/items?itemName=Dart-Code.flutter
1. Click “Install”.
Alternately:
1. In Go to View > Command Palette or press Command + Shift + P.
2. In the command palette, type flutter.
3. Select Flutter: New Project.
VS Code prompts you to locate the Flutter SDK on your computer. Select Download SDK.
1. When the Select Folder for Flutter SDK dialog displays, choose where you want to install Flutter.
2. Click Clone Flutter.
3. While downloading Flutter, VS Code displays this pop-up notification:
4. Downloading the Flutter SDK. This may take a few minutes. This download takes a few minutes. If you suspect that the download has hung, click Cancel then start the installation again.
5. Click Add SDK to PATH.
6. When successful, a notification displays: “The Flutter SDK was added to your PATH. VS Code might display a Google Analytics notice.” If you agree, click OK.
7. To ensure that Flutter is available in all terminals: Close all terminal windows. Then Quit and Restart VS Code.

Verify installation: <pre>flutter –version</pre>

 Flutter 3.38.2 • channel stable •
 https://github.com/flutter/flutter.git
 Framework • revision f5a8537f90 (15 hours
 ago) • 2025-11-18 09:27:21 -0500
 Engine • hash
 78c3c9557e50ee7c676fa37562558c59efd8406a
 (revision b5990e5ccc) (6 days ago) •
 2025-11-12 21:08:24.000Z
 Tools • Dart 3.10.0 • DevTools 2.51.1

To support Flutter plugins that use native macOS code, install the latest version of https://cocoapods.org/, following the CocoaPods installation guide See https://flutter.dev/to/platform-plugins
```
sudo gem install cocoapods
```
Alternately, CocoaPods update guide.
```
[sudo] gem install cocoapods
```

Run <pre>flutter doctor -v</pre>

 [✗] Chrome - develop for the web (Cannot find
     Chrome executable at /Applications/Google
     Chrome.app/Contents/MacOS/Google Chrome)
     [7ms]
     ! Cannot find Chrome. Try setting
     CHROME_EXECUTABLE to a Chrome
     executable.

Check for macOS devices to ensure Flutter can find and connect to your macOS device correctly, run flutter devices in your preferred terminal:
```
flutter devices
```

Create locally step-by-step

View Building your first Flutter App within https://codelabs.developers.google.com/?text=flutter with code at:

Install VSCode & Flutter (above)

Testing mobile apps

How to Test a Flutter app

Create an Android emulator, download Android Studio which also supports Flutter development, and follow the instructions in Create and manage virtual devices.
Create an iOS simulator, you will need a Mac environment. Download XCode, and follow the instructions in Simulator Overview > Use Simulator > Open and close a simulator.
TODO: dart build tool.

Agentic Vertex AI

Flutter with Google Vertex AI in Firebase (ViF) SaaS
Google Genkit lives on a server
https://blog.flutter.dev/learn-how-to-build-agentic-apps-with-flutter-angular-firebase-and-vertex-ai-ad46b38b1adb
https://flutter.dev/events/building-agentic-apps#home
MCP server?

SVG & Icon Fonts

.svg vector files look sharper and consume less space because they are treated like program code.

Search for images from stock photo sites:

dribble.com
pinterest.com

Dart function declaration to let the LLM set colors in your app:

FunctionDeclaration get setColorFuncDecl => FunctionDeclaration(
  'set_color',
  'Set the color of the display square based on red, green, and blue values.',
  parameters: {
 'red': Schema.number(description: 'Red component value (0.0 - 1.0)'),
 'green': Schema.number(description: 'Green component value (0.0 - 1.0)'),
 'blue': Schema.number(description: 'Blue component value (0.0 - 1.0)'),
  },
);

Graphically Design using Figma

Generate from visual designs in $20+/mo Figma Design Desktop app based on templates from $16.50/mo Envato

About Figma Design to Design and prototype in one place.

Features

User Authentication
Billing

E-commerce

https://github.com/googlecodelabs shown using npm ployserve.

panoply store

UI Widgets

PROTIP: Split code into separate widget sections for faster performance.

Google Material Design and Cupertino support Flutter’s wide range of widgets.

YouTube Live: Building scrolling experiences in Flutter | Workshop
Building next generation UIs in Flutter - animations, shaders, and particle effects that work across all of Flutter’s six platforms.

Smart Phone app features

animations and transitions to make apps visually stunning.

Utilize device features such as the camera within your applications.

Mastering Emulators in VS Code & Android Studio (Google Fold Pro & Pro Tips!) (virtual devices)

Zoho Tables mobile apps are built using Flutter and has a million lines of code. All state management is done using BLoC, ValueNotifier, ValueListenableBuilder.

Database

https://github.com/amugofjava/anytime_podcast_player uses Sembast, a NoSQL in-memory database but less suitable for a larger, more data-centric app.

Web apps

Flutter’s Skia rendering engine runs 60 frames per second for visually stunning and responsive user interfaces.

Taking Flutter to the Web By Damodar Lohani

Calls to APIs

Third-party integrations include cloud hosting, data storage, payment gateways, and SMS push notifications.

AI tools: Google Gemini, OpenAI (ChatGPT), Anthropic

Google’s Firebase Backend

Google Project Account to set up Firebase account.
Get on the FireBase Console at:

https://console.firebase.google.com/
Add Firebase to your Flutter app

Get to know Firebase for Flutter
Your first Flutter app
Build a Gemini powered Flutter app generates random, cool-sounding names. April 17, 2025 with Craig Labenz and Andrew Brogdon of DevRel. This use Asynchronous programming - Futures, async/await, and streams. Interprets the descriptions into precise RGB color values Displays the color on screen in real-time Provides technical color details and interesting context about the color Maintains a history of recently generated colors
1. Project setup - You’ll start with a basic Flutter app structure and the colorist_ui package
2. Basic Gemini integration - Connect your app to Firebase AI Logic and implement LLM communication
3. Effective prompting - Create a system prompt that guides the LLM to understand color descriptions
4. Function declarations - Define tools that the LLM can use to set colors in your application
5. Tool handling - Process function calls from the LLM and connect them to your app’s state
6. Streaming responses - Enhance the user experience with real-time streaming LLM responses
7. LLM Context Synchronization - Create a cohesive experience by informing the LLM of user actions
8. Configure Firebase AI Logic for Flutter applications
9. Craft effective system prompts to guide LLM behavior
10. Implement function declarations that bridge natural language and app features
11. Process streaming responses for a responsive user experience
12. Synchronize state between UI events and the LLM
13. Manage LLM conversation state using Riverpod
14. Handle errors gracefully in LLM-powered applications
Generate random dishes to cook and eat based on user criteria.
Local development for your Flutter apps using the Firebase Emulator Suite
Send and receive notifications for a Flutter app using Firebase Cloud Messaging
FCM

Resources

Jobs

https://www.virtualemployee.com/da/hire-flutter-app-developers/

Flutter development was originally published by Wilson Mar at Index on November 20, 2025.

Jekyll (JAM) site development

2025-11-18T00:00:00+00:00

Getting started with Jekyll

Overview

The objective
Upgrade Apple XCode
Install rbenv
Create a folder
- Install Jekyll (instead of Homebrew):
Bundle install
Grunt tasks
Serve Jekyll landing page
- Edit index.html author_profile
Change README.md content
- Edit _config.yml and reset server
- Edit _config.yml author info
Tabs, folders, and index.md files (for SEO)
- index.md under About folders
- index.md under folders
- Parsing of post file names
- UI Text Translation
- Metadata within .md files
- Layout types
- Liquid engine
  - Collections
- Link icon YAML
- .yml metada
- sitemap.xml in _site
- Bing it on
- Google Ownership
- Disqus comments
- Multiple authors
- Social links +
- Social sharing
Images
- In-line GFM images
- Clickable images
- Layout responsive to screen size
- Image sized to screen?
Markdown coding
- Notice boxes
- Blockquotes
- Footnotes
- Button colors in HTML
- SASS
- Paragraph Indents
- Numbered lists
- Code Snippets
- Gists
- Standard GFM mark-up
- Custom Includes
- Tables
Affiliate Ads
- Amazon Affiliate Ads
- Google Affiliate Ads
Site Search
.gitignore
Additional features
Deploy to server
Questions
Footnotes
Jekyll MinimalMistake users in the wild
More on front-end styling

NOTICE: Kubernetes.io moved their docs to Hugo in 2018.

This article contains notes on getting started with Jekyll and other static websites.

This is one in a series:

There is also Gatsby and others.

But Jekyll is still currently the most popular among static site builder options.

The objective

What we would like to do after going thrugh the below is to type this on a Terminal and a browser would open to show your Jekyll site locally.

In the macOS ~/.bash_profile add a shortcut, but substitute “wilsonmar” with your own GitHub account name:
```
alias js='cd ~/gits/wilsonmar/wilsonmar.github.io; \
bundle exec jekyll serve --config _config.yml'
```
Create the folder.

Upgrade Apple XCode

Install the latest XCode from Apple. See my tutorial at https://wilsonmar.github.io/xcode

Jana Bergant’s Udemy course uses a mac install Jekyll 3.3.0 at last viewing:

Install rbenv

Get list of rbenv versions

rbenv install -l grep -E “^\s*3.[0-9]+.[0-9]+$” tail -10
Specify latest rbenv install 3.4.7 rbenv global 3.4.7
Per https://github.com/rbenv/ruby-build/wiki#suggested-build-environment
```
brew install openssl libyaml libffi
```
```
brew install rbenv ruby-build
```
To avoid ???:

??? /usr/local/bin for Intel chips
```
sudo gem update --system -n /usr/local/bin --no-document
```
-n /usr/local/bin ensures avoids “You don’t have write permissions for the /usr/bin directory.”

--no-document to avoid installing documentation (which can be accessed online anyway)

which ruby

   /Users/johndoe/.rbenv/shims/ruby

Create a folder

CAUTION: In 2019, GitHub changed their pricing policies to begin charging for hosting websites (at $7/month). That $84 per year is less than what many hosting companies charge to provide a single machine. But GitHub also provides free scaling and a fast world-wide CDN for no additional cost.

In GitHub create a youraccount.github.io repo.
Delete file .bundle from my Home folder (rm -rf ~/.bundle). You can check out your configuration running bundle env

https://jekyllrb.com/docs/

In Terminal, from any folder,

sudo gem uninstall bundler
gem update --system

Response:

RubyGems system software updated

If the latest version is not installed, you get a message like this:

ERROR:  While executing gem ... (Errno::EPERM)
 Operation not permitted @ rb_sysopen - /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/bin/gem

Rehash:

rbenv rehash
sudo gem install bundler

A valid response I got:

Successfully installed bundler-2.0.1
Parsing documentation for bundler-2.0.1
Done installing documentation for bundler after 4 seconds
1 gem installed

Install Jekyll (instead of Homebrew):

gem install jekyll --no-document

The response:

Successfully installed jekyll-4.4.1
28 gems installed

http://ryan.mcgeary.org/2011/02/09/vendor-everything-still-applies/

In _config.yml

exclude: ["vendor", "lib", </pre<>

### Demo Site

Use or create an enclosing folder, such as “projects”.

jekyll new demosite

The response should be

New jekyll site installed ...

BLAH: I’m getting this message:

Your user account isn't allowed to install to the system RubyGems.
  You can cancel this installation and run:
 
   bundle install --path vendor/bundle
 
  to install the gems into ./vendor/bundle/, or you can enter your password
  and install the bundled gems to RubyGems using sudo.
 
  Password:

Bundle install

After downloading, have Maven pull in dependencies based on the Gemfile:

bundle install

NOTE: Technically, “install” is not needed since it’s the default command for bundle.

Bundling makes the list of dependencies in the Gemfile to be downloaded.

Your user account isn't allowed to install to the system RubyGems.
  You can cancel this installation and run:
 
      bundle install --path vendor/bundle

Grunt tasks

Behind the scenes is a running of the Gruntfie.js that comes with the theme. It defines the parameters of various tasks that are downloaded:

clean clears files and folders.
jshint validates files with JSHint, based on the .jshintrc configuration file at the root folder.
uglify minfies files with UglifyJS.
watch runs tasks whenever watched files change.
imagemin minifies PNG graphics files.
grunt-svgmin minifies SVG graphics files.

NOTE: File names beginning with a dot are hidden.

Serve Jekyll landing page

Theme programming goes to work generating HTML files in folder _site when this command is issued when the present working directory is the site’s folder:

To see the site the way GitHub would generate it (without additional plug-ins some templates provide):

   bundle exec jekyll serve --safe

The precise version of plug-ins used by GitHub on-line is listed here.

Otherwise:

   bundle exec jekyll serve --baseurl ''

Alternately, override local URLs:

   bundle exec jekyll serve --config _config.yml,_config_dev.yml

PROTIP: Define an alias, such as “bs” in ~/.bash_profile file:

alias bs='bundle exec jekyll serve --config _config.yml,_config_dev.yml'

PROTIP: Leave this terminal instance running and open another Terminal instance to work on the content of the site.

The generated HTML files can then be accessed from an internet browser at this URL:

http://localhost:4000

The landing page of the site is defined in the index.md file at the root folder.

The theme by itself does not show much. The template’s author assumes that technical people will be using his creation.

When the web server starts, it is industry standard for the index.html file to be rendered.

Edit file index.html file. By default it contains this:

---
layout: archive
author_profile: true
---
&#217;% include base_path %}

&LT;h3 class="archive__subtitle">Recent Posts&LT;/h3>

&#217;% for post in paginator.posts %}
&#217;% include archive-single.html %}
&#217;% endfor %}

&#217;% include paginator.html %}

Between the two triple-dash characters is the “front matter” for Jekyll to interpret.

Jekyll uses the layout tag’s value archive to build out the page according to the archive.html file within the _layouts folder.

Another layout type, splash, arranges the page with thumbnail pictures.

The other layout types are default, single, and compress.

Jekyll converts index.md files to index.html files.

Edit index.html author_profile

Having author_profile: true tells Jekyll to add the profile on the left side.

If you would rather have text greet your visitors, add it.

---
layout: home
excerpt: "By Wilson Mar"
tags: [Jekyll, theme, responsive, blog, template]
image:
feature: sunrise-1900x500.png
credit:
creditlink:
---

If you would rather have text greet your visitors, add it.

<meta name="keywords" content="Jekyll, theme, responsive, blog, template">

TODO: Substitute the image file name in the feature: variable with an alternative file you placed in the images folder.

Return to this page from any other by clicking on the site’s title presented at the upper left corner.

Change README.md content

Use a text editor program to open the README.md file at the root.

This file is not shown on the website.

It was written for those who work with the site’s code, not readers of the resulting website.

So the content of this page should be changed from being about the theme to about the website derived from the theme template, such as:

“I hope you’ll file an issue or send a Pull Request. I need the help.”
File mm-theme-post-600.jpg within the images folder can be deleted.

Edit _config.yml and reset server

Use a text editor to edit _config.yml.

# Site Settings
locale                   : "en-US"
title                    : "Home"
title_separator          : "-"
name                     : "Wilson Mar"
description              : "Hello. Hire me."

Change the title text from “USER_” to "Home" or whatever you want.
Change the name value to your screen name.
Save and exit the file.
Stop the server so the changes take.
Start the server again.
When you view the page again, notice the heading has changed to your title value.

Edit _config.yml author info

Again use a text editor to edit the _config.yml file to change other values.

Scroll down the file to:

# Site Author
author:
name             : "Wilson Mar"
avatar           : "bio-photo.jpg"
bio              : "Hello."
location         : "Everywhere"

Change the default author name, bio text, and location.

<a href=”#avatar>Change the avatar</a>. PROTIP: Don’t change more than one or two values before you reset and view again so you know what change break the system.

Tabs, folders, and index.md files (for SEO)

Links at the top of the page (“QUICK-START GUIDE”, “ABOUT”, etc.) are specfied by the navigation.html file within the _data folder.

Edit that file.

The title: key specifies the text of each tab, such as “About”.

NOTE: CSS in the theme automatically turns all letters into capital.
Change url values such as this:

- title: About
url: /about/

- title: Sample Posts
url: /posts/

Save and restart the server.

index.md under About folders

Next let’s use a text editor to look into that about folder specified in the .yml file.

github: repo: https://github.com/user/Proj # “GitHub project” link on sidebar

index.md under folders

Jekyll converts the contents of each index.md file (containing markdown text) into index.html files containing HTML.

Open the index.md file in the about folder.

HOORAY: The use of folders above an index.html file enables calls using SEO-friendly links. For example, to reference the about link:

http://localhost:4000/about

HOORAY: This technique does not require use of mechanisms in the underlying web server container (such as IIS).

The text is added to page titles that appear in browser tabs through this HTML:

<title>All Posts &#8211; WilsonMar.GitHub.io</title>

Parsing of post file names

The posts tab link to files within the _posts folder. In the case of the sample file named “2011-03-10-sample-post.md”, Jekyll programming parses the “sample-post” out of the file name and uses that as if it’s named “sample-post.html”.

UI Text Translation

An addition

Metadata within .md files

At the top of each markdown file, between a set of 3 dashes, are key-value pairs providing metadata about the page, such as this example from the index.md file within folder about:

---
layout: page
title: About
tags: [about, Jekyll, theme, responsive]
modified: 2014-08-08T20:53:07.573882-04:00
comments: true
image:
   feature: pic pic blue black stars spin 1900x500.jpg
   credit: Jeremy Thomas
   creditlink: https://www.flickr.com/photos/132218932@N03/page2
---

EXTRA: Detailed YAML specifications are at: http://www.yaml.org/spec/1.2/spec.html

HOORAY: Such metadata takes the place of a database referenced to dynamically generate pages (as WordPress does). Jekyll’s lack of a database vastly simplies matters and speeds up processing. This enables static page HTML to be distributed in CDNs (Content Distribution Networks) around the world. That maximizes download speed for visitors.

Layout types

The various layout types are defined in files (with no extension) within the _templates folder:

archive
page
post

HOORAY: This approach enables additional types to be defined.

---
layout: {}
title: 
modified:
categories: 
excerpt:
tags: []
image:
feature:
---

Text within square braces define an array of several values.

Liquid engine

Tags within { curly braces } are processed by the Liquid templating engine.

Liquid can perform if/then/else decisions and loops.

EXTRA: More detail about Liquid is at: https://docs.shopify.com/themes/liquid/basics#If_.2F_Else_.2F_Unless

List of Liquid commands

Collections

One of the most powerful features provided by Liquid is Collections.

Collections is explained at:

jekyllrb.com/docs/collections
2015/02/20/jekyll-collections by Ben Balter (product manager at GitHub).

Collections refer to a custom folder containing many markdown files, each having front-matter than can be parsed by Liquid code.

Ben has a great decision diagram:

NOTE: site.categories and site.tags only works on _posts.

Link icon YAML

In the list of posts, post titles with a link icon get that way because in its YAML is a line link post line such as this:

link: http://www.wilsonmar.com
---

.yml metada

Default values are specified in a _config.yml file at the root of the site folder.

EXTRA: All keys are detailed at http://jekyllrb.com/docs/configuration/

Here are the first few lines of a sample file:

# Site wide configuration

title:            WilsonMar.GitHub.io
locale:           en_US
url:

# Jekyll configuration

permalink:   /:categories/:title/
markdown:    kramdown
highlighter: rouge
sass:
sass_dir: _sass
style: compressed
gems:
- jekyll-sitemap
- jekyll-gist

PROTIP: Changes in the _config.yml file are applied only when the Jekyll service is recycled. At the command terminal window where Jekyll was launched, press control+C, then invoke the command to start the server again.

Another theme (Poole Hyde) adds:

---
github:
repo:  https://github.com/user/Proj # "GitHub project" link on sidebar
---

sitemap.xml in _site

Theme programming also generates the _site folder and in it generates feed.xml and sitemap.xml files for web crawlers to read.

Bing it on

TODO: Get a value for the bing-verify: variable in your _config.yml.

Open a Webmaster Tools account at bing.com/toolbox/webmaster/
Sign In with a Windows Live ID. If you don’t have a Microsoft account already, get one.
Type in your Site Name (mine’s wilsonmar.github.io) and click Add a site.
Type in the URL to your Site Map. (mine’s http://wilsonmar.github.io/sitemap.xml).

The sitemap.xml file is generated in the _site folder, but will be the root folder when deployed on a web server.
Fill out the other fields (contact info and preferences), then click Save.
In the Verify ownership page, copy the string from:

   <meta name="msvalidate.01" content="73A60A207FC7D42B6F428E462079B001" />

Paste that string to the right of the bing-verify: variable.
Click the BingSiteAuth.xml link to save the file.
Move the file into the root folder where the _config.yml file is (NOT in the _site folder, which gets deleted and repopulated automatically).
Recycle the Jekyll server to see the BingSiteAuth.xml in the _site folder.

Google Ownership

This is explained in https://support.google.com/webmasters/answer/35179?hl=en

Access Webmasters Tools using your Google account.
Add a Property (such as http://wilsonmar.github.io).
Download the html file (such as google923b0745fb3293c1.html) to the Downloads folder.
Move the file into the root folder where the _config.yml file is (NOT in the _site folder, which gets deleted and repopulated automatically).
Download the file.

Disqus comments

Use an internet browser to get to: Disqus.com.

This is about creating a publisher account such as “wilsonmarcom”.

PROTIP: Create a separate personal commenter account (such as “wilsonmar”) to track your responses on other websites.
Click the cog next to your picture to select Add Disqus To Site, or https://publishers.disqus.com/engage?utm_source=Home-Nav
Click Install on your site.
Specify a site name such as “wilsonmar-github-io”.
Click Next and answer the demographic questions (how many visits, etc.).
You don’t need to select installation for Universal code and copy paste JavaScript because the theme has already done that in file _disqus_comments.html within folder _includes.
Copy the site.owner.disqus-shortname, such as “wilsonmargithubio” from:

<script id="dsq-count-scr" src="//wilsonmargithubio.disqus.com/count.js" async></script>

Open for edit file _config.yml in the root folder.
Paste the Disqus short name as the value to key disqus-shortname:.
Read more about configuration of Disqus at: https://help.disqus.com/customer/en/portal/articles/2158629

Disqus Setup Disqus on a New Site.

Multiple authors

Lower in the file is information about the default author displayed on all pages. This can be overridden in a particular index.md or post file by a line such as:

author: billy_rick

“billy_rick” is a key to more information in the authors.yml file within the _data folder:

billy_rick:
  twitter: @billyrick

HOORAY: This mechanism presents the photo and links to multiple alternative authors to appear on the website.

If you’d like more links, add them in folder _includes file _author-bio.html:

On the bottom of every page of the minimal-mistakes theme are large buttons for sharing tweets, Facebook, and Google.

Unlike links on the left pane of every page, clicking on these links pops up a new browser window.

You can change that pre-populated text (the URL) by changing the _social-share.html file withing folder _includes. The default pulls in the value of variables:

https://wilsonmar.github.io and /jekyll-site-development/

The pop-up relies on cookies previously created when the visitor signed into Twitter, Facebook, and Google on the same browser used to access this site.

Images

Images can be defined in GFM or standard HTML.

In-line GFM images

Positioning of GFM-specified images can be specified using a special tag.

![Smithsonian Image](https://wilsonmar.github.io/images/3953273590_704e3899d5_m.jpg)
{: .image-pull-right}

renders as:

NOTE: Most images are stored in the site’s images folder.

Clickable images

GFM is not yet able to handle code to specific clickable images, either as HTML image maps nor as CSS.

One Up

<figure>
<a href="http://farm9.staticflickr.com/8426/7758832526_cc8f681e48_b.jpg"><img src="http://farm9.staticflickr.com/8426/7758832526_cc8f681e48_c.jpg"></a>
<figcaption><a href="http://www.flickr.com/photos/80901381@N04/7758832526/" title="Morning Fog Emerging From Trees by A Guy Taking Pictures, on Flickr">Figure: Morning Fog Emerging From Trees by A Guy Taking Pictures, on Flickr</a>.</figcaption>
</figure>

renders to:

Figure: Morning Fog Emerging From Trees by A Guy Taking Pictures, on Flickr.

Half/Three Up

The theme has a half class to split the available horizonatl space in half to display two images side by side (and share the same caption).

<figure class="half">
<a href="/images/image-filename-1-large.jpg"><img src="/images/image-filename-1.jpg"></a>
<a href="/images/image-filename-2-large.jpg"><img src="/images/image-filename-2.jpg"></a>
<figcaption>Figure: Two images.</figcaption>
</figure>

renders to:

Figure: Two images.

Three Up

The theme has a third class to split the available horizontal space in thirds to display three images side by side (and share the same caption):

<figure class="third">
<img src="/images/image-filename-1.jpg">
<img src="/images/image-filename-2.jpg">
<img src="/images/image-filename-3.jpg">
<figcaption>Figure: Three images.</figcaption>
</figure>

is rendered as:

Figure: Three images.

Layout responsive to screen size

The MadeMistakes themes make use of the Semantic Grid System to define fluid grids for each major page layouts with a few lines of CSS code referencing @media queries. This makes the theme responsive – adapting to various size screens:

Desktop default (up to the largest HD & 4XHD screen)

Min-width: 780px
Tablet Portrait (to landscape and desktop)

Min-width: 768px / Max-width: 979px
Smartphone (and all smaller screens)

Max-width: 480px

Image sized to screen?

The size of screens.

The image for Twitter Cards is a square image around 120 x 120 pixels.

Markdown coding

The next few sections are based on

https://mmistakes.github.io/minimal-mistakes/sample-post/

Notice boxes

To put text in a box, add {: .notice} under the text to be boxed:

**CAUTION:** Invalid markup can crash the server.
{: .notice}

renders to:

CAUTION: Invalid markup can crash the server.

PROTIP: Make a small change (one phrase) then verify rendering. Commit to git at every verified set.

Blockquotes

A leading > marks a line as a blockquote:

> Lorem ipsum

renders as:

Lorem ipsum

Footnotes

A paragraph ending with the &Vcirc; “circumflex” character (upper case of the number 6 key) between square brackets defines the footnote number:

Footnotes are Syntax Highighting¹.

A repeat of the sequence at the beginning of a paragraph defines the definition:

[^1]: <http://en.wikipedia.org/wiki/Syntax_highlighting>

Button colors in HTML

Use pre-defined classes:

<div markdown="0"><a href="#" class="btn">Primary Button</a></div>
<div markdown="0"><a href="#" class="btn btn-success">Success Button</a></div>
<div markdown="0"><a href="#" class="btn btn-warning">Warning Button</a></div>
<div markdown="0"><a href="#" class="btn btn-danger">Danger Button</a></div>
<div markdown="0"><a href="#" class="btn btn-info">Info Button</a></div>

renders to:

If you are viewing this on a desktop, mouse-over each button to see the color change.

SASS

To change the colors, edit in folder _sass file variables.scss, then compile the file to .css.

    sass variables.scss  variables.css

Sass, or Syntactically Awesome StyleSheets, is an extension language for CSS.

Nests

Variables:

   $background-transparent :

Mixins

Paragraph Indents

By default, the theme assumes formatting is for books by removing extra lines and adds indents to second and subsequent paragraphs. Well, we’re in the internet age where long paragraphs are the exception.

To disable the indents and add spacing between paragraphs, edit in folder _sass file variables.scss to change:

$paragraph-indent: true !default;

To:

$paragraph-indent: false;

PROTIP: This change in the theme enables use of indented items using GFM.

Numbered lists

As with GFM, numbers in front of ordered list items can be preceded by zeros since they are automatically numbered:

0. Item one
0. sub item one
0. sub item two
0. Item two

some text after 3 spaces.

0. Item three

renders to:

Item one
sub item one
sub item two
Item two

some text after 3 spaces.

Item three

Code Snippets

Instead of a set of three back quotes, blocks of programming code are enclosed with special tags like this:


{% highlight css %}
#container {
float: left;
margin: 0 -240px 0 0;
width: 100%;
}
{% endhighlight %}

renders as:

#container {
float: left;
margin: 0 -240px 0 0;
width: 100%;
}

Gists

Snippets of code on Gist.com can be displayed on the web page with a simple line containing the gist.com userid and snippet number:


{% gist userid/6589546 %}

Standard GFM mark-up

Several coding techniques ar the same as in GitHub Flavored Markdown.

Asterisks precede text in unordered lists preceded with bullets.
The number of # characters preceding heading text specifies the level.
One asterisk enclosing text makes it italics.
Two asterisk enclosing text makes it bold.

Just as with GFM, regular HTML is recognized and processed as such.

<strong>bolded text</strong>

Custom Includes

Jekyll can process several special tags beyond what GFM can do. An entire HTML file can be inserted:


{% include _toc.html %}

The tag is processed by Kramdown which generates the Table of Contents displayed on the right side of the screen.

A custom include can be coded within markdown like this:


{% include evangelist_links.html %}

Doing this takes some mental contortion because of the automatic processing.

The evangelist_links.html file referenced needs to be in the _includes folder.

 During processing, the folder "_includes" is automatically added to the link.
 Therefore you can't put the include file anywhere else, or you'll get a message such as:

 Error: Included file '_includes/includes/1loadrun_map.html' not found

However, there can be markdown in the evangelist_links.html file, such as:

In this series:

* [Budget](Budget)

<!--
* [Future1](Future1)
-->

NOTE: HTML code above to ignore can be included in the file.

Tables

A rule can be specified for formatting tables coded in GFM:

| Header1 | Header2 | Header3 |
|:--------|:-------:|--------:|
| cell1   | cell2   | cell3   |
| cell4   | cell5   | cell6   |
|----
| cell1   | cell2   | cell3   |
| cell4   | cell5   | cell6   |
|=====
| Foot1   | Foot2   | Foot3
{: rules="groups"}

renders to:

Header1	Header2	Header3
cell1	cell2	cell3
cell4	cell5	cell6
cell1	cell2	cell3
cell4	cell5	cell6
Foot1	Foot2	Foot3

Affiliate Ads

Amazon Affiliate Ads

https://affiliate-program.amazon.com/gp/associates/network/main.html
Search for a product to get its URL, such as: http://www.amazon.com/gp/product/B00IR2VEUS/ So Amazon’s product code is “B00IR2VEUS”.
Specify the product code to get the HTML containing your affiliate tracking code, such as:

<a target="_blank" href="http://www.amazon.com/gp/product/B00IR2VEUS/ref=as_li_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN=B00IR2VEUS&linkCode=as2&tag=wilsonslifenotes&linkId=LGM2HVV7JYHE5QRS">Cabin Max Metz Backpack Flight Approved Carry on Bag 44 Litre Travel Hand Luggage - 55x40x20 (Black)</a><img src="http://ir-na.amazon-adsystem.com/e/ir?t=wilsonslifenotes&l=as2&o=1&a=B00IR2VEUS" width="1" height="1" border="0" alt="" />

Note the link has a one-pixel image link Amazon uses to track the number of impressions.

If you would like to list products you make on Amazon, get an account Seller Account at sellercentral.amazon.com/gp/homepage.html.

Google Affiliate Ads

Ideally, I would put a vertical ad under the table of contents.

Site Search

A Node.js library to add search functionality to any Jekyll blog Demo here is available from this repo.

Theme http://mmistakes.github.io/so-simple-theme/theme-setup/#jekyll-search activates each page using it with the search_omit: true front matter.

.gitignore

This list of folders and files is about what processing occurs locally.

{$ endhighlight text %} _site .sass-cache .DS_Store *.sublime-project *.sublime-workspace codekit-config.json node_modules _asset_bundler_cache .jekyll-metadata {$ endhighlight %}

Additional features

Make Jekyll multi-lingual

Deploy to server

http://help.github.com/articles/using-jekyll-with-pages/
http://goo.gl/hE3Zj2 to http://nicolasgallager.com/simple-git-deployment-strategy-for-static sites/
jekyllrb.com/docs/deployment-methods/

Questions

QUESTION: How to add regular .html files to the site.

TODO: Inspired by Shamime’s photomap building, I added a Photomap tab and folder on my site.

http://loyc.net/2014/javascript-toc.html

QUESTION: Spell checking in GitHub?

Footnotes

There is no need to repeat excellent tutorials:

Thomas Bradley’s videos on YouTube
Tutorial: http://jekyll.tips/jekyll-casts/
https://geekflare.com/cloud-storage-static-website/
https://snipcart.com/blog/static-site-e-commerce-part-2-integrating-snipcart-with-jekyll

Jekyll MinimalMistake users in the wild

http://udaypal.com/jenkins-workflow-getting-started/
http://udaypal.com/2015-04-08-continuous-delivery-using-jenkins-workflow/
http://michaelcrump.net/running-jekyll-locally/
http://blog.christianposta.com/microservices/netflix-oss-or-kubernetes-how-about-both/
JAMstack Conf 2018 - San Francisco 19 videos
https://www.tomordonez.com/jekyll-text-expand-collapsible-markdown/ to hide text unless clicked
https://karttur.github.io/setup-theme-blog/blog/blog-hide-show-div/

Machine Learning

2025-11-15T00:00:00+00:00

Different ways to use data to create a model (program)

Overview

The pervasiveness of AI and Machine Learning was recognized by Google CEO Sundar Pichai when he said in 2016:

“Machine learning is a core, transformative way by which we’re rethinking how we’re doing everything. We are thoughtfully applying it across all our products, be it search, ads, YouTube, or Play. And we’re in early days, but you will see us — in a systematic way — apply machine learning in all these areas.”

Skill-building from games

In 1997, when Deep Blue beat world chess champion Gary Kasparov, it did so by “brute force”, by using a supercomputer to analyze the outcome of every possible move, looking further ahead than any human possibly could. That wasn’t Machine Learning or AI.

But In 2016, IBM’s Watson software beat top Jeopardy game champions by “learning” from books and encyclopedias. IBM only created the program that enables the computer to learn. The software makes use of a “model” from example vs. following strictly static program instructions (logic defined by human developers).

Machine learning is a type of AI (Artificial Intelligence) that enables computers to do things without being explicitly programmed by human developers. Rather than explicit programming, Machine Learning algorithms identify rules through “training” based on many examples.

The photo above is the Todai Robot, back in 2014, scoring among the upper 20% of students in Japan’s university entrance exams – writing essays using a pen on paper. In Japanese. It knows 8,000 Japanese words, 2,000 mathematical axioms, and uses “symbolic computation” for “automatic reasoning” on 15 billion sentences.

In 2017, the top ranked player in the Chinese game Go was defeated by Google’s AlphaGo, which is based on Google’s DeepMind acquisition. The software made moves that many human players considered illogical. BTW, Go is considered the most complex game ever invented. Whereas chess players have, at any given turn, an average of 35 possible moves, on a Go board’s 19-by-19 grid, there are 250 possible moves.

Also in 2017, all top-ranked poker players were bested by software named Libratus from Tuomas Sandholm at CMU. The software adjusted its strategies during the tournament. And its algorithms for strategy and negotiation are game-independent, meaning they’re not just about poker, but a range of adversarial problems.

Rather than neat rows structured in fixed columns and rows within tables, AI computers deal with less structured data, such as (natural language text, images, and videos).

21 August 2017, Elon Musk tweets: “OpenAI first ever to defeat world’s best players in competitive eSports [dota2]. Vastly more complex than traditional board games like Chess & Go”. VIDEO.

Use Cases for AI

What ordinary people might appreciate:

Estimate the price of a house given real estate data (multiple regression), so you don’t waste time on properties that don’t fit your criteria.
Classify movie reviews from imdb.com into positive and negative categories (such as “revenge”), to spend time only on movies you want to see.
Classify news wire articles by topic (multi-class classification), to save time avoiding skimming articles not of interest to you specifically.

For small businesses:

Sort vegetables using computer vision

For enterprises:

Data Security - identify malware by detecting minute variations in file signatures.
Fraud detection - fight money laundering by finding anomalies in transactions.
Financial trading
Health care - understand risk factors and spot patterns in medical info
Marketing - personalize ads based on interests identified for individuals
Smart cars
Insurance - identify risks in smaller populations

Algorithms

Use of hard-coded (static) “rules” crafted by human programmers is called “symbolic AI”, used in “expert systems” fashionable during the 1980s.

Machine learning algorithms identify information from data fed through “generic” (general purpose) algorithms which build their own logic from detecting patterns within the data.

Patterns are recognized by neural network algorithms. This cycle of “learning” is implicit in a definition of Machine Learning by Mitchell (in 1997): “A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P if its performance at tasks in T, as measured by P, improves with experience E”.

The “network” in a neural network has multiple “layers” or data-processing modules that “distill” data. Models using a small number of layers are called “shallow learning”. GoogleNet in 2014 used 22 layers. In 2016, one network uses over 1,000 layers.

By contrast, the human brain has 300 million modules that recognize patterns, each having 100 neurons.

At the input layer, the network trains on a specific set of “features” and then sends that information to the next layer. That next layer combines previous conclusions with other features and passes it to the next layer, and so on, sequentially.

Models are trained using examples so they can be used to make predictions. The result of training is a mathematical model used to make predictions, such as taking an unlabled photo and deriving the label “cat”.

Terminology

An example of the last layer which presents the output/decision (from recognizing what number is written down in a photo from the MNIST collection) is a 10-way “softmax” layer returning an array of 10 probability scores (all summing to 1). Each of the 10 contains the probability that the digit image belongs to one of 10 digit classes.

“Supervised” Machine Learning systems learn how to combine input to produce useful predictions on never-before-seen data.

Machine learning uses some terms that have alternate meanings for words also used by traditional programmers and statisticians:

(In statistics, a “target” is called a dependent variable.) In machine learning, a target is also called a label, what a model should ideally have predicted, according to an external source of data.
A “label” is a specific instance of a class. A label can be an answer (target) for a prediction task – either the answer produced by a machine learning system, or the right answer supplied in training data. It’s represented as “y” in mathematical notation.
Data points are called “samples” or “examples”, represented as “x” in mathematical notation.
Unlabeled examples are used for making predictions on new data.
A “category” of a classification problem is called a class. For example, when classifying pictures, “puppy” and “muffin” are two of the classes. Each class describes a set of possible labels to choose from.
A model maps examples to predicted labels. It’s defined by internal parameters, which are learned.
The prediction error, also called loss value, the measure of the distance between a model’s prediction and the target.

It’s a metric of measurements that you care about, which may or may not be directly optimized.
An instance is the aspect about which you want to make a prediction. (An instance is called an “objective” in other fields.)
A feature is a property of an instance used in a prediction task. For example, a web page might have a feature “contains the word ‘cat’”.

A feature in machine learning is called a “variable” in statistics. A feature is an input variable—the x variable in simple linear regression. (Feature creation in machine learning is called a “transformation” in statistics.)
A feature Column is a set of related features, such as the set of all possible countries in which users might live. An example may have one or more features present in a feature column. A feature column is referred to as a “namespace” in the VW system (at Yahoo/Microsoft), or a field. Example: An instance (with its features) and a label.
An objective is a metric that an algorithm is trying to optimize.
A pipeline is the infrastructure surrounding a machine learning algorithm. A particular pipeline can include:
1. gathering the data from the front end,
2. putting it into training data files,
3. training one or more models, and
4. exporting the models to production.

Types of machine learning

</sub>–by Geena Kim</sub)

Supervised learning

The supervised learning approach predicts an output by making use of a labeled data set of training data(examples) which provide and “answer” or target giving feedback on what is correct or not.

The training correlates features to outputs in order to predict outputs based on new inputs.

For time series analysis, use a “recurrent net”. Recurrent nets process data that changes with time, using a feedback loop that acts as a forecasting engine.

Recurrent networks have a network topology in which data flow itself is recycled. It is used, for example, to generate sequences of words from the vectors describing the “meaning” of pictures. Each word depends on all that have already been produced.

For text processing (Sentiment Analysis) and speech recognition: use a Recurrent Net or a RNTN (Recursive Neural Tensor Network) that operates at individual character level.
RNTNs were conceived by Richard Socher of MetaMind.io as part of his PhD thesis at Stanford. In 2016 it became part of Salesforce Einstein Predictive Services at https://metamind.readme.io/v1/docs

RNTNs are better than feed-forward or recurrent nets with data with a hierarchical structure (binary trees), such as the parse trees of a group of sentences.

For image (object) recognition is DBN (Deep Belief Network) or Convolutional Net.

Convolution means use of the same filter (also called a “kernel”) across the whole image, just like use of a filter in Photoshop. Clarifai uses a convolutional net to recognize things and concepts in a digital image. It then presents similar images.

Kernel methods are a group of algorithms for classification–Support Vector Machine (SVM) being the best known from Vapnik and Cortes in the early 1990s at Bell Labs and Vapnik and Chervonenkis as early as 1963. SVM classifies by finding in training data “decision boundaries” between sets of points belonging to different categories. Classifying new data points involves checking which side of the decision boundary they fall on.

Used in both feed-forward and (unrolled) recurrent networks is Backpropagation to update weights so networks learn (improve). * The Deep Visualization Toolkit illustrates the intermediate process.

Unsupervised learning

The “unsupervised” part of unsupervised learning means it makes use of a dataset without labels.

It uses “feature extraction” to discover a good internal representation of the input. It identifies the structure of data to solve some given task.

It uses “Pattern recognition” to classify patterns and clusters data.

Autoencoders encode their own structure. They are feature extractors with the same number of input and output nodes.

A hidden layer in Autoencoders provides a bottleneck of nodes reconstruction of input layer. So they can be used for image compression.

RBM (Restricted Boltzmann Machine) is an autoencoder with one visible and one hidden layer. Each visible node connects to all nodes in the hidden layer.

The “restricted” is because there is no connection among nodes within its layer.

RBM is like a two-way translator. RBM determines the relationship among input features.

In training loops, RBM reconstructs inputs in the backward pass.

RBM uses a measure called “KL Divergence” that compares actual to recreation of data. RBM makes decisions about what features are important based on weights and overall bias.

All this means that data in RBM does not need to be labeled.

As an example, to determine whether an animal is acerous or not acerous (has horns), it look at features such as color, number of legs, horns.

“Principal Component Analysis” (PCA) is a linear method for finding a low-dimensional representation.

Reinforcement learning

Reinforcement learning does not provide feedback until a goal is achieved. Its objective is to select an action to maximize payoff.

In Dec 2013, Volodymyr Mnih and others at DeepMind.com (a small company in London) uploaded to Arxiv a paper titled “Playing Atari with Deep Reinforcement Learning”. The paper describes how a “convolutional neural network” program learned to play several games on the Atari 2600 console (Pong, Breakout, SpaceInvaders, Seaquest, Beam Rider) by observing raw screen pixels of 210 × 160. The program learned by receiving a reward when the game score increased. This was hailed as “general AI” because the games and the goals in every game were very different but, without any change, learned seven different games, and performed better than some humans in three of them. * Their Feb. 2015 article in Nature gave them widespread attention. Then Google bought DeepMind (for $400 million).

https://www.youtube.com/watch?v=e3Jy2vShroE&index=17&list=PLjJh1vlSEYgvZ3ze_4pxKHNh1g5PId36-
https://www.nervanasys.com/demystifying-deep-reinforcement-learning/

Transfer learning

https://www.youtube.com/watch?v=Yx6Wv_SCKjI&index=16&list=PLjJh1vlSEYgvZ3ze_4pxKHNh1g5PId36-

One-shot learning

(aka Probabilistic Programming) is where a neural network learns from one (or a few) examples, as opposed to a large amount of data.

Deep Learning

“Deep learning” is a specific subfield of machine learning. The “deep” in “deep learning” is not about “deeper” understanding, but about the depth of various filters in a multi-stage information distillation operation. Each stage extracts some meaning from different representations of the input.

Deep learning learns all layers of representation “greedily”, in parallel at the same time, rather than each layer in succession. Intermediate incremental representations are learned jointly. Each layer is updated to follow the representational needs of layers both above and below itself.

See https://www.wikiwand.com/en/Deep_learning

Tools for Machine Learning

From http://www.infoworld.com/article/3163525/analytics/review-the-best-frameworks-for-machine-learning-and-deep-learning.html

Python or R is supported.

Many corporations have efforts using Machine Learning:

SAP’s “Leonardo” platform for ML courseuses the R language.

Tool: Neural Network Playground.

Python

Python is extended by libraries:

for handling csv, textblob and other data formats
for visualization: Matplotlib, Seaborn, Bokeh, Yellowbrick
for matrix operations, Numpy (Quickstart)
for statistics and linear algebra: SciPy, tweepy
for vectorized computing: Pandas and SFrame, which is not limited to datasets that can fit in memory, so it can deal with large datasets, even on a laptop.
for Machine Learning, see below:

Machine Learning frameworks

Scikit-learn 0.18.1 from Scikit-learn

http://www.infoworld.com/article/3158509/analytics/review-scikit-learn-shines-for-simpler-machine-learning.html
Mature documentation and libraries
Python-based, but does not support PyPy compiler

Spark MLlib 2.01 from Apache Software Foundation

http://www.infoworld.com/article/3141605/artificial-intelligence/review-spark-lights-up-machine-learning.html
Written in Scala and uses the linear algebra package Breeze which uses netlib-java.
Get data easily from Spark big-data clusters
Supported in the Databricks cloud

Keras (at https://keras.io) is not a library of its own but is a high-level API to simplify the complexity of deep learning frameworks by running on top of other deep learning APIs (TensorFlow, Theano and CNTK).

Keras runs on both CPU and GPU through backend engines Google’s TensorFlow and Theano developed by the MILA lab at Universite de Montreal.
PROTIP: Bypass manual installation by using the Docker image for Keras at
https://github.com/fchollet/keras/tree/master/docker based on Ubuntu.

In 2007, Nvidia launched CUDA, a C++ programming interface for its line of GPUs (Graphic Processing Units) begins to replace clusters of less efficient CPUs.

In 2017, NVIDIA provides GPU supercomputers used in many self-driving cars.

In 2017, basic Python scripting skills suffice to do advanced deep learning research.

https://www.exxactcorp.com/blog/Deep-Learning/tensorflow-vs-pytorch-vs-keras-for-nlp

Java in DL4j

Although Python is vastly more popular, there is a Java library that can run on both Scala and Clojure.

Adam Gibson at SkyMind developed Deeplearning4j (referred to as DL4j) to be commercial-grade library to run on a distributed, multi-node setup. It comes with GPU support for distributed training.

The DL4j team built a vectorization library called Canova.

In it one can select values for its hyper parameters.

DL4j supports most of the deep nets – RBM, DBN, Convolutional net, Recurrent net, RNTN, autoencoders, and vanilla MLP.

Deep Learning Frameworks

The list of frameworks today is NVIDIA to make because <a target=”_blank” href=”they optimize for their NVIDIA GPU Cloud (NGC) at ngc.nvidia.com.

A ranking of Deep Learning frameworks based on GitHub star count in 2017:

Since then, Google’s search history shows Pytorch overtaking Tensorflow:

Facebook/Meta’s PyTorch framework rising steadily from October, 2018 to become the one most people use:

On NVIDIA’s NGC
Based on Torch, another deep learning framework based on Lua
Easier to learn and debug its dynamic computational processes
TorchVision, TorchText, TorchAudio, PyTorch-XLA, PyTorch Hub, SpeechBrain, TorchX, TorchElastic and PyTorch Lightning
Pytorch perf tuning is easier due to its reliance on native support for asynchronous execution through Python means optimal performance in data parallelism
Poster projects: CycleGAN, FastAI, Netron

TensorFlow AI platform from Google

TensorFlow 2.0 has Keras integrated, supports dynamic graphs using eager execution
When running on CPUs, TensorFlow wraps itself over a low-level library for tensor operations called Eigen. BLAS
When running on GPUs, TensorFlow wraps itself over a library of optimized deep learning operations called cuDNN (with CUDA drivers developed by NVIDIA).
TorchServe deployment
TensorFlow Serving, TensorFlow Extended, TF Lite, TensorFlow.js, TensorFlow Cloud, Model Garden, MediaPipe and Coral
Google TPU (Tensor Processing Units)
Poster projects: DeepSpeech, Magenta, StellarGraph
Google’s Machine Learning Crash Course

Microsoft Cognitive Toolkit v2.0 Beta 1 (aka CNTK 2), as of 2017:

http://www.infoworld.com/article/3138507/artificial-intelligence/review-microsoft-takes-on-tensorflow.html
uses a declarative BrainScript neural network configuration language
No MacOS support yet
CNTK 2 models on GPU-equipped N-series family of Azure Virtual Machines.
Azure Machine Learning is part of the larger Microsoft Cortana Analytics Suite offering.

Caffe 1.0 RC3 from Berkeley Artificial Intelligence…

http://www.infoworld.com/article/3154273/analytics/review-caffe-deep-learning-conquers-image-classification.html

MXNet v0.7 from Distributed Machine Learning Amazon…

http://www.infoworld.com/article/3149598/artificial-intelligence/mxnet-review-amazons-scalable-deep-learning.html
Amazon’s DNN framework of choice, combines symbolic declaration of neural network geometries with imperative programming of tensor operations.
MXNet scales to multiple GPUs across multiple hosts with a near-linear scaling efficiency of 85 percent and boasts excellent development speed, programmability, and portability.
Its dynamic dependency scheduler allows mixing symbolic and imperative programming flavors: Python, R, Scala, Julia, and C++
trained MXNet models can also be used for prediction in Matlab and JavaScript.
Ahead of TensorFlow with embed imperative tensor operations.

Data representation

Tensors generalize matrices to an arbitrary number of axes (3 or more “dimensions”).

A tensor that contains only one number is called a “scalar” (aka “scalar tensor”), also called a “0D tensor” because in Numpy the ndim attribute of a scalar tensor has 0 axis (ndim == 0). (Yes, it confuses axis with dimensions)

An array (list) of several numbers is called a vector or 1D tensor having one axis. As Lecun explains it:

A vector of 5 entries is called a “5-dimensional vector”. Do not confuse a 5-dimensional vector with a 5D tensor! A 5D vector has only one axis and has 5 dimensions along its axis, while a 5D tensor has 5 axes (and may have any number of dimensions along each axis).

An array of vectors is a matrix, or 2D tensor of two axes.

x = np.array([[1, 2, 3, 4, 5],
              [10, 11, 12, 13, 14],
              [100, 101, 102, 103, 104]])

Each vertical “column” is like a variable. The first one has values 1, 10, and 100 from the three lines (rows), which are akin to a set of observations for a particular point in time.

The “shape” of the above is (3,5) for 3 vectors each containing 5 values.

A 3D tensor is defined as a “cube” of numbers. The MNIST library of 60,000 sample images, each consisting of 28x28 black-and-white pixels (each pixel represented by a number range from white to black), has a shape of (60000,28,28).

4D tensors are used to process matrices of color pictures :
(samples, width, height, channels)

5D tensors are used when processing video data:
(samples, frames, width, height, color_depth).

In Python Numpy, a data type of “float32” or “float64” is a scalar tensor (or scalar array).

“Selecting” specific elements in a tensor is called “tensor slicing”.

Axies for Shape

2D tensors containing simple vector data of shape (samples, features) are typically processed in “fully-connected” (“densely-connected” or “dense”) layers using the Dense class in Keras.

3D tensors containing sequence data of shape (samples, timesteps, features) are typically processed by “recurrent” layers such as a LSTM layer.

4D tensors containing image data is typically processed by Convolution2D layers.

5D tensors containing video data use the reshape layer. See https://github.com/anayebi/keras-extra for using Extra Layers for Keras to connect a RNN (Recurrent Neural Network) to a Convolutional Neural Network (CNN) by allowing the CNN layers to be time distributed.

Pandas

The Padas Python library reads databases directly into these Pandas structures:

Dimensions	Name	Description
1	“Series”	Indexed 1 dimension data structure
2	“Timeseries”	Series using time stamps as an index
3	“DataFrame”	A two-dimensional table
4	“Panel”	A three-dimensional table data structure

A scalar regression task is one where the target is a continuous scalar value. For example, when predicting house prices, the different target prices form a continuous space.
A vector regression task is one where the target is a set of continuous values (e.g. a continuous vector) while doing regression against multiple values (e.g. the coordinates of a bounding box in an image).

Metrics

The goal is to derive models that generalize.

When using its training data, a “loss function” is used to measure how well a neural network layer meets its objective. Thus, some call it an “objective function”.

It is called a function because it’s the result of changes, and thus used to determine whether changes are moving in the right direction. Changes are made to minimize the loss function.

The number of data values is typically split into a training set, a validation set, and a test set. This is so we don’t evaluate data using what was used for training in order to avoid overfitting.

An “optimizer” is the mechanism a network uses to update itself (based on data received and loss function values). It implements a specific variant for stochastic gradient descent.

Gradient Boosting

To address shallow learning problems, where structured data is available, “gradient boosting machines” have been used.

Practitioners of gradient boosting make use of the XGB library, which supports both the two most popular languages of data science: Python and R.

Introductory Resources

YOUTUBE: A friendly introduction to Deep Learning and Neural Networks by Luis Serrano

Machine Learning is Fun! (article on Medium) self-proclaimed “the world’s easiest introduction to Machine Learning”.

Adam Geitgy’s introduction of Machine Learning https://medium.com/@ageitgey/machine-learning-is-fun-80ea3ec3c471/ “for anyone who is curious about machine learning but has no idea where to start”

https://www.youtube.com/watch?v=dYT2LSuemgg Apr 26, 2017 by Dr. Joseph Reger, CTO of Fujitsu Technology Solutions

Enterprise Machine Learning in a Nutshell free class from SAP.

Recommended by Elon Musk: Nick Bostrom “SuperIntelligence: Paths, Dangers, Strategies”

This is one of a series on AI, Machine Learning, Deep Learning, Robotics, and Analytics:

Machine Learning was originally published by Wilson Mar at Index on November 15, 2025.

GaiaNet

2025-11-11T00:00:00+00:00

Monitize your knowledge in a blockchain exposed as AI Agents

Overview

At https://gaianet.ai, Gaia is the name of a decentralized blockchain combined with many AI Agents.

coder.gaia.domains is a collection of pure Qwen 2.5 33B models for developers to use.
pastor.gaia.domains is a Bible study agent that can explain biblical content.
chemistry.gaia.domains is a collection of Llama 3.2-8b models with chemistry knowledge.

Smart contracts of the blockchain interact with AI Agents.

That enables Gaia to build “Living Knowledge Systems” for AI Agents. – an decentralized ecosystem to support AI apps that learn, improve, and grow over time.

Power any LLM application many LLMs.

many AI Agents. To fuel the growth and development of the Gaia network, the Gaia Reward Program ///

Although Gaia has an API compatible with OpenAI, Unlike OpenAI ???

When Gaia Nodes connect to a Gaia Domain, it adds reasoning capabilities.

Nodes can be installed on macOS, Linux, Azure/AWS:

Make a folder to hold
```
mkdir -p gaianetper; cd gaianet
```

Download

curl -sSfL 'https://github.com/GaiaNet-AI/gaianet-node/releases/latest/download/install.sh' | bash

Check both shell and running process:

if [[ $SHELL == *"zsh"* ]] || [[ $(ps -p $$ -o comm=) == *"zsh"* ]]; then
   source ~/.zshrc"
else
   source ~/.bash_profile"
fi

Initialize $HOME/gaianet/config.json
```
gaianet init
```
Start node:
```
gaianet start
```
wasmedge is the process running in the background:
```
ps -al
```

Gaia Domains are linked dirctly from a web browser as a personal AI Agent portal.

Instead of complex wallet addresses, Gaia domains are shared in a human readable format.

Domain stGAIA (Auto-deploy to domain when TGE)

https://decrypt.co/297060/gaia-is-building-living-knowledge-systems-for-ai-agents
https://gist.github.com/kwunyeung/bfc3a6c9f8e5ad2566f12e69419c64e6
https://hub.cosmos.network/main/getting-started/installation
https://medium.com/@Gaianet.ai/gaianet-node-installation-guide-7572718eadf2
https://github.com/GaiaNet-AI/awesome-gaia is a collection point for resources that extend and enrich Gaia’s capabilities.
https://medium.com/@Gaianet.ai/step-by-step-guide-to-minting-your-gaia-domain-name-and-package-b6bb54654385

Among videos at https://www.youtube.com/@GaiaAI

https://www.youtube.com/watch?v=oTRuc5QXCBI Gaia Domains under 5 minutes

GaiaNet was originally published by Wilson Mar at Index on November 11, 2025.

Python Features (and tools/utilities)

2025-11-08T00:00:00+00:00

Overview

Execution Environment
Version Control
Linting: Ruff
Logging
Colorized print output
traceback for debugging
Async API FastAPI
CLI UI
Subprocess
Databases
Dashboards to present analytics
Analytics
GUI
brew search
References
Pythonista mobile IDE
AI Vision
Workflow orchestration

How to automate Python

The design choices faced by enterprise Python language users (click for more):

Version Control: git/github, Google jj
Linting: Ruff
CLI
GUI & Analytics & Dashboards
Async API (FastAPI)
Databases

Specify first line and main to run program directly.
Define docstring on latest change, STATUS of program
Define github URL where program is located in docstring
Get parameter values from argument specified in call within CLI
Read secrets from .env file outside the program and GitHub, cloud (akeyless.com)
Positive and negative unit tests for each function (PyTest?)
Read CSV file for multiple iterations
Define OpenTelemetry (OTel) spans for tracing
Define a code for each message
Measure duration of each function with scope processed
Output log entries with duration and process scope

Execution Environment

My article on Jupyter Notebooks covers:

Google Colab
Kaggle
AWS

Version Control

git/github, Google jj

Linting: Ruff

To run several in one command, ruff combines the rules from several previous utilities (black, etc.). And it runs fast due to it being written in Rust.

To identify whether libraries referenced has been flagged as vulnerable, we use safety. It’s free but it has an annoying habit of making users type a password every run. So I took it out of the git-commit hooks script run on every commit.

Logging

loguru — Logging with zero boilerplate and built-in rotation Why: Instead of logging.getLogger() setup, you get a one-line log tool with colors, file rotation, and context info.

from loguru import logger

logger.add("file_{time}.log", rotation="500 MB")
logger.info("Start processing {n} items", n=10)

Minimal setup, instantly usable output, fewer config hassles — productivity win.

Colorized print output

The click library avoids the need to add color to print output by define global variables in every program file.

import click
import rich_click as rc

rc.rich_click.MODERN = True

@click.command()
@click.option('--name', prompt='Your name')
def hello(name):
    click.echo(f"Hello, [bold cyan]{name}[/]!")

if __name__ == '__main__':
    hello()

traceback for debugging

Default tracebacks are messy. Rich’s tracebacks give color, local vars, context, and you spend less time digging.

from rich.traceback import install
install(show_locals=True)

def broken():
    a = [1,2,3]
    return a[5]

broken()

Instant clarity — especially when your automation fails in production and you need answers fast.

Async API FastAPI

https://www.codecademy.com/article/fastapi-vs-flask-key-differences-performance-and-use-cases

CLI UI

Python comes with the print() function.

The typer library makes it easier to define code to recognize parameters.

Subprocess

To execute OS commands within Python, instead of shell scripts:

from invoke import task

@task
def clean(ctx):
    ctx.run("rm -rf build dist __pycache__")

@task(pre=[clean])
def build(ctx):
    ctx.run("python setup.py sdist bdist_wheel")

# CLI:
# > invoke build

Databases

Local databases:

SQLite comes built into Python, so is a popular choice.
Postgres
MySQL is open source, but its ownership by Oracle makes its future suspect.

Cloud-based databases are convenient, but expensive.
Snowflake
Databricks
Microsoft SQL & Azure Cosmos DB

The question about database is its architectural data organization:
traditional SQL
Graph databases
DAG (Directed Acyclic Graph) like in blockchains and within Git
Semantic vector databases used by AI to augment foundation LLMs with private data

Python ORM frameworks include:
Django ORM
sqlalchemy ORM: [Datacamp.com]
https://www.planeks.net/django-orm-vs-sqlalchemy/

Dashboards to present analytics

Dashboard visually present metrics (statistics) for “situational awareness” (many in real-time):

At an individual level, health stastics such as weight from scales, blood/oxigen, blood pressure, Glucouse from Continous Glucose Monitors, etc.
Families install Home Assistant to display sensor history, temperature fluctuations, and other weather conditions.
Families and teams have a common calendar.
Factories install operational status boards such as Ignition from Inductive Automation.
Citizens use world and US Population dashboards to better understand the past and prepare for the future (such as inbound and outbound migration).

Python Frameworks:

Matplotlib-based dashboards.
Streamlit: Simple and fast for data apps with less coding. [tutorial to build a US Population Dashboard app]
Panel by Holoviz: For powerful dashboards customized by pros, especially with Jupyter Notebook.
Voila turns Jupyter notebooks into dashboards. Save this example as a .ipynb file, then run it with voila script_name.ipynb:
Bokeh
Taipy
LightningChart features GPU acceleration.
HoloViews puts the focus on describing data, and it decides how best to visualize it by auto-links with Bokeh, Matplotlib, and Plotly. Netflix’s internal data teams have used HoloViews-style pipelines for rapid analytics dashboards.

Resources:

https://realpython.com/python-dash/
https://medium.com/codrift/7-python-libraries-that-make-data-visualization-addictive-f657bf98d595
Python for Visualization

Analytics

You may be familiar with the phrase “A picture is worth a thousand words”.

There are expensive enterprise-level system Tableau, SAS, Matlab, etc.

For Python:

Seaborn runs on top of Matplotlib to provide more flexibility and a more elegant look.
Plotly (for interactivity and modern UI) [Dash Tutorial]
- https://dash.plotly.com/tutorial shows recreation of a GapMinder 4D interface from https://raw.githubusercontent.com/plotly/datasets/master/gapminder2007.csv
- choropleth-maps displays a map which use gradations of colors to highlight differences between locations (such as the most and least populated states).
Altair (for quick, declarative, grammar-based plots)
Polars + hvPlot (if you’re moving toward faster, Arrow-native workflows)

Resources:

“What is the best Python dashboard framework?”

GUI

Python GUIs (Graphical User Interfaces) are everything you see and interact with on the computer screen, from buttons and windows to menus, icons, etc., on any device – computer, phone, or other. You don’t have to type out all commands anymore; a GUI allows you to mouse click, tap, or use any other input, with all such actions becoming visual.

To provide front-end GUI such as a clickable dashboard, many enterprises use NodeJs (with ReactJs, etc.) or game engines (such as UnReal, etc.).

SUMMARY: Libraries to create Python GUI have a fragmented among these choices:

Tkinter: The default (built-in) Python GUI library is for simple, portable, and quick-to-build interfaces. So it is beginner-friendly, with many tutorials. However, it “looks like 1994” and has more limited widgets.
PySide (Qt for Python): The most powerful and professional GUI toolkit with extensive features, good documentation, native look and cross-platform support. Suitable for complex and commercial apps without much licensing worry unless modifying the core. Each version requires different coding.
PyQt require a commercial license for professional and complex applications because it is feature-rich with tools like Qt Designer.
Kivy is for modern touch and multi-touch apps on smart phones (iPhones, Androids, and Raspberry Pi). It provides custom UI elements. However, it is not native-looking but visually modern and flexible.
PySimpleGUI is good for small utilities or quick tools for rapid, simple GUI creation with a lightweight abstraction over Tkinter, Qt, or wxPython. But it’s less customizable.
wxPython (at https://wxpython.org/index.html) is open source and cross-platform - run with little or no modifications on Windows, Macs and Linux or other unix-like systems. It is implemented as a set of Python modules that wrap native-looking GUI components due to use of low-level super fast wxWidgets cross platform GTK2 or GTK3 libraries written in C++ which means tricky to learn with complex documentation.

wxPython’s Project Phoenix is a new from-the-ground-up implementation of wxPython, created with the intent of making wxPython “better, stronger, faster than he was before.”

PyGObject (GTK-based, good for Linux)
FLTK is a lightweight, cross-platform GUI library designed for speed and efficiency. Using its Python bindings, you get the performance and stability of its C++ core. Key features include a simple interface, lightweight design, and fast performance for GUI apps. While FLTK is quick, lightweight, and works well on many platforms, it has fewer widgets and a less modern interface than other libraries. It’s a good choice for simple graphics applications or projects needing good performance without a complex or fancy interface.
Toga is a cross-platform GUI library that uses each operating system’s native APIs to deliver a native look and feel. So it enables Python developers to build apps with consistent and natural interfaces across all platforms. Its “least common denominator” means fewer fancy widgets and a smaller community than older libraries.
Dear PyGui is a open-source GUI library that provides high performance and ease of use, especially for creating real-time graphics tools and applications. Dear PyGui provides fast graphics rendering, a node-based user interface, and supports a lot of interactive features. But, its community is still small, and it might not have as many features as some of the more established libraries. Dear PyGui is a good fit for real-time applications, graphics editors, data analysis tools, and apps with high graphics performance.
Pygame, while not a pure GUI library, is popular for developing 2D games. It makes mp3 audio processing easy on macOS.

https://stepmediasoftware.com/blog/best-gui-library-for-python/

brew search

brew search python
==> Formulae
boost-python3                              python-setuptools
bpython                                    python-tabulate
brewsci/bio/[email protected]             [email protected]
cyclonedx-python                           [email protected]
ipython                                    [email protected] ✔
libvirt-python                             [email protected] ✔
micropython                                [email protected]
ptpython                                   python-yq
python-argcomplete                         [email protected]
python-build                               [email protected] ✔
python-freethreading                       [email protected] ✔
[email protected]                           [email protected] ✔
[email protected]                           [email protected]
[email protected]                           [email protected]
python-launcher                            reorder-python-imports
python-lsp-server                          wxpython
python-markdown                            pythran
python-matplotlib                          cython
python-packaging ✔                         jython

References

BOOK: “Python Tricks: A Buffet of Awesome Python Features “ from October 25, 2017 on OReilly by Dan Bader (of RealPython.com) recommends assertions

https://learning.oreilly.com/library/view/data-structures/9780134855912/ Data Structures & Algorithms in Python By John Canning, Alan Broder, Robert Lafore

VIDEO: 22:43 AI-generated podcast about book BOOK: “Python Basics: A Practical Introduction to Python 3rd Edition” by David Amos (Author), Dan Bader (Author), Joanna Jablonski (Author), Fletcher Heisler (Author)

VIDEO $55 “The Kubernetes Bible: The definitive guide to deploying and managing Kubernetes across major cloud platforms” by by Nassim Kebbani (Author), Piotr Tylenda (Author), Russ McKendrick (Author)

Pythonista mobile IDE

https://apps.apple.com/us/app/pythonista-3/id1085978097 Pythonista 3 ($9.99 by omz:software) Python IDE for iPad (and iPhone)

AI Vision

OpenCV

https://www.raspberrypi.com/documentation/accessories/ai-camera.html AI Camera from Raspberry Pi. https://www.youtube.com/watch?v=aoYfHlbNxGQ Get started with Raspberry Pi AI Camera with Object Detection under 5 Minutes #raspberrypi

https://www.ultralytics.com/events/yolovision YOLO vision by Ultralytics.

https://core-electronics.com.au/guides/raspberry-pi/custom-object-detection-models-without-training-yoloe-and-raspberry-pi/

https://docs.firialabs.com/codeair/radio.html

Workflow orchestration

The prefect library enables scripts with orchestration involving flows, tasks, retry logic, scheduling by providing visibility through multiple stages and task breakdown, without heavy infrastructure.

from prefect import flow, task

@task
def fetch_data():
    return [1,2,3]

@task
def process(data):
    return [x*2 for x in data]

@flow
def my_flow():
    data = fetch_data()
    result = process(data)
    print(result)

if __name__ == '__main__':
    my_flow()

Python Features (and tools/utilities) was originally published by Wilson Mar at Index on November 08, 2025.

Python Ray

2025-11-03T00:00:00+00:00

Run Python for AI Machine Learning in parallel distributed within a cluster of Kubernetes machines across AWS, GCP, Azure, and Anyscale cloudds.

Overview

Competition
Ray Clusters
Install using Docker
- Port
- Resources
Ecosystem
Glossary
Installation scopes
Monitoring
Dashboard
Cluster Launcher
Ray Serve
MCP
Beginner Info

https://www.ray.io/#why-ray

https://github.com/wilsonmar/python-ray

Ray enables parallel processing to Machine Learning use cases, each a Python program:

Deploy MCP servers to report weather
ray-crawler.pyfor crawling the web to scrape content.
ray-data.py
ray-learn.py for Reinforcement learning
ray-batch.py for Batch inference
ray-train.py for Model training
ray-tune.py for Hyperparameter tuning
ray-serve.py for Model serving

The above are based on https://docs.ray.io/en/latest/ray-overview/examples.html

Among End-to-End ML Workflows

[Example] Text classification with Ray
[Example] Object detection with Ray
[Example] Machine learning on tabular data

https://docs.ray.io/en/latest/train/examples.html

https://github.com/ray-project/ray/tree/master

Running a job involves specifying the number of nodes. Ray abstracts away the complexity of managing scaling clusters, task scheduling, inter-node cmmunications, handling failures with retries and restarts.

https://github.com/ray-project/ray/blob/master/doc/source/ray-security/index.md Ray provides fault-tolerance, optimized scheduling, task orchestration, and auto-scaling to run a given workload. If you expose these services (Ray Dashboard, Ray Jobs, Ray Client), anybody who can access the associated ports can execute arbitrary code on your Ray Cluster. This can happen:

Explicitly: By submitting a Ray Job, or using the Ray Client
Indirectly: By calling the Dashboard REST APIs of these services
Implicitly: Ray extensively uses cloudpickle for serialization of arbitrary Python objects. See the pickle documentation for more details on Pickle’s security model.

Within a cluster are stateless CPU Tasks and stateful Actions in a pool of GPUs.

Results are returned as futures.

https://docs.ray.io/en/latest/cluster/key-concepts.html#cluster-key-concepts

At the Ray.io marketing page notes, several of the “Magnificient Seven” stocks use Ray (an Apache project) owned by Anyscale.com. Here’s why:

Ray deploys to:

Workspaces on Anyscale.com managed cloud. https://docs.anyscale.com/platform/workspaces/
Docker images from https://hub.docker.com/r/rayproject/ray comes with anaconda
VMs within hyperscale cloud providers:
- AWS,
- GCP within https://docs.cloud.google.com/tpu/docs/ray-guide
QUESTION: What is Community-supported Azure?
Community-supported Aliyun and vSphere integrations also exist.

https://docs.newrelic.com/docs/infrastructure/host-integrations/host-integrations-list/ray-integration/
Ray Kubernetes

Competition

Spark
Dask
pytorch monarch the new distributed AI framework by meta? It looks much alike ray APIs. if torch-native distributed usages are enough for most cases, it will definitely attract lots of users. Meanwhile, ray is just donated to pytorch foundation.

https://orbstack.dev/”>orbstack

https://www.youtube.com/watch?v=aJe7CvQ-aM8

Ray Clusters

Ray runs on any machine, cluster.

Multi-node Ray clusters are only supported on Linux. At your own risk, you may deploy Windows and OSX clusters by setting the environment variable RAY_ENABLE_WINDOWS_OR_OSX_CLUSTER=1 during deployment.

apps are submitted as Jobs to existing Ray clusters.

Install using Docker

Port

Start the Head Node of a cluster:
```
ray start --head --port=6379
```
If a –port argument is omitted, Ray chooses port 6379, and then fall back to a random port if in 6379 is in use.

The command will print out the Ray cluster address, which can be passed to ray start on other machines to start the worker nodes (see below). If you receive a ConnectionError, check your firewall settings and network configuration.
Start Worker (Compute) Nodes on each of the other nodes:
```
ray start --address=head-node-address:port
```
Replace head-node-address:port with the value printed by the command on the head node (it should look something like 123.45.67.89:6379).

Resources

Ray auto-detects the resources (e.g., CPU) available on each node, but can be manually overriden by passing flags resources to the ray start command. For example, to specify that a machine has 10 CPUs and 1 GPU available for use by Ray, you can do this with the flags –num-cpus=10 and –num-gpus=1. See the Configuration page for more information.

If your compute nodes are on their own subnetwork with Network Address Translation, the address printed by the head node will not work if connecting from a machine outside that subnetwork. You will need to use a head node address reachable from the remote machine. If the head node has a domain address like compute04.berkeley.edu, you can simply use that in place of an IP address and rely on DNS.

Ecosystem

Support by a growing ecosystem of community Integrations

https://docs.ray.io/en/latest/_images/air-ecosystem.svg

https://github.com/ray-project/ray “Ray is an AI compute engine.

Tasks - Stateless functions executed in the cluster.
Actors - Stateful worker processes created in the cluster.
Objects - Immutable values accessible across the cluster.

Glossary

See https://docs.ray.io/en/latest/ray-references/glossary.html

Installation scopes

This article is a rewrite of https://docs.ray.io/en/latest/ray-overview/installation.html

There are several scopes:

A. If you’re just getting started and not using Ray Dashboard or Cluster Launcher, install Ray with minimal dependencies: VIDEO

pip install -U "ray"

B. To run machine learning apps:

pip install -U "ray[data,train,tune,serve]"

### Machine Learning Ray Apps

Ray consists of a Core distributed runtime plus:

RaySGD - a library for distributed deep learning, which provides wrappers around PyTorch and TensorFlow
data - Scalable Datasets for ML
train - Distributed Training
tune - Scalable Hyperparameter Tuning. The Tuner is the top level Ray Tune API used to configure and run an experiment with many trials. A hyperparameter optimization framework, most commonly used for deep and reinforcement learning.
serve - Scalable and Programmable model-Serving

B. For reinforcement learning support, install RLlib for Scalable Reinforcement Learning:

pip install -U "ray[rllib]"

RLib</a> -

C. To run general Python applications:

pip install -U "ray[default]"

Test if the installation was successful:

python -m pytest -v python/ray/tests/test_mini.py

Monitoring

Install on every machine and configure for Prometheus.

https://docs.newrelic.com/docs/infrastructure/host-integrations/host-integrations-list/ray-integration/

Dashboard

Monitor Ray apps and clusters with the Ray Dashboard.
Debug Ray apps with the Ray Distributed Debugger.

Identify the head_ip.

Cluster Launcher

Edit the cluster config file >example-full.yaml to create a Ray cluster with a list of nodes.
Fill in the head_ip, a list of worker_ips, and the ssh_user field.

Test that it works by running the following commands from your local machine:

 # Download the example-full.yaml
 wget https://raw.githubusercontent.com/ray-project/ray/master/python/ray/autoscaler/local/example-full.yaml

 # Update the example-full.yaml to update head_ip, worker_ips, and ssh_user.
 # vi example-full.yaml

 # Create or update the cluster. When the command finishes, it will print
 # out the command that can be used to SSH into the cluster head node.
 ray up example-full.yaml

 # Get a remote screen on the head node.
 ray attach example-full.yaml
 # Try running a Ray program.

 # Tear down the cluster.
 ray down example-full.yaml

Ray Serve

https://docs.ray.io/en/latest/ray-overview/examples/mcp-ray-serve/README.html decribes an end-to-end example as a Notebook for running within Google Colab to setup within the Anyscale cloud an MCP FastAPI server having a tool to serve weather info from the US National Weather Service.

Ray’s example specifies older Python versions:

pip install  mcp==1.11.0 asyncio==3.4.3 pydantic==2.9.2

Autoscaling: Dynamically adjusts replica count to match traffic peaks and maintain responsiveness. Ray Serve automatically adjusts the number of replicas based on traffic demand, ensuring your service handles increased load while maintaining responsiveness during peak usage periods.
Observability: Exposes real‑time metrics on request rates, resource usage & system health. Built-in monitoring capabilities provide visibility into your service’s performance, including request metrics, resource utilization, and system health indicators.
Load balancing: Intelligently distributes incoming requests across all replicas for steady throughput. Ray Serve intelligently distributes incoming requests across available replicas, preventing any single instance from becoming overwhelmed and maintaining consistent performance.
Fault tolerance: Detects failures, restarts components, and reroutes traffic to healthy replicas for continuous availability. Ray Serve automatically detects and recovers from failures by restarting failed components and redistributing requests to healthy replicas, ensuring continuous service availability.
Composition: Chains deployments—pre‑process, infer, post‑process, and custom logic—into a single seamless pipeline. Build complex services by orchestrating multiple deployments into a single pipeline, allowing you to chain preprocessing, model inference, postprocessing, and custom logic seamlessly.
Production ready: Enterprise‑grade infrastructure management and automated deployments for real‑world MCP traffic
Logging and tracing: Comprehensive logs, distributed tracing, and real‑time dashboards for end‑to‑end observability
High availability: Availability‑Zone‑aware scheduling and zero‑downtime rolling updates to maximize uptime
Head node fault tolerance: Managed head‑node redundancy to eliminate single points of failure in the Ray cluster coordination layer.
RayTurbo optimizations

01-Deploy_custom_mcp_in_streamable_http_with_ray_serve.ipynb: Deploys a custom Weather MCP server in streamable HTTP mode behind FastAPI + Ray Serve, illustrating autoscaling, load‑balancing, and end‑to‑end testing on Anyscale.

MCP Python library

It uses Podman to deploy MCP tools with existing Docker images for notebooks 3 through 5.

A Brave API key set in your environment (BRAVE_API_KEY) for notebooks 3 and 4

02-Build_mcp_gateway_with_existing_ray_serve_apps.ipynb: Shows how to stand up a single MCP gateway that multiplexes requests to multiple pre‑existing Ray Serve apps under one unified /mcp endpoint, requiring no code changes in the underlying services.

03-Deploy_single_mcp_stdio_docker_image_with_ray_serve.ipynb: Wraps a stdio‑only MCP Docker image, for example Brave Search, with Ray Serve so it exposes /tools and /call HTTP endpoints and scales horizontally without rebuilding the image.

04-Deploy_multiple_mcp_stdio_docker_images_with_ray_serve.ipynb: Extends the previous pattern to run several stdio‑based MCP images side‑by‑side, using fractional‑CPU deployments and a router to direct traffic to the right service.

05-(Optional)_Build_docker_image_for_mcp_server.ipynb: Builds and pushes a lightweight Podman‑based Docker image for a Weather MCP server with uv in an Anyscale workspace.

MCP

https://modelcontextprotocol.io/specification/2025-03-26/basic/transports#streamable-http

SSE (legacy, deprecated): HTTP+Server-Sent events, now deprecated in favor of a unified HTTP transport.

Streamable HTTP: A single HTTP endpoint that handles both client→server POSTs and server→client GET/SSE streams.

https://support.anthropic.com/en/articles/11175166-about-custom-integrations-using-remote-mcp integrate the Claude APP with remote MCP server

Beginner Info

https://www.youtube.com/watch?v=FhXfEXUUQp0 Beginner’s Guide to Ray! Ray Explained The Data Guy

https://domino.ai/blog/ray-tutorial-for-accessing-clusters

Python Ray was originally published by Wilson Mar at Index on November 03, 2025.

Museums Roadtrip USA

2025-10-26T00:00:00+00:00

Visual, architectural, and culinary art in every state and major city, mapped by Machine Learning

Overview

Journeys
References (Websites)
Extreme corners
Just Touching Each State
The US Rain Shadow Divide
US interstate highways
Refueling and ReCharging
Taxes
Coast-to-Coast Trails
US National Parks
Civil War Confederates
Down the Atlantic Eastern Seaboard
Freedom Ride
- Boston:
- Cambridge (North of Boston):
- Western Mass Turnpike 90:
- Northward Mass up 95:
- SouthEast of Boston on 3 to the tip:
- Western Mass up 91:
- Southern Mass:
- New York City (Manhattan)
- New York City (Brooklyn)
- Philadelphia:
- Pittsburgh:
- Williamsburg:
- Atlanta:
- St. Petersberg Northwest on 75 up the Gulf coast
- South down the East coast
- Miami:
Down the Mississippi River
- Chicago:
- Kansas City:
- St. Louis:
- Nashville:
- Memphis:
Northward on Cattle Drives
Journey down the Pan American Highway
Westward on land
- The Pony Express
Westward from Vermont to Kentucky
- Albany/Rochester:
- Adirondacks
- Buffalo:
- Detroit
- Cincinnati:
- Cleveland:
- Indianapolis:
Down the Pacific West Coast
- Spokane:
- Seattle:
- San Francisco Bay:
- San Jose:
- Santa Barbara (Central Coast):
- West Side, Los Angeles:
- Downtown Los Angeles:
- East Los Angeles:
- South Bay, Long Beach:
- Orange County:
- Inland Empire:
- San Diego:
Westward through Northern states
- Northern Rail
- Lewis and Clark Trail Westward Ho
- Oregon Trail to the Pacific
- Milwaukee:
- Duluth (North coast of Lake Superior)
- Minneapolis:
- St. Paul:
Westward through the Southwest
- Route 66
- Chisolm Trail
- Dallas:
- Austin:
- Houston:
- Santa Fe:
- Taos:
- Denver:
All the sights
Technical Footnote

This page lists where one can visit, see, and eat near the most significant cultural artifacts in America. I created this page as a “bucket list” so that even if I can’t visit each one and perhaps enjoy on-site, I can still visit their web pages. Someday soon everyone can see treasures from anywhere using VR (Virtual Reality) glasses providing 360-degree views in High Definition.

Do you have a road trip map or story? Share it! I’d love to know.

Journeys

It’s a large country, so cites are listed by each state of the union, along natural geography East-to-West:

Journeys on water as she flows toward the Equator:

Down the Atlantic Eastern Seaboard (Freedom Ride)
Down the Mississippi River (on a riverboat?)
Down the Pacific West Coast

Journeys Northward on Cattle Drives in the 1880s.

Journey South down the Pan American Highway.

Journeys Westward on land (The Pony Express):

Westward from Vermont to Kentucky
Westward through Northern states (like Lewis and Clark and on the Oregon Trail)
Westward through the Southwest (on Route 66)

BTW, finding where each site is located resulted in a great geography and historical lesson for me.

References (Websites)

Since July 4, 1776, the US has grown from 13 colonies with 2.5 million people to 50 states and 14 territories with over 342 million people connected by roughly 5,000 airports, 140,000 miles of train tracks, 4 million miles of roads, and 5.5 million miles of power lines.

Extreme corners

Iron Butt motocyle rallies award bonus points for reaching the four corners of the nation:

NorthWest: Blaine, Washington (where the Peace Arch international monument straddles the border of US and Canada)
NorthEast: Madawaska, Maine (87% speak French at home in this most northeastern town in the contiguous United States, next to the province of Quebec, Canada)
SouthEast: Key West, Florida (“Home of the Sunset” where you can see the total lunar eclipse on June 26, 2029 [Wikipedia])
SouthWest: San Ysidro, California (the busiest border crossing in the Western Hemisphere)

Just Touching Each State

This Google route map was actually used by recent finishers to go around the 48 states in 6 days:

To deter reckless driving among Extreme Road-trippers, the Guinness World Records discontinued listing speed records in 1996. But that didn’t stop the All Fifty States Club website.

The US Rain Shadow Divide

VIDEO: Notice the transition between yellow to green down the middle of the country?

VIDEO: 80% of Americans live East of the (vertical) 98th Meridian, as shown by a green straight line overlaid this map from NASA’s BlackMarble satellite images of the nigh sky worldwide:

When geologist John Westly Powell identified this phenomenon across the “pairies” in 1890, that natural line was at the 100th Meridian (vs. 98th today). Since then, “Climate change” continues to shift to the East. So expect less rain from Winnapeg (Canada) to Forth Worth, Ausin, and San Antonio Texas. Also impacted will be agriculture around Winnipeg (Manitoba, Canada), Fargo, Sioux Falls, Omaha, Lincoln, Wichita, Oklahoma City.

That green line down the middle of America defines the extent wet storms reach from the East. West of that is the “Rain Shadow” of limited moisture from the Pacific West blocked by the tall Cascade Mountains in Washington state housing Leavenworth, Washington and Rocky Mountains housing Aspen, Vail, Breckenridge, Telluride, Denver, Colorado), Park City, Utah, California.

The East coast also has quaint towns well decorated for Christmas :

Ogunquit, Maine
Portsmouth, New Hampshire
Nantucket, Massachusetts
Newport, Rhode Island
Christmas Village, Philadelphia
Cape May, New Jersey
Atlantic City, New Jersey
New York, New York
Annapolis, Maryland
Charlottesville, Virginia
Lewisburg, West Virginia
Beaufort, North Carolina
Myrtle Beach, South Carolina
Natchitoches, Louisiana
Santa Rosa Beach, Florida

US interstate highways

East-west interstate highway numbers end with 0.
North-South interstate highway numbers end with 5.

Refueling and ReCharging

The number of Tesla Supercharger locations jumped to 2,966 in Q2 2021 from 1,587 at Q1 2019:

In 2023 Ford and GM agreed to enable their electric cars to use Tesla’s charging ports and stations.

A map of stations offering Ethanol-free premium gasoline (at higher prices) is at pure-gas.org/extensions/map.html. My wife used it to figure out where I should stop along a route from Florida to Montana. It was difficult because we had to figure out where I was on the website’s map. She also had to calculate how much further I could go with remaining gas. Somehow we managed to stay married after that.

Taxes

No sales tax is collected from residents within the states of Alaska, Delaware, Montana, New Hampshire, and Oregon. The Sales Tax Institute notes: Residents from other states are often required by laws in their home state to pay out-of-state sales tax. Sellers in tax-free states still collect the sales tax for visitors and remit it to the buyer’s home state if the vendor has a presence in the buyer’s home state. Otherwise, out-of-state buyers are required to pay use tax themselves. Many don’t pay the use tax to their home state even though there can be significant fines, on top of paying the tax, for not doing so.

Some states offer sales tax-free holidays (for a limited time) to encourage spending on products that are considered to be of benefit to the state’s economy. This typically occurs in August and early September for back-to-school supplies, books, computers, and clothing.

Coast-to-Coast Trails

VIDEO: The American Discovery Trail (https://discoverytrail.org/) spans 6,800 miles from coast to coast, with two options in the middle states. The route across rural and urban areas, wilderness, desert mountains and forests.

NERDY TRIVIA: How fast would one need to drive to see a sunset continuously?
If you were at 89.9 degrees North near a Pole, you could walk across all time zones in the world.
The formula is: v = circumference * cos(ϕ) where ϕ = latitude.
At the equator, the circumferance of the earth is 40,075 km, so the earth rotates at 40,075 km / 24 h ≈ 1670 km/h (1038 mph).
At Denver, Colorado, its 40 degrees latitude = 0.77 radians, so 1279 km/h (795 mph). See my Python program that calculates it at https://github.com/wilsonmar/python-samples/blob/main/sunset-speed.py

US National Parks

Among America’s greatest treasures are the 63 national parks managed by the U.S. National Park Service.

The map above is missing White Sands National Park (New Mexico), Indiana Dunes, and Gateway Arch (St. Louis).

One couple visited the most significant parks in this order:

The above route through major landmarks in the lower 48 states was optimized for least driving time across 6,813 miles, using Google Maps API driven by Machine Learning algorithms run in a Python Jupyter Notebook as described by Randal S. Olson. See How to USE AI to Plan a Road Trip.

CAUTION: as COVID lockdowns relax, reservations are at all-time highs at recreation.gov/, KOA, ReserveAmerica.com, and state camping sites.

Many “Western” movies were filmed in iconic “Mighty 5” parks below Salt Lake City in Utah: Las Vegas from the South and Denver from the North 322 miles in 5 hours without stopping (click for Google Map). But you’ll want to stop and marvel the views at each park:

4K 360 VIDEO: Zion (Utah’s first National Park)
4K 360 VIDEO: Bryce Canyon VIDEO
4K 360 VIDEO: Capital Reef
4K 360 VIDEO: Arches
4K 360 VIDEO: Canyonlands

Civil War Confederates

When the Civil War ended in 1865, The Confederacy included the 11 Southern states of Texas, Arkansas, Louisiana, Tennessee, Mississippi, Alabama, Georgia, Florida, South Carolina, North Carolina, and Virginia.

The 5 “Border States” were Maryland, Delaware, West Virginia, Kentucky, and Missouri (where “brother fought brother”). VIDEO: Although Kentucky’s legislature voted to be neutral, the state was represented as a star in both Confederate and Union flags and was occupied by both Confederate and Union troops. Four times more Kentucky citizens fought for the Union than for the Confederacy.

States in white (Oklahoma) did not fight for either side. Idaho volunteers did not fight against the Confederacy. Areas in Arizona and New Mexico were claimed by both sides.

Down the Atlantic Eastern Seaboard

This is where the United States of America began as colonies of England.

Freedom Ride

The planned route of the courageous Freedom Ride May 1961 through the “Jim Crow” South to test a Supreme Court ruling against “whites-only” restrooms and lunch counters at bus stations:

The Woolworth lunch counter in downtown Greensboro, NC is now a museum.

The ride stopped on May 14 in Anniston, Alabama where their bus was burnt by segregationists.

Maine

Bates Museum of Art, Lewiston
Bowdoin College Museum of Art, Brunswick
Colby College Museum of Art, Waterville
Farnsworth Art Museum, Rockland
Hudson Museum at the University of Maine, Orono
Portland Museum of Art
~~University of Maine Museum of Art~~, Orono
Artemus Ward House, Waterford Maine
Maple syrup creamies!

New Hampshire

Cornish Colony Gallery and Museum
Saint-Gaudens National Historic Site, Cornish
Currier Gallery of Art, Manchester
Hood Museum of Art, Hanover
Thorne-Sagendorph Art Gallery at Keene State College
Robert Frost House, Franconia

Massachusettes

Boston:

Boston is among the safest large cities in the US.

Arts on the Point Sculpture Park, Boston
Boston University Art Gallery
Boston Athenaeum
Institute of Contemporary Art, Boston
Isabella Stewart Gardner Museum, Boston
Museum of Fine Arts
Museum of Science and Hayden Planetarium
USS Constitution Museum, Boston
John F. Kennedy Presidential Library and Museum, Columbia Point, Boston

Cambridge (North of Boston):

Harvard University Art Museums, Cambridge
Peabody Museum of Archaeology and Ethnology at Harvard University, Cambridge
Fogg Art Museum
MIT Museum
Arthur M. Sackler Museum
Rose Art Museum at Brandeis University, Waltham
Henry Wadsworth Longfellow House, Cambridge, Massachusetts

Western Mass Turnpike 90:

Edith Wharton's The Mount, Lenox
Museum of Bad Art, Dedham
McMullen Museum of Art at Boston College, Chestnut Hill
Davis Museum and Cultural Center at Wellesley College, in Wellesley, MA
~~Danforth Museum of Art~~, Framingham
Worcester Art Museum
Old Sturbridge Village
Norman Rockwell Museum, Stockbridge
Mount Holyoke College Art Museum, South Hadley
Berkshire Museum, Pittsfield
Herman Melville's Arrowhead, Pittsfield
The Springfield Museums at the Quadrangle
Dr. Seuss Memorial, Springfield
Site of Thoreau's Cabin, Walden Pond, Concord
Wayside (home of Nathaniel Hawthorne, Louisa May Alcott, and Margaret Sidney), Concord
Ralph Waldo Emerson Home, Concord
Louisa May Alcott's Orchard House, Concord

Northward Mass up 95:

Griffin Museum of Photography, Winchester
Tufts University Gallery, Medford
Whistler House Museum Of Art, Lowell
Addison Gallery of American Art, Andover
Peabody Essex Museum, Salem

SouthEast of Boston on 3 to the tip:

Western Mass up 91:

DeCordova Museum and Sculpture Park, Lincoln
Mead Art Museum at Amherst College, Amherst
Eric Carle Museum of Picture Book Art, Amherst
Emily Dickinson's Home, Amherst
Smith College Museum of Art, Northampton
Clark Art Institute, Williamstown
Williams College Museum of Art, Williamstown
Massachusetts Museum of Contemporary Art, North Adams

Southern Mass:

Rhode Island

David Winton Bell Gallery at Brown University, Providence
Rhode Island School of Design Museum of Art Providence
Newport Art Museum
National Museum of American Illustration, Newport

Connecticut

Mercy Gallery at the Loomis Chaffee School, Windsor
Benton Museum of Art at the University of Connecticut, Storrs
Mark Twain House and Museum, West Hartford [1]
Harriet Beecher Stowe Home, West Hartford
Wadsworth Atheneum, Hartford
Hill-Stead Museum, Farmington
New Britain Museum of American Art
Davison Art Center at Wesleyan University, Middletown
Florence Griswold Museum, Old Lyme
Mattatuck Museum, Waterbury
Slater Museum at Norwich Free Academy
Yale Center for British Art, New Haven
Yale University Art Gallery, New Haven
Housatonic Museum of Art, Bridgeport
Aldrich Museum of Contemporary Art, Ridgefield
The Stamford Museum and Nature Center
Bruce Museum of Arts and Science, Greenwich

New Jersey

Jersey City Museum across the Hudson from Manhattan
Newark Museum
New Jersey State Museum, Trenton
Jane Voorhees Zimmerli Art Museum at Rutgers University, Brunswick
Art Museum at Princeton University, Princeton
Rats [restaurant with gardens]

Bergen Museum, Hackensack
Grounds For Sculpture, Hamilton
Montclair Art Museum
Morris Museum, Morristown
Noyes Museum of Art, Oceanville
Wheaton Village Museum of American Glass, Millville

New York

Franklin D. Roosevelt Presidential Library and Museum, Hyde Park

New York City (Manhattan)

Bronx Museum of Art
Metropolitan Museum of Art and the Cloisters
Alternative Museum
American Folk Art Museum
American Museum of Natural History
Chelsea Art Museum
Cooper-Hewitt, National Design Museum
Dahesh Museum
Dia Center for the Arts
Dia: Chelsea
International Center of Photography
Jewish Museum
Lehman College Art Gallery
Morgan Library
El Museo del Barrio
Museum for African Art
Museum of Modern Art (MOMA)
Museum of the City of New York
Museum of the National Academy of Design
National Museum of the American Indian
Neue Galerie Museum for German and Austrian Art
New Museum of Contemporary Art
New-York Historical Society
Nicholas Roerich Museum
Queens Museum of Art
Rubin Museum of Art: Art of the Himalayas
Staten Island Institute of Arts and Sciences
Studio Museum in Harlem
Ukrainian Museum
Whitney Museum of American Art
American Museum of Natural History
Gallery of Modern Art
GONE: Museum of Holography
Metropolitan Museum of Art (the Met)
Guggenheim Museum
Solomon R. Guggenheim Museum, with Guggenheim.com for motorcycles and Guggenheim.org for environmental art
Museum of the American Indian
Grey Art Gallery at New York University
Frick Collection
Hispanic Society of America

New York City (Brooklyn)

DUMBO = Down Under the Manhattan Bridge Overpass is home to 25% of New York based tech firms, including Etsy. [tour]

Walk the Brooklyn Bridge
River Cafe (Jackets required of men)
Brooklyn Museum of Art
Rotunda Gallery

Pennsylvania

Allentown Art Museum
Arnold Art Gallery at Lebanon Valley College, Annville
Barnes Foundation, Merion
Brandywine River Museum, Chadds Ford
Charles Demuth Foundation and Museum, Lancaster
Erie Art Museum, Erie
Everhart Museum, Scranton
Glencairn Museum, Bryn Athyn
James Michener Art Museum, Doylestown
Juniata College Museum of Art, Huntingdon
Palmer Museum of Art at Pennsylvania State University, University Park
Reading Public Museum, Reading
Samek Art Gallery at Bucknell University, Lewisburg
Southern Alleghenies Museum of Art, Johnstown
State Museum of Pennsylvania, Harrisburg
Widener University Art Gallery and Collection, Chester
Railroad Museum of Pennsylvania, Ronks (Lancaster)

Philadelphia:

Franklin Institute Science Museum
Mütter Museum [weird] 19 S. 22nd St. 19103
National Liberty Museum
Pennsylvania Academy of the Fine Arts
Moore College of Art and Design Galleries
University of Pennsylvania Museum of Archaeology and Anthropology
The Eakins Gallery at Thomas Jefferson University
La Salle University Art Museum
Institute of Contemporary Art
Arthur Ross Gallery at the University of Pennsylvania
Academy of Natural Sciences
Rosenbach Museum and Library
Philadelphia Museum of Art
Rodin Museum at the Philadelphia Museum of Art
Barnes Foundation Collection, Merion
Museum of American Art
University Museum of Archaeology and Anthropology
Woodmere Art Museum

Ristorante Pesto
Vetri Cucina [#50]
Zahav restaurant of Israeli cuisine, Philadelphia

Pittsburgh:

Carnegie Museum of Art
Andy Warhol Museum
Frick Art and Historical Center
Mattress Factory Museum of Contemporary Art
Carnie Museum of Natural History

Delaware

Maryland

Baltimore had the #3 rate of crime among all cities in the US (2,027/100,000 in 2022).

Academy Art Museum, Easton
African Art Museum of Maryland, Columbia
American Visionary Art Museum, Baltimore
Art Gallery at the University of Maryland, College Park
Baltimore Museum of Art
Contemporary Museum, Baltimore
Peabody Gallery of Art, Baltimore
Walters Art Gallery, Baltimore
Ward Museum of Wildfowl Art, Salisbury
Washington County Museum of Fine Arts, Hagerstown

Washington DC

Dumbarton Oaks Collection
Freer Gallery of Art
National Air and Space Museum
National Archives, 700 Pennsylvania Ave. 202-357-5000 See the US Constitution, Bill of Rights and the Declaration of Independence. But the Emancipation Proclamation is open to the public just 4 days a year around MLK Holiday Jan. 13-16 Friday-Monday 10 a.m.-5:30 p.m.
The Smithsonian Institution: The Freer Gallery of Art and The Arthur M. Sackler Gallery
Sackler/Freer Galleries
Art Museum of the Americas
Corcoran Gallery of Art
Dimock Gallery at George Washington University
Dumbarton Oaks Research Library and Collection
Hillwood Museum and Gardens
Hirshhorn Museum and Sculpture Garden
Howard University Gallery of Art
Kreeger Museum
U.S. National Gallery of Art
National Museum of African Art
Smithsonian American Art Museum
National Museum of Women in the Arts
National Portrait Gallery
National Statuary Hall
Phillips Collection 1600 21st Street, NW 20009 Closed Mondays
Smithsonian Institution
Textile Museum
U.S. Capital Art Collection
U.S. Navy Art Collection
US Holocost Memorial Museum 10-5:30 every day, but timed passes are necessary for visiting the permanent exhibit (20 each day from tickets.com for $1.75)
White House, 1900 Pennsylvania Avenue

West Virginia

Virginia

Richmond is the capital of Virginia, and the capital of the Confederacy during the Civil War. In 2022 it was the 3rd most dangerous city in the US (2,027/100,000).

Anderson Gallery at the VCU School for the Arts, Richmond
Art Museum of Western Virginia, Roanoke
Belmont, The Gari Melchers Estate and Memorial Gallery, Fredericksburg
Chrysler Museum, Norfolk
Hampton University Museum
Hermitage Foundation Museum, Norfolk
Lynchburg Fine Arts Center
Maier Museum of Art at Randolph-Macon Woman's College, Lynchburg
Museum for American Studies at the University of Virginia, Charlottesville
University of Virginia Art Museum, Charlottesville
Sweet Briar College Art Galleries
University of Richmond Museums
Virginia Museum of Fine Arts, Richmond
William King Regional Arts Center, Abingdon

Williamsburg:

Muscarelle Museum of Art at the College of William and Mary
Abby Aldrich
Rockefeller Folk Art Collection
Colonial Williamsburg Villege reenacts 18th centry American village

North Carolina

Asheville Art Museum
Biltmore Estate, the largest privately-owned house in America, built by George Vanderbilt, Asheville
In Asheville, the fanciest McDonald's in America (with a piano and fireplace)
Ackland Art Museum at the University of North Carolina, Chapel Hill
Lantern restaurant, Chapel Hill
Duke University Museum of Art, Durham
Guilford College Art Gallery, Greensboro
Hickory Museum of Art
Mint Museum of Art, Charlotte
North Carolina Museum of Art, Raleigh
Contemporary Art Museum, Raleigh
North Carolina State University Gallery of Art and Design, Raleigh
Reynolda House Museum of American Art, Winston-Salem
Southeastern Center for Contemporary Art (SECCA), Winston-Salem
Wake Forest University Art Collections, Winston-Salem

South Carolina

Bob Jones University Museum and Gallery, Greenville
Greenville County Museum of Art
Columbia Museum of Art
South Carolina State Museum, Columbia
Gibbes Museum of Art, Charleston
Huntington Sculpture Garden, Pawleys Island
Spartanburg County Museum of Art
Fort Sumter National Monument, Sullivan's Island
FIG restaurant, Charleston
Husk restaurant (Southern food), Charleston

Georgia

Albany Museum of Art
Booth Western Art Museum, Cartersville
Columbus Museum
Georgia Museum of Art at the University of Georgia, Athens

Atlanta:

Carlos Museum at Emory University
World of Coca Cola
High Museum of Art
Oglethorpe University Museum, Atlanta
Jimmy Carter Presidential Library and Museum, Atlanta
Staplehouse restaurant (menu)

Morris Museum of Art, Augusta
Telfair Museum of Art, Savannah
The Grey, Savannah

Florida

Down the Mississippi River

At 2,300 miles, the Mississippi River is the 4th longest in the world (after Nile, Amazon, Yangtze). It’s part of the largest watershed in the world.

VIDEO: “It’s inevitable that the US emerged as a global superpower”: the Missisippi is the longest navigable river in the world, enabling inland cities to be oceanic ports serving world markets by boat (10-39X cheaper than by road).

It takes 8 days for the “America Heartland” cruise between St. Louis and to St. Paul (waterfalls at the head of the Mississipi):

Cruise on a riverboat between New Orleans and Memphis, with stops in the Vicksburg battlegrounds. on Viking or the “American Countess”.

Cruise from Chicago to St. Louis down the Illinois River.

Illinois

Block Museum of Art at Northwestern University, Evanston
Elmhurst Art Museum
Krannert Art Museum, Champaign
The Mitchell Museum and Cedarhurst Sculpture Park, Mt. Vernon
Northern Illinois University Art Museum, DeKalb
Rockford Art Museum
Southern Illinois University Museum, Carbondale
Tarble Arts Center at Eastern Illinois University, Charleston

Chicago:

Chicago had the #20 rate of crime among all cities in the US (1,099/100,000 in 2022).

Museum of Contemporary Art (MCA), Chicago
Art Institute of Chicago
DePaul University Museum
DuSable Museum of African American History
Martin D'Arcy Museum of Art at Loyola University
Mexican Fine Arts Center Museum
Museum of Contemporary Art
Museum of Contemporary Photography at Columbia College
National Vietnam Veterans Art Museum
Oriental Institute Museum at the University of Chicago
Smart Museum of Art at the University of Chicago
Ukrainian Institute of Modern Art
Barack Obama Presidential Library, Hoffman Estates
Farnsworth House (1951), 14520 River Road, Plano, IL 60545

Purple Pig
Zahav [Israeli restaurant]
Au Cheval burgers [#29]
Fat Rice, Chicago [#58]
Red Apple Buffet
Alinea (3-star Michelin & rated the Best Restaurant in the US)

Missouri

Harry S. Truman Presidential Library and Museum, Independence
Ashby-Hodge Gallery of American Art, Fayette
Daum Museum of Contemporary Art, Sedalia
Margaret Harwell Art Museum, Poplar Bluff
Museum of Art and Archaeology at the University of Missouri, Columbia
Mark Twain Museum, Hanibal

Kansas City:

Albrecht-Kemper Museum of Art, St. Joseph
Kemper Museum of Contemporary Art and Design, Kansas City
Nelson-Atkins Museum of Art, Kansas City

St. Louis:

St. Louis had the #1 rate of crime among all cities in the US (2,082/100,000 in 2022).

Tennessee

Carroll Reece Museum at East Tennessee State University, Johnson City
Hunter Museum of American Art, Chattanooga
Knoxville Museum of Art
McClung Museum at the University of Tennesse, Knoxville
Dollywood (amusement park), Pigeon Forge
The Barn at Blackberry Farm, Walland, Tennessee

Nashville:

Nashville had the #16 rate of crime among all cities in the US (1,138/100,000 in 2022).

Cheekwood Museum of Art, Nashville
The Parthenon, Nashville
Tennessee State Museum, Nashville
Vanderbilt University Fine Arts Gallery, Nashville

Memphis:

Memphis had the #4 rate of crime among all cities in the US (2,003/100,000 in 2022).

Arkansas

Little Rock had the #5 rate of crime among all cities in the US (1,634/100,000 in 2022).

Anthony Chapel in Garvan Woodland Gardens at U of Arkansas
Crystal Bridges Museum of American Art, Bentonville
Ozark Heritage Arts Center and Museum, Leslie
Baum Gallery of Fine Art at the University of Central Arkansas, Conway
Clinton Presidential Library and Museum, Little Rock
Toltec Mounds, Scott [site]

Mississippi

George E. Ohr Arts and Cultural Center, Biloxi
Lauren Rogers Museum of Art, Laurel
Mississippi Museum of Art, Jackson
University Museums at the University of Mississippi, Oxford
Walter Anderson Museum of Art, Ocean Springs

Louisiana

New Orleans had the #18 rate of crime among all cities in the US (1,121/100,000 in 2022).

Alexandria Museum of Art
Contemporary Arts Center New Orleans
Louisiana State Museum, New Orleans
Mardi Gras World, New Orleans
Louisiana State University Museum of Art, Baton Rouge
Meadows Museum of Art at Centenary College, Shreveport
New Orleans Museum of Art
R.W. Norton Art Gallery, Shreveport
Ogden Museum of Southern Art, New Orleans
Mounds at Poverty Point
Delgado Museum of Art
Louisiane State Museum

Alabama

Huntsville Museum of Art
Birmingham Museum of Art
Highlands Bar & Grill, Birmingham
Montgomery Museum of Fine Arts
Acre, Auburn
American Sport Art Museum and Archives, Daphne
Wiregrass Museum of Art, Dothan
Mobile Museum of Art

Northward on Cattle Drives

The TV series “1883” is about one of the cattle drives that brought Texas back from economic collapse after the end of the Civil War in 1865. The drive went from Fort Worth North toward Montana and Portland. Although a fictional story, the script mentions real locations: Doan’s Store Red River Crossing, established 1878 along the Western Trail to Dodge City, Kansas where trains carried cattle East.

In 1881 the Doan’s Cross reached a peak of 301,000 cattle driven by to Kansas shipping points. This was before the “Chisolm Trail”.

In 1884 an annual picnic, celebrating the cattle drives and cowboy tradition, began near Doan’s Store.

In 1885 long cattle drives was eliminated by both the construction of railroads across north Texas and the fencing of the West using newly invented barbed wire.

The TV series “Lonesome Dove”, is set in late 1870s. Just like the “1883” TV series, it is also about cowboys seeking to drive cattle North to settle along Montana’s Yellowstone River. Several other movies have characters doing the same.

Journey down the Pan American Highway

VIDEO: The longest road in the world is the 30,000 km (19,000 miles) of the Pan American Highway.

It starts from the North in Prudhoe Bay, Alaska through Fairbanks, into Canada’s Whitehorse, Edmonton, Calgary. It crosses into the United States down highway 15 and 87 into Billings, Montana. Then down 90, 25, into Denver. 285 into Albuquerque, New Mexico. 40 and 285 to Roswell, then 385 to Browfield. 87 to Eden. 83 to Junction. 10 to San Antonio and 85 to Loredo, Texas. 285 into Mexico to Monterrey and Mexico City.

Except for a break flying over the swamps of the Darian Gap between two continents at Yaviza, Panama and Turbo, Antioquia, Colombia, the Vía Panam or Vía Panamericana goes all the way down to Tierra del Fuego, Chile.

Westward on land

“Go West, young Man, and grow up with the country!” is the advice widely (but wrongly) attributed to New York Tribune Publisher Horace Greeley, who visited the West only once.

The Pony Express

80 Pony Express riders (who include Calamity Jane) traveled day and night to deliver mail from St. Joseph, Missouri on the Missouri River to San Francisco, California in only 10 days rather than the previous 24 days. They carried news of the volatile time leading up to the Civil War.

Photo source: Wikimedia.

The riders can run at full gallop along their 1,900-mile (3,100 km) route because they switch horses waiting at each of 184 stations, each about 10-15 miles apart.

But their service lasted for less than 2 years – from April 3, 1860 to October 24, 1861 – due to the availability of the electric telegraph along railroads.

Westward from Vermont to Kentucky

Vermont

Bennington Museum
Brattleboro Museum and Art Center
Fleming Museum at the University of Vermont, Burlington
Middlebury College Museum of Art
Norman Rockwell Museum, Rutland Town
St. Johnsbury Athenaeum
Shelburne Museum
Ark Encounter, Williamstown

Upstate New York

Albany/Rochester:

Albany Institute of History and Art
Castellani Art Museum at Niagara University, Niagara Falls
George Eastman House International Museum of Photography and Film, Rochester
Memorial Art Gallery at the University of Rochester
Strong Museum, Rochester
University Art Museum, Albany

Adirondacks

The Adirondack Museum, Blue Mountain Lake
American Museum of the Moving Image, Astoria
Canajoharie Library and Art Gallery
Corning Museum of Glass, Corning
Dia: Beacon, Beacon City
Samuel Dorsky Museum of Art at SUNY New Paltz
Emerson Gallery at Hamilton College, Clinton
Everson Museum of Art, Syracuse
Fenimore Art Museum, Cooperstown
Frederic Remington Art Museum, Ogdensburg
Genesee Country Village and Museum, Mumford
Guild Hall, East Hampton
Hammond Museum and Japanese Stroll Garden, North Salem
Heckscher Museum of Art, Huntington
Hofstra University Museum, Hempstead
Hudson River Museum, Yonkers
Hyde Collection Art Museum, Glens Falls
Isamu Noguchi Garden Museum, Long Island City
Islip Art Museum, East Islip
Johnson Museum of Art at Cornell University, Ithaca
Katonah Museum of Art
Loeb Art Center at Vassar College, Poughkeepsie
Long Island Museum of American Art, History and Carriages, Stony Brook
Morrisville College Library
Nassau County Museum of Art, Roslyn Harbor
Neuberger Museum of Art at Purchase College, Purchase
New York State Museum, Albany
Newington-Cropsey Foundation, Hastings on Hudson
NY Center for Media Arts, Long Island City
Parrish Art Museum, Southampton
Picker Art Gallery at Colgate University, Hamilton
Plattsburgh State University Art Museum
P.S. 1 Museum, Long Island City
Rockwell Museum, Corning
Schein-Joseph International Museum of Ceramic Art, Alfred
The Schick Art Gallery and The Tang Museum at Skidmore College, Saratoga Springs
Shaker Museum and Library, Old Chatham
Storm King Art Center, Mountainville
Syracuse University Art Collection

Buffalo:

Albright-Knox Art Gallery, Buffalo
State University at Buffalo Art Gallery
The Burchfield Penney Art Center, Buffalo

Michigan

Henry Ford Museum
Greenfield village
Cranbrook Art Museum, Bloomfield Hills
Dennos Museum Center, Traverse City
Flint Institute of Arts
Grand Rapids Art Museum
Kelsey Museum of Archaeology at the University of Michigan, Ann Arbor
Kresge Art Museum at Michigan State University, East Lansing
Muskegon Museum of Art
Saginaw Art Museum
Shiawassee Arts Center, Owosso
University of Michigan Museum of Art, Ann Arbor
Urban Institute for Contemporary Arts, Grand Rapids
Gerald R. Ford Presidential Library, Ann Arbor

Detroit

Detroit had the #2 rate of crime among all cities in the US (2,057/100,000 in 2022).

Ohio

Toledo Museum of Art
Table 128 Bistro, Toledo

Cincinnati:

Cincinnati Art Museum
Museum Center of Union Terminal
American Neon Sign Museum</a>
Creation Museum (is closest to the Cincinnati airport)
Ark Encounter (44 miles South in Kentucky from the Creation Museum)

Cleveland:

Cleveland had the #8 rate of crime among all cities in the US (1,557/100,000 in 2022).

Rock and Roll Hall of Fame by the Lake Erie shore
Cleveland Museum of Art

Indiana

Indianapolis:

Indianapolis Children's Museum
Eiteljorg Museum of American Indians and Western Art
Herron School of Art Gallery
Indiana State Museum
Indianapolis Museum of Art
National Art Museum of Sport at Indiana University, Indianapolis
Richmond Art Museum
Alewife restaurant, Richmond
Indianapolis Art Center
Indianapolis Museum of Art

Ball State University Museum of Art, Muncie
Brauer Museum of Art at Valparaiso University
Evansville Museum of Arts and Science
Fort Wayne Museum of Art
Greater Lafayette Museum of Art
Greentown Glass Museum
Indiana University Art Museum, Bloomington
Snite Museum of Art at the University of Notre Dame, South Bend
Swope Art Museum, Terre Haute
Turman Gallery at Indiana State University, Terre Haute

Kentucky

International Museum of the Horse, Lexington
Kentucky Art and Craft Foundation, Louisville
Kentucky Museum at Western Kentucky University, Bowling Green
Speed Art Museum, Louisville
University of Kentucky Art Museum, Lexington
Mammoth Cave National Park

Down the Pacific West Coast

The Coast Starlight line on Amtrak has coastal portions between Seattle and Portland, and along the middle of California.

Alaska

NOTE: Driving from Alaska to Washington state requires travel through Canada.

Washington

Spokane:

Seattle:

Bellevue Art Museum

Oregon

Coos Art Museum, Coos Bay
Corvallis Arts Center
Hallie Ford Museum of Art at Willamette University, Salem
Portland Art Museum
Portland Institute for Contemporary Art
Le Pigeon (Le Pigeon burger), Portland
Schneider Museum of Art at Southern Oregon University, Ashland
University of Oregon Museum of Art, Eugene

California

Crocker Art Museum, Sacramento
The Kitchen Restaurant, Sacramento
Stockton - Haggin Museum
Sonoma Valley Museum of Art, Sonoma
Sonoma State University Art Gallery, Rohnert Park
di Rosa Preserve, Napa

San Francisco Bay:

Yerba Buena Center for the Arts, San Francisco
San Francisco Museum of Modern Art
Asian Art Museum of San Francisco
San Francisco State University Fine Arts Gallery
Thacher Gallery at the University of San Francisco
California Academy of Science
California Museum of the Legion Of Honor
San Francisco Museum of Modern Art
M H de Young Museum, San Francisco
Friends of Photography/Ansel Adams Center, San Francisco
The Jewish Museum, San Francisco</a>
Museum of Craft and Folk Art
Cable Car Museum
Alcatraz island [ferry]

San Jose:

Santa Barbara (Central Coast):

Hearst Castle, San Simeon
Oceanside Museum of Art
Art Museum at U.C. Santa Barbara
Santa Barbara Museum of Art
Wildling Art Museum, Los Olivos
California Center for the Arts, Escondido
Carnegie Art Museum, Oxnard
Lee Institute for Japanese Art, Hanford
Ventura County Museum of History and Art, Ventura

West Side, Los Angeles:

J. Paul Getty Museum, Malibu
Santa Monica Museum of Art
UCLA Fowler Museum of Cultural History, Los Angeles
Armand Hammer Museum of Art at UCLA, Los Angeles

Museum of Television and Radio, Beverly Hills
Skirball Cultural Center, Los Angeles
Los Angeles County Museum of Art, Los Angeles
California African-American Museum, Los Angeles
Museum of Contemporary Art

Downtown Los Angeles:

Corita [Kent] Art Center, Los Angeles
Museum of Neon Art, Los Angeles
Korean American Museum, Los Angeles
Fisher Gallery at the University of Southern California, Los Angeles
The Broad, then Otium restaurant, downtown Los Angeles
Southwest Museum, Los Angeles

East Los Angeles:

Autry Museum of Western Heritage
Ronald Reagan Presidential Library and Museum, Simi Valley
Huntington Library, San Marino
Norton Simon Museum, Pasadena
Pacific Asia Museum, Pasadena

South Bay, Long Beach:

Museum of Latin American Art, Long Beach
Long Beach Museum of Art
California State University Art Museum, Long Beach
California State University Library, Long Beach

Orange County:

Richard Nixon Presidential Library and Museum, Yorba Linda
Fullerton Museum Center
Disneyland, Anaheim
Bowers Museum of Cultural Art, Santa Ana
Irvine Museum
Orange County Museum of Art, Newport Beach
Laguna Art Museum, Laguna Beach

Inland Empire:

Ruth Chandler Williamson Gallery at Scripps College, Claremont
Pomona College Museum of Art, Claremont
Latino Art Museum, Pomona
Historical Glass Museum, Redlands
California Museum of Photography at U.C. Riverside
Sweeney Art Gallery at U.C. Riverside
Riverside Art Museum
Bakersfield Museum of Art
Palm Springs Desert Museum

San Diego:

Museum of Photographic Arts
Mingei International Museum of Folk Art
Timken Museum of Art, San Diego
Museum of Contemporary Art
San Diego Art Institute
Stuart Collection of Sculpture at U.C. San Diego
San Diego Museum Of Art
Addison (restaurant), Del Mar, San Diego

Hawaii

Honolulu and Hawaii as a whole had the lowest crime rate among all US cities and states.

Contemporary Museum, Honolulu
Honolulu Academy of Arts
Hana Cultural Center and Museum, Hana, Maui

Westward through Northern states

Going from New York City to Seattle takes 2,852-miles on Interstates 80 and 90, crossing 11 states.

Northern Rail

Amtrak’s Empire Builder train between Chicago to Seattle and Portland takes 46 hours.

Amtrak’s California Zephyr (named after the Greek god of the Western wind). VIDEO: from Chicago to Emeryville (San Franciso) – 2 nights through 7 states: Naperville, Galesburg, Omaha, Denver (a one hour stop) over the mountains to Grand Junction, Reno, Truckee, Salt Lake City. With no wi-fi between stations.

Lewis and Clark Trail Westward Ho

The Lewis and Clark Expedition of 1804 to 1806 is an 8,000-mile trip to the Pacific (Portland, Oregon) returned with maps and scientific specimens for President Thomas Jefferson.

The Lewis and Clark Trail today is a set of hiking trails. “Wm Clark” carved “July 25, 1806” on “Pompey’s Pillar” 30m miles East of Billings, Montana.

The “Corps of Discovery” emboldened wagon trains traveling Westward through Northern United States.

Oregon Trail to the Pacific

The Oregon Trail was established during the 1830s by mountain men in their fur trade, before motorized transportation. It favors valleys to minimize going over mountains:

The trail begins from St. Louis and Independence, Missouri through Kansas and Nebraska to Fort Laramie, Wyoming (1834-1890). It then goes through Boise, Idaho to Portland, Oregon. A map of the trail in 1907:

Kansas

Boot Hill Museum, Dodge City
Beach Museum of Art at Kansas State University, Manhattan
Birger Sandzen Memorial Gallery, Lindsborg
Coutts Memorial Museum of Art, El Dorado
Mulvane Art Museum at Washburn University, Topeka
Spencer Museum of Art at the University of Kansas, Lawrence
Ulrich Museum of Art at Wichita State University
Wichita Art Museum
Oz museum, Wamego

Iowa

Arts Iowa City
Blanden Memorial Art Museum, Fort Dodge
Brunnier Art Museum at Iowa State University, Ames
Cedar Rapids Museum of Art
Davenport Museum of Art
Des Moines Art Center
University of Iowa Museum of Art, Iowa City
Waterloo Museum of Art
Des Moines: Living History Farms (at Urbandale)
Herbert Hoover Presidential Library and Museum, West Branch
Walcott Trucking Museumis next to Iowa 80, the largest truck stop in the world (VIDEO)

Wisconsin

Elvehjem Museum of Art at the University of Wisconsin, Madison
Fairfield Public Gallery, Sturgeon Bay
John Michael Kohler Arts Center, Sheboygan
Leigh Yawkey Woodson Art Museum, Wausau
Madison Museum of Contemporary Art
Paine Art Center and Arboretum, Oshkosh
Racine Art Museum
West Bend Art Museum
Wright Museum of Art at Beloit College, Beloit

Milwaukee:

Milwaukee had the #6 rate of crime among all cities in the US (2,082/100,000 in 2022).

William F. Eisner Museum of Advertising and Design, Milwaukee
Haggerty Museum of Art at Marquette University, Milwaukee
Milwaukee Art Museum
Ristorante Bartolotta [#94]

Minnesota

Duluth (North coast of Lake Superior)

Minneapolis:

Minneapolis had the #19 rate of crime among all cities in the US (1,101/100,000 in 2022).

The Minneapolis Institute of Arts
Minneapolis Institute of Arts</strong>
Walker Art Center, Minneapolis
Weisman Art Museum at the University of Minnesota, Minneapolis
Spoon and Stable restaurant, Minneapolis

St. Paul:

Denler Art Gallery at Northwestern College St. Paul
American Museum of Asmat Art St. Paul
Goldstein Museum of Design at the University of Minnesota St. Paul
Minnesota Museum of American Art, St. Paul
Green Giant statue, Blue Earth 56013 (off hwy 90)

Nebraska

Great Plains Art Collection at the University of Nebraska, Lincoln
Joslyn Art Museum, Omaha
Museum of Nebraska Art at the University of Nebraska, Kearney
Sheldon Memorial Art Gallery at the University of Nebraska, Lincoln

South Dakota

Mount Rushmore National Memorial, Keystone
Hotel Alex Johnson, Rapid City
Redlin Art Center, Watertown

North Dakota

Montana

Holter Museum of Art, Helena
Glacier National Park "Crown of the Continent"
C.M. Russell Museum, Great Falls
Art Museum of Missoula
University of Montana Museum of Fine Arts, Missoula
Museum of the Rockies, Bozeman
American Computer & Robotics Museum, Bozeman
Tippet Rise Art Center, near Bozeman
Yellowstone Art Museum, Billings
The only known markings by the Lewis and Clark Corp, Billings

Idaho

Boise Art Museum

Westward through the Southwest

Route 66

VIDEO: Route 66 was one of the original highways within the U.S. starting in 1924. Thus its colloqual name the “Mother Road”. It served as a military transport corridor during WWII. In post-war years, motels, diners, and gas stations along Route 66 became popular vacaction destinations.

Route 66 begins on Michigan Avene in Chicago, where you can eat at Lou Mitchell’s diner. The route goes to St. Louis, Missouri, then through smaller road-side towns on the way to Tulsa and Oklahoma City, Amarillo TX, Alberquque New Mexico, then over mountains to Flagstaff AZ before ending on the Santa Monica pier in Los Angeles, California.

However, interstate freeways built from 1956 enabled travel without the need to slow down through towns. That bypassed small businesses along Route 66.

Chisolm Trail

The Chisolm Trail was used between 1867-1884 to drive cows to market from various cowtowns in Texas through Oklahoma Indian Territory to Abilene and other railheads in Kansas. The Lonesome Dove TV series depicts that time.

Since Illinos and Missouri are already listed in our Mississippi route, here we begin from Oklahoma and take a long detour North to avoid too much desert along the way.

Oklahoma

Fred Jones Jr. Museum of Art at the University of Oklahoma, Norman
Gilcrease Museum, Tulsa
National Cowboy Hall of Fame and Western Heritage Museum, Oklahoma City
Philbrook Museum of Art (Philbrook Art Centre), Tulsa

Texas

Amarillo Museum of Art
Cadillac Ranch near Amarillo
Arlington Museum of Art
Art Museum of Southeast Texas, Beaumont
Beeville Art Museum
Chinati Foundation, Marfa
Cushing Memorial Library at Texas A&M University, College Station
El Paso Museum of Art
Grace Museum, Abilene
Longview Museum of Fine Arts
McNay Art Museum, San Antonio
Museum of the Southwest, Midland
Museum of Texas Tech University, Lubbock
Ellen Noel Art Museum, Odessa
San Antonio Art League Museum
San Antonio Museum of Art
South Texas Institute for the Arts, Corpus Christi
Stark Museum of Art, Orange
University of North Texas Art Galleries, Denton

Dallas:

Crow Collection of Asian Art
The McKinney Avenue Contemporary (MAC)
Meadows Museum at Southern Methodist University, Dallas
Amon Carter Museum, Fort Worth
Dallas Museum of Art</strong>
Kimbell Art Museum</strong>, Fort Worth
Art Center Waco
Modern Art Museum of Fort Worth
Sid Richardson Collection of Western Art, Fort Worth
Baylor University Art Galleries, Waco
George Bush Presidential Library and Museum, College Station
George W. Bush Presidential Library and Museum, Dallas

Austin:

Ransom Humanities Research Center at the University of Texas, Austin
Austin Museum of Art
Blanton Museum of Art at the University of Texas, Austin
Mexic-Arte Museum, Austin
Lyndon Baines Johnson Presidential Library and Museum, Austin

Houston:

Baker Planetarium
Rice University Art Gallery, Houston
Blaffer Gallery at the University of Houston
Museum of Fine Arts</strong>, Houston
Contemporary Arts Museum, Houston
Museum of Medical Science
The Contemporary Arts Museum
Menil Collection
The Art Car Museum

New Mexico

Santa Fe:

Taos:

Colorado

Aspen Art Museum
Boulder Museum of Contemporary Art
Leanin' Tree Museum of Western Art, Boulder
The Museum of Outdoor Arts, Englewood
Hoover Dam, Boulder City
Frasca Food & Wine, Boulder

Denver:

Wyoming

Buffalo Bill Historical Center, Cody
Briton Museum, Big Horn
University of Wyoming Art Museum, Laramie
National Museum of Wildlife Art, Jackson Hole

(Southern Idaho)

Utah

Brigham Young University Museum of Art, Provo
Springville Museum of Art
The Museum of (Mormon) Church History and Art, Salt Lake City
Utah Museum of Fine Arts at the University of Utah, Salt Lake City
Braithwaite Arts Gallery at Southern Utah University, Cedar City

Arizona

El Tovar Hotel on the North Rim has a formal dress code!
Grand Canyon Village
Arizona State University Art Museum, Tempe
Center for Creative Photography at the University of Arizona, Tuscon
Desert Caballeros Western Museum, Wickenburg
Fleischer Museum of American and Russian Impressionism, Scottsdale
Heard Museum, Phoenix
Museum of Northern Arizona, Flagstaff
Phippen Art Museum, Prescott
Phoenix Art Museum
Scottsdale Museum of Contemporary Art
Tucson Museum of Art
University of Arizona Museum of Art, Tucson
West Valley Art Museum, Surprise
Musical Instrument Museum, Phoenix

Nevada

Nevada Museum of Art, Reno
Harrah's Auto Collection, Reno

All the sights

In addition to “museums”, also included here are grand natural sights:

historic landmark hotels
Restaurants with unique interiors/art
Breakfasts at B&Bs
Cool Architecture - churches
Gardens and Farms
National Monuments
US Presidential libraries, museums, and birth places
New Media art festivals and notable galleries
Iconic movie locations of note [map]
Caverns
Zoos
Factory tours
Experiences sold by Viator, The ONE Thing You Must Do In Each U.S. State
Amusement parks
State Fairs
Tripadvisor Excellence award winners
Most scenic restaurants according to OpenTable, Zagat, Michelin

Technical Footnote

This rather large list was originally created to be intentionally large in order to test how well the system handles a large file (how quickly it can download and display).

This is an upgrade of my terrible Roadtrips to visit museums across the USA from 2005.

Next, I’d like to display a Google map of coordinates from a public Google spreadsheet like Jessica Lord’s hack-spots site implemented from a github repo which uses the sheetsee.js and Mapbox libraries.

“I haven’t been everywhere, but it’s on my list.” – Susan Sontag

Museums Roadtrip USA was originally published by Wilson Mar at Index on October 26, 2025.

Flood the Internet (control JavaScript API)

2025-10-25T00:00:00+00:00

Prove that tools emulating users (Playwright, JMeter, Selenium, etc.) can recognize the gamut of controls on a challenging web app.

Overview

Challenges on The-Internet app
Video introduction
Recap: Architectural components
- Project folders from GitHub
How To Manual Steps
Automating the-internet using Selenium
Coding Flood Element Typescript
Run Element script from client CLI
Perpare for Flood
Run flood against app in AWS under instrumentation
Config New Relic Dashboard
Other APM
Security scans
Playwright
Python scripting
Resources

Challenges on The-Internet app

The table below presents several icons associated with each page of the sample app’s UI on-line at

https://the-internet.herokuapp.com

“An example application that captures prominent and ugly functionality found on the web. Perfect for writing automated acceptance tests against.”

Ruby code to create “the-internet” was at account saucelabs but forked to:

https://github.com/bononike/the-internet

The website was originally created at https://github.com/tourdedave/the-internet by Dave Haeffner since 2015 part 1 and part 2 of “Selenium Test Automation: Practical Tips & Tricks” presentation recorded in Israel. In his May 2016 “How to use Selenium successfully” slidedeck he said:

Click on to see the sample app’s GUI. The website was created by Dave Hoeffner to present 43 controls which provide challenges to those learning to code Selenium scripts that automate manual actions real users perform on an internet browser (such as Google Chrome). Dave created the site as the basis for his tutorials at ElementalSelenium.com and SeleniumGuidebook.com.

Click on to view Playwright emulation scripts.

Click on to view JMeter XML scripts for the control.

Click on to view a video about manual actions and analysis of the UI page source code as the basis for test script creation.

Additional columns of icons may be added to show sample run results for each test item.

A/B Test Control (also known as split testing)
Add/Remove Elements
Basic Auth (Sign in Username and Password: admin)
Broken Images
Challenging DOM - this is the one impacting server resource
Checkboxes
Context Menu
Digest Authentication (user and pass: admin)
Disappearing Elements
Drag and Drop
Dropdown
Dynamic Content
Dynamic Controls
Dynamic Loading (using explicit wait for resilency)
Entry Ad
Exit Intent
File Download (query HTTP HEADER first to make sure file contains something)
File Upload (issue in Element handling Windows vs Linux, also in Selenium)
Floating Menu
Forgot Password
Form Authentication (Login)
Logout (appears after login, not listed in the app’s menu)
Frames (Nested)
Frames (iFrames)
Geolocation
Horizontal Slider
Hovers
Infinite Scroll
Inputs
JQuery UI - Menus
JavaScript Alerts
JavaScript onload event error
Key Presses
Large & Deep DOM
Multiple Windows
Nested Frames
Notification Messages (Growl listener)
Redirect Link
Secure File Download
Shifting Content
Slow Resources (blacklist slow resource with proxy server)
(Sortable) Data Tables
Status Codes
Typos
WYSIWYG Editor

NOTE: Some scripts are under development.

Video introduction

Below is the narration (transcript) of the video above.

Selenium makes use of older “Web Driver” APIs that control browsers from code written in a variety of programming languages.

But the new Google “Lighthouse” API exposes a comprehensive set of metrics that include performance timings for every manual action. They’ve been added to the “Audits” section of Chrome Developer Tools UI we’ve been using to figure out the classes and identifiers we code into Selenium scripts.

But since these “Lighthouse” diagnostics require manual effort each time, it can be tedious to keep repeating manual actions during each regression test. So we create scripts to automate manual actions in the Python (or JavaScript) programming language run by the PlayWright program. The program is installed locally using instructions in the README.md file.

There is currently no Docker image containing PlayWright. So it needs to be installed.

Typescript is a superset of the JavaScript programming language that control browsers. Typescript is used because its transpiler checks for errors sooner than JavaScript.

After scripts are git pushed to a remote GitHub repository, others can git clone onto their machine to run.

Both PlayWright and Selenium control a single user GUI at a time. But we also want to see what happens when many users on many browser instances run at the same time exercising the website. We want to see how much each JavaScript control can impact both the client and server environment’s memory, CPU, and other resources. «<

App Build

But we don’t want our experiments to overload Dave’s public site for everyone else.

So we run the app as a Docker container within the AWS or other cloud. The container and environment under test is built by invoking a build script that retrieves files from GitHub which makes use of a Docker image housed in Docker Hub and uses it to instantiate an app server for testing. It uses credentials for an AWS account associated with the appropriate groups with applicable permissions and roles needed.

Emulate using PlayWright

We use the PlayWright? service in the cloud (or on-premises) to emulate those many users by running automation scripts pulled from a GitHub repository.

PlayWright scripts are a new innovation because it emulates manual actions within each user’s browser.

Historically, Java code used by JMeter or Scala code used by Gatling emulate load by simply emulating just the exchange of what is sent between client browser and server. But a lot of work now occur inside the client browser.

Multi-user Flood runs are controlled by run parameters such as the number of virtual users being emulated. Run shell scripts can be used to manage various runs, test data, and results over various variations in run conditions.

Instrumentation

It’s important to have a metrics dashboard that helps people make sense of measurements collected over time. This article talks about use of New Relic.

We have an instrumentation script which installs an agent (newrelic-infra) to run alongside the app. Because the sample app under test was written in the Ruby language, the agent is installed as a rpm file (newrelic.rpm) specified in the Gemfile referenced during installation.

During runs, the agent sends notifications about events to a process installed using a Docker image in Docker Hub from New Relic. The monitoring process transfers events collected by agents to a metrics dashboard at newrelic.com.

To validate communications, a license key obtained manually from the New Relic website is installed when the agent is installed.

The license key, plus IP address and port number of the metrics collector are provided to Flood so that it can add its metrics to New Relic over time. These metrics include the number of users, transaction response times, the rate of transactions per second processed, network bandwidth throughput, and transaction pass/fail error rates.

When we also add the cost of each run, we would be able to identify which configurations would provide the most profitable number of transactions per dollar.

Recap: Architectural components

While learning on a local machine such as a Mac, Linux laptop, or Windows PC:

Chrome Developer Tools is used to extract identifiers, classess, and selectors in HTML and CSS to programmatically reach each GUI control used in each TypeScript.
The setup.sh CLI shell script is installed to run scripts to emulate a single user’s manual actions on a Google’s Chrome browser.

The system under (load) test (SUT) instantiated using Docker:

The “the-internet” web app from a Docker image
The monitoring process, which can be in another container or as another pod within the same container as the web app.

Additionally, the GUI of two cloud services:

https://flood.io which runs TypeScript to emulate the browsers for multiple users, which imposes an artificial load.
A New Relic dashboard which provides visualization (line graphs) of metrics collected during runs over time and under various configurations.

Project folders from GitHub

These steps are done manually on your local machine.

Create or navigate to a project folder for this effort.

Clone automation scripts:

git clone https://github.com/flood-io/element/tree/master/examples/internet-herokuapp

Review script coding.

How To Manual Steps

Here are the manual steps to make use of instructions in this tutorial:

NOTE: This assumes that you know how to open and use a Terminal program on a Mac or a Git Bash on Windows.

Clone the PlayWright script.
Get an AWS service account linked to AWS Roles assigned to Groups with Permissions. See https://wilsonmar.github.io/aws-onboarding, which describes editing files which store credentails (UserName and Password) in environment files which are invoked during runs to populate environment variables referenced by automation scripts.
Install within AWS “the-internet” app under test from DockerHub Flood Script Update-aws-ec2

NOTE: Automation for installation within the Azure cloud is on our Roadmap.
Obtain logins to accounts for New Relic APM, New Relic Browser, and New Relic Infrastructure.
Install NewRelic’s monitoring process

NewRelicAgentInstall-aws-ec2.sh
Define initial run parameters to control runs of flood.io in the cloud (Flood.io account, etc.) in flood-run-e2e.sh.
Run “flood-run-e2e” to launch runs in flood.io at scheduled times to take advantage of AWS Spot Rates.

PROTIP: Automation (shell or Python) scripts to bring up servers and conduct runs are designed to minimize spend (not waste money on idle resources). Services are deleted after each run.
Configure New Relic dashboard
Review warning and error messages. Analyze statistics collected by the Chrome Browser’s Lighthouse and sent to NewRelic’s dashboard in the cloud.
Identify the fastest realistic ramp-up time (without causing errors) by re-running with different rates which running users are added.
Experiment with changes to JavaScript, HTML, and CSS in client application code in attempts to reduce timings and resource usage on browsers.
Modify TypeScript accordingly to identify the impact of changes made to the application before reruns.

NOTE: Concern about metrics is more about what is happening in client browsers than in the application server. The application under test here (“the-internet”) does not make use of separate authentication servers, a database, nor other back-end services.
Run separate isolated scenarios to isolate transactions to study:
1. ~~Registration (to establish new users)~~
2. Login (to load authentication)
3. Menus and static pages (when users are exploring)
4. User data entry filling out forms (editing ~~and saving form data into a database~~)
5. ~~Client-side performance during batch reporting, backup, restore, or other back-end processing~~
Identify the mix of transactions in a standardized run of different transactions at a time.

PROTIP: This exercise stands up only one instance each and not multiple instances in a cluster for High Availability (HA).
~~Identify optimal scale-up and scale-down (instance type) configurations~~
~~Identify optimal scale-out and scale-in configurations~~

Automating the-internet using Selenium

T.J. Myer wrote in his website June - July 2015 a series describing his adventures coding Selenium on Dave’s website:

References:

http://bit.ly/se-exceptions-java list of exceptions in Selenium (2015)
http://bit.ly/se-exceptions-howto exception handling in Selenium (2015)

Many of the issues addressed above also need to be addressed by any app automation tool.

Coding Flood Element Typescript

Typescript is a superset of the JavaScript programming language that control browsers. Flood Element makes use of the Typescript language, which transpiles to JavaScript. Typescript is used because its transpiler checks for errors sooner than with JavaScript.

QUESTION: Typescript

Typescript variables are statically typed (not dynamic as in JavaSript)
Typescript can be coded using object-oriented constructs

Rather than directly referencing application control IDs, so that when an app changes, just one change is needed to make all tests pass again. This is like Selenium page object helpers from http://bit.ly/po-html-elements Yandex and http://bit.ly/po-page-factory built into Selenium. Similarly, Base Page Object library to migrate commands from one version to another.

Run Element script from client CLI

An example summary report:

This flood simulated up to 1 users across 1 grid in us-east-1 for 7 minutes. The mean response time was 916ms with a standard deviation of 1,285 ms. The median was 169 ms and the 90th percentile was 3,010 ms. The maximum was 3,014 ms. A maximum of 12 rpm with a mean of 4 rpm was observed. 101 transactions passed with 0 failed.

Setup AWS manually

Based on https://wilsonmar.github.io/aws-onboarding

On an internet browser such as Google Chrome, Apple Safari, or Microsoft Edge:

To limit financial exposure (to like $25 or whatever), buy a pre-paid reloadable Visa gift (debit) card pre-paid online (which has an expiration date and some have a monthly service fee). The Drawpay card provides a 1% refund on purchases. Others provide fee-Free cash withdrawal at over 25,000 MoneyPass ATMs
Open AWS master account with email.
In IAM, lock down master account.
Create Security Group.
In IAM, create service account.
Define service account with permissions.
Store key pair (credentials) for service account locally.
Select your AWS region.

Script A : Instantiate AWS Docker in EC2 build script
Get to AWS EC2.
Choose and AMI - Ubuntu 16.04 LTS
Select EC2 instance type (t2.micro Free Tier eligible can handle up to 50 users), or “m5axlarge”.
[10:23] Define Security Group add “All TCP Traffic”.
Assign Key Pair name ___
[2:29] Download Key Pair
Save to file ???
[2:37] Launch Instance
PROTIP: Name instance “the-internet-app” so that files referring to this name (such as newrelicc-infra.yml) don’t have to be changed.

Terminal - AWS Key Pair
In Terminal store .pem file downloadd
SSH into instance.

Terminal - AWS Key Pair

Inside “the-internet” terminal:

[4:08] Within app server to hold “the-internet”, install prerequisites (GPG certs, Docker):

sudo apt update
sudo apt install apt-transport-https ca-certificates curl software-properties-common
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -
sudo add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable"
sudo apt update
apt-cache policy docker-ce
sudo apt install docker-ce
# verify:
sudo systemctl status docker
sudo docker --version
DOCKER_IMAGE="gprestes/the-internet"
sudo docker pull "$DOCKER_IMAGE"
sudo docker run -d -p 7080:5000 "$DOCKER_IMAGE"
CONTAINER_ID=$( docker ps | grep "$DOCKER_IMAGE" | cut -d " " -f 1 )
WANIP4=$( curl http://canhazip.com" )  # public IP4 address.

[12:04] On a browser, verify external access to “the-internet” app using the external IP address from AWS, such as:

http://52.91.73.157:7080/

Setup “NewRelic” in a EC2 Ubuntu containing Docker

In a browser:
Login to AWS using your service account.
Get to AWS EC2.
Choose and AMI - Ubuntu 16.04 LTS
Select EC2 instance type (t2.micro Free Tier eligible can handle up to 50 users), or “m5axlarge”.
[10:23] Define Security Group add “All TCP Traffic”.
Assign Key Pair name ___
[2:29] Download Key Pair
Save to file ??? [15:07] ssh -i “ubuntu.pem” [email protected]
[2:37] Launch Instance
Name instance “NewRelic”

Save NewRelic License Key

Based on *
[8:13] On the NewRelic web page Account Settings, highlight and save the License Key text
Open file ./secrets.env

NOTE: The secrets.env file is referenced in the docker-compose.yml file cloned from GitHub.
```
docker-compose build
docker-compose up
```
[15:29] Update newrelicc-infra.yml with license_key value.

Install NewRelic instrumentation agent
[8:13] Switch back to the terminal

TODO: Script to do this:

# TODO: Replace with reference to secrets.env by docker-compose
echo "license_key: a46bf7d3b4043cdfffcab3aaef677d29cc60d6be" | sudo tee -a /etc/newrelic-infra.yml
curl https://download.newrelic.com/infrastructure_agent/gpg/newrelic-infra.gpg | sudo apt-key add -
 
cat /etc/lsb-release 
# [13:33] Based on NewRelic web page  
# https://docs.newrelic.com/docs/infrastructure/new-relic-infrastructure/installation/
printf "deb [arch=amd64] https://download.newrelic.com/infrastructure_agent/linux/apt bionic main" \
| sudo tee -a /etc/apt/sources.list.d/newrelic-infra.list
sudo apt-get update
sudo apt-get install newrelic-infra -y
# Verify: more /etc/newrelic-infra.yml
 
# TODO: automate this:
vi  /etc/newrelic-infra.yml
sudo vi /etc/newrelic-infra.yml
 
# TODO: Identify the Docker ID to a variable: 
$CONTAINER_ID=$(sudo docker ps)
# (value such as ba965ff40ef7)
sudo docker exec -i -t "$CONTAINER_ID" /bin/bash
 
# TODO: From inside NewRelic process:
sudo docker cp ba965ff40ef7:/app/server.rb .
 
# [19:31] Reboot:
sudo systemctl restart newrelic-infra

[19:57] Verify that NewRelic recognizes events from “the-internet-app” (subsituting the account number), such as:

https://infrastructure.newrelic.com/accounts/2256749/hosts

Install NewRelic agent in running “the-internet-app”

[20:38] Get inside Docker container:

# TODO: Identify the Docker ID to a variable: 
$CONTAINER_ID=$(sudo docker ps)
# (value such as ba965ff40ef7)
sudo docker exec -i -t "$CONTAINER_ID" /bin/bash

Based on https://docs.newrelic.com/docs/agents/ruby-agent/installation/install-new-relic-ruby-agent

[23:17] Add gem 'newrelic_rpm' in Gemfile.

# TODO: From inside NewRelic process (example root@ba965ff40ef7):
sudo docker cp "$CONTAINER_ID:/app/server.rb" .
sudo docker cp server.rb "$CONTAINER_ID:/app/"
# Backup existing
cp Gemfile Gemfile.backup
# TODO: Automate 
??? gem 'newrelic_rpm
# For the server.rb which is larger it’s not possible to echo and cat the file,
# so I copied it locally and edit it to include the require 'newrelic_rpm'
sudo docker cp ba965ff40ef7:/app/server.rb .
# And copy it back to the container:
sudo docker cp server.rb ba965ff40ef7:/app/

Verify

Script B : Add in server.rb and create new Docker image

This is so the Docker image can be used for scaling.

sudo docker run -d -p 7080:5000 ruby-bundle-update
 
# TODO: Identify the Docker ID to a variable: 
$CONTAINER_ID=$(sudo docker ps)
# (value such as 363ddc8f7439)
sudo docker exec -i -t "$CONTAINER_ID" /bin/bash
# Save updated files:
sudo docker cp server.rb "$CONTAINER_ID:/app/"
sudo docker cp Gemfile "$CONTAINER_ID:/app/"
# Get inside:
sudo docker exec -i -t  "$CONTAINER_ID" /bin/bash
sudo docker ps
sudo docker commit "$CONTAINER_ID" ruby-bundle-update
sudo docker stop "$CONTAINER_ID"
 
sudo docker ps
sudo docker run -d -p 7080:5000 ruby-bundle-update
sudo docker ps
 
# TODO: copy file newrelic.yml from external
touch 1
vi q
vi 1
mv 1 newrelic.yml
vi newrelic.yml 
ls -lart  # to verify manually
 
# TODO: Identify the Docker ID to a variable: 
$CONTAINER_ID=$(sudo docker ps)
# (value such as 178e6dc45ab7)
 
sudo docker cp newrelic.yml "$CONTAINER_ID:/app/"
sudo docker commit "$CONTAINER_ID" final-version
sudo docker stop "$CONTAINER_ID"
# Verify:
sudo docker images
# Restart:
sudo docker run -d -p 7080:5000 final-version
 
sudo docker ps
history > /tmp/history.file

Update Element .ts script for flood.io

Update the IP address in the script (several locations):
```
await browser.visit('http://18.208.170.2:7080/')
```
Instrument script for NewRelic
Get license from newrelic.com
Insert license into script

NOTE: https://github.com/ThyWoof/geek-movie-shop

Script C : Save instrumented Docker image to DockerHub for reuse
Docker save

Perpare for Flood

If you don’t have a flood.io account, get one (manually).
Confirm your account via email.
Log into Flood.io.
Get license token.

Run flood against app in AWS under instrumentation

This step runs a shell script file at
https://github.com/wilsonmar/DevSecOps/master/flood-io/flood-run-e2e.sh

It is customized from an example in Flood docs.

If you don’t have a GitHub account, get one.
Use an internet browser to view:

https://github.com/wilsonmar/DevSecOps/
Click “Fork” button to copy the repository under your own account.
Open a Terminal.
Navigate to the containing folder where GitHub creates folders. Make a folders as necessary.

Clone the whole DevSecOps repo:

git clone https://github.com/wilsonmar/DevSecOps/

Navigate into the folder:
```
cd DevSecOps
cd flood-io
```
Edit the environment file using your favorite editor, such as:
```
nano flood-env.sh
```
Insert the license token from flood.io.
Save the file
Run the environment file to load variables into memory.
Edit the script using your favorite editor, such as:
```
nano flood-run-e2e.sh
```
Define other parameters: run conditions.
Validate run pre-conditions.
Initiate run.
Stop run.
Collect run results.
Analyze run results / Generate visualizations.
Display summary statistics.
Git add, commit, and push the changed script to GitHub.

Config New Relic Dashboard

Questions about several other dimensions, such as:

What is the impact on the cloud bill (costs) of that cool JavaScript UI code?
What is the capacity of a chosen instance type (such as the free tier t2.micro)?
How much more is needed to run the anticipated peak load?
What happens when that peak load is exceeded?

https://docs.newrelic.com/docs/insights/use-insights-ui/manage-dashboards https://learn.newrelic.com/get-started-with-apm https://learn.newrelic.com/dashboards-and-data-apps https://docs.newrelic.com/docs/plugins/plugins-new-relic/custom-dashboards-custom-views https://blog.newrelic.com/product-news/steal-this-dashboard/

Other APM

A full list of APM tools:

New Relic
Dynatrace OneAgent
Dynatrace AppMon
AppDynamics
NudgeAPM

Security scans

In today’s ransomware environment, we all need to be extra vigilant to ensure security.

Install https://inspec.io (created by Chef)
Install https://github.com/docker/doccker-bench-security
Install CIS (Center for Internet Security) benchmarks for specific distributions and versions of Linux. For example:
- Distribution independent Linux
- Debian Linux 8
- Ubuntu Linux 16.04 LTS
- Amazon Linux 2
- Centos Linux 7
- Oracle Linux 7
- Red Hat Enterprise Linux 7
- SUSE Linux Enterprise 12

The Linux Audit Framework is used to identify potential security weaknesses or policy violations

Install
```
sudo apt install auditd
pidof auditd
```

Add rules and list them

sudo auditctl -w /usr/bin/dockerd -k docker
sudo auditctl -l

Turn auditing on.
Analyze report
```
sudo aureport
```

Securing the Docker Platform by Nigel Brown Released 21 Jun 2018

Playwright

Under development are our emulation (test) scripts that call the Playwright API that controls Chromium, Firefox, and WebKit internet browsers on macOS, Linux, and Windows machines.

Playwright’s marketing home page is at:

https://playwright.dev

Playwright was open-sourced by Microsoft on April 16, 2016, with first tag on
Jan 31, 2020 at https://github.com/microsoft/playwright.

The library maintained by several active contributors:

Subscribe to the product’s social media, led by Debbie O’Brien, Sr. Tech PM @Microsoft
Create an environment for Node to run.
View Debbie’s YouTube series to get started.
1. VIDEO: Install Playwright within VSCode (instead of CLI git clone)
2. Add GitHub Actions in file playwrite.yml created within repo folder .github/workflows
Each language that calls the API has its own documentation:
Python scripting

The PlayWright documention talks about a test-sample.py script.

PROTIP: You can save hours of headache by using the repo I created after getting the uv package to work.
Open a Bash scripting CLI such as Terminal or, better yet, Warp CLI from https://warp.dev.

Create a folder where Git will create a folder using these commands:

git clone https://github.com/bomonike/playwright-scripts; cd playwright-scripts

Create a folder where Git will create a folder using these commands:

cd test-example
python -m venv .venv
source .venv/bin/activate
uv pip install pytest pytest-playwright playwright -U
playwright install  #  browser binaries: Chromium, Firefox, WebKit, FFMPEG
# NOTE: cached in /Users/johndoe/Library/Caches/ms-playwright/ to run Playwright tests.

pytest test_example.py --browser chromium --headed --debug

Run a sample test in the language of your choice from above. For Python:
```
pytest test_example.py --browser chromium --headed --debug
```
Generate emulation (test) scripts by recording actions as a human user.

Accelerate test creation and insights with AI-powered tooling.
Setup Microsoft’s Playwright Testing Service in the Azure cloud (Part of “Azure App Testing”) at:

https://azure.microsoft.com/en-us/products/playwright-testing (formerly at
https://playwright.microsoft.com)

Within https://portal.azure.com/#home : Azure Web Tesing at https://portal.azure.com/#view/HubsExtension/AssetMenuBlade/~/overview/assetName/AzureAppTesting/extensionName/Microsoft_Azure_CloudNativeTesting which consists of two services:
- Playwright Workspaces for functional QA testing
- Azure Load Testing for performance testing
Read the documentation at https://learn.microsoft.com/en-us/azure/app-testing/

Under your subscription, create a globally unique workspace of up to 64 alphanumeric characters (no dashes, etc.).
pricing

The same price is charged across the limited number of regions where the service is available during preview (East US, West US 3, East Asia, West Europe).

See the Pricing page at https://azure.microsoft.com/en-us/pricing/purchase-options/azure-account?icid=playwright-testing

The choice is embedded in the URL used to call the service, CLI variable used within test script code:

export PLAYWRIGHT_SERVICE_URL=wss://eastus.api.playwright.microsoft.com/api/authorize/connectSession echo PLAYWRIGHT_SERVICE_URL=”$PLAYWRIGHT_SERVICE_URL”

Generate the API Access token PLAYWRIGHT_SERVICE_ACCESS_TOKEN= and store it securely in an encrypted vault until needed.

The service provides browser and OS combinations (up to 50 in parallel, at scale). To run 50 Playwright tests:
```
npx playwright test --workers=50 --config=playwright.service.config.ts
```
For example: this playwright.service.config.ts file.

If each of 50 takes 12 seconds on average, you’ll be billed for 10 “test minutes”, calculated as 50 tests x 12 seconds ÷ 60 seconds in a minute. Each “Test minute” is when a Playwright test runs in the service’s cloud browsers.

After 100 test minutes during a free 30-day trial, pricing is $0.01/test minute on Linux and $0.01/test minute on Windows, billed by the second.

QUESTION: Would running apps hosted within Azure remove variability in time going through the public internet?
build AI agents to generate Playwright tests
QUESTION: Use Playwright scripts to perform load testing?

We need to control https://portal.azure.com, particularly to create an AI Cognitive group in order to check the “Microsoft Responsible AI Agreement”. That is needed before automation such as Terraform and Bicep are allowed to create AI-related resources.

In response to https://www.reddit.com/r/QualityAssurance/comments/1cq4ja8/learning_playwright/

A tutorial by Artem is provided at https://www.bondaracademy.com/course/sdet-with-playwright (and on his Udemy class) for $139 for a quiz, or $499 for test case coding and code reviews using JavaScript (not Python).

VIDEO course by Mukesh Otwani.

Resources

PlayWright.

Flood the Internet (control JavaScript API) was originally published by Wilson Mar at Index on October 25, 2025.

Index

Food (Diet)

Do you control your food intake?

Food apps

Purines, Uric Acid, and Gout

Minerals

Calcium & PTH Testing

Sodium

Potassium

Low potassium fruits (fresh or dried):

Low-potassium vegetables:

Canning, Leaching out potassium

Cooking

Cooking eggs

Dairy

Sugar & Carbs: Glucose

Uric Acid

Dash Diet

Maple Syrup

Grow your own

Can = glass jars

Chocolates

Big on-line stores

Specialty on-line stores

Waters

Glass bottles:

Plastic bottles:

Not recommended acidic:

Meats

Veggies

Bread from live yeast

Quinoa

Butter

Caffeine

Resources

Articles

Rodent-resistant containers

MLflow

Why MLflow? Run Metadata and Metrics

Competition to MLflow

MLflow Components

Backend SQL Store

Enterprise MLflow on Databricks UnityDB

MLflow Artifact store

Tracking UI Server

End-to-end capabilities Flowchart

Two sided product

Docker Compose

Manual Install locally

Vulnerability Scans

Download and Start Server

Start MLflow

IDE

Custom MLflow Extensions

GitHub repos

MLproject file

MLflow’s Sample Python code

Sample_ML_model.py

Azure Sample GenAI Python code

Python Libraries

Scoring Guidelines in Python

MLflow activation in Python

MLFlow workflows

Aliases

Metrics for each experiment:

Metrics Classification Report

Compare metrics from selected experiments

Dagshub

References:

AI Benchmarks

AI Vendors and their LLM Brands

LLM Highlights:

List of benchmarks

Show your work. Get famous.

LLMs by subject category

Humanity’s Last Exam

AGI & ASI?

AGIEval

Sneaky Tricks with Benchmarks

Claude 3.7 Sonnet