Programming a Neural Network

In this article, we will build a neural network from scratch and use it to classify handwritten digits.

Why reinvent the wheel/neural network, I hear you say? Can’t I just use my favourite machine learning framework and be done with it? Yes, there are many off-the-shelf frameworks that you can use to build a neural network (Keras, PyTorch, and TensorFlow to name a few). The thing with using one of these is that they make it easy for us to treat neural networks like black boxes.

This isn’t always a bad thing. Often we need this level of abstraction so that we can get to work on the problem at hand, but we should still strive to at least have a basic understanding of what is going on under the hood if we are to use neural networks in our work.

Building a neural network from scratch is, in my opinion, the best way to foster a deep understanding of how they work.

By the end of this article, you will have learned about the feedforward and backpropagation algorithms, what an activation function is, what the difference between an epoch and a batch is, and how to train a neural network. We will finish with an example by training a neural network to recognise handwritten digits.

All code used in this article is available here on GitHub 

What is a neural network?
Neural networks, or artificial neural networks, are a type of machine learning algorithm. They form the core of many deep learning and artificial intelligence systems like computer vision, forecasting and speech recognition.

The structure of artificial neural networks is sometimes compared to the structure of biological neural networks in the brain. I would always urge caution not to draw too much from this comparison. Sure, artificial neural networks look a bit like biological neural networks but it is quite a big leap to start comparing them to something as complex as a human brain.

A neural network is made up of several layers of neurons. Each layer of neurons is activated based on the activations in the previous layer, a set of weights connecting the previous…  READ MORE...

How it Begins

 

Political Party Differences

KEY POLICIES

Democrats
The party favors a mixed economy and generally supports a progressive tax system, higher minimum wages, Social Security, universal health care, public education, and subsidized housing.

Republicans
The party's fiscal conservatism includes support for lower taxes, small government conservatism, free market capitalism, free trade, deregulation of corporations, and restrictions on labor unions.

As you can see, the Democrats favor the working man whereas the Republicans favor corporations.

The Democrats favor a large government and higher taxes whereas the Republicans favor a small government and lower taxes.  The Democrats favor socialism whereas the Republicans favor capitalism.

It would appear that the two parties are polar opposites...  so, how do they agree on anything?  Perhaps, this is why nothing ever gets accomplished except the fact that politicians are getting wealthy.

• Right now, the Democrats have created the following scenarios:
• Open Borders for illegal immigrants
• Higher prices especially in the areas of food and gasoline
• Higher taxes more corporate regulations
• an increase in social programs
• A huge national debt that someone will eventually have to pay off
• A decrease in our military's capabilities
• A war on fossil fuels and the death or gasoline
• An increase in racism due to BLM, WOKE, and CRT
• An increase in crime and violence

Do you see any correlations between what the Democratic President Joe Biden has created and the policies of the Democratic Party?

The UAW Union is striking for higher wages and if they get higher wages, then the American people will be faced with higher prices.

This dilemma is a DOUBLE-EDGED SWORD...  it will benefit the workers but at the same time it will hurt them because everything will cost more.  Most of their wage increases will be eaten up by higher prices...  and their increased wages will put them into a higher tax bracket.

You must decide two things:

First, do you support the agenda of the Democrats?

Second, are you better off since we have had a Democratic President?

Riding a Bicycle

 

Boosting Quantum Devices

MIT physicists, inspired by noise-canceling headphones, have advanced the coherence time of quantum bits by 20-fold, marking significant progress for quantum computing. The team used an “unbalanced echo” technique to counteract system noise, and they believe further improvements are possible. This breakthrough has vast potential, from quantum sensors in biology to advancements in quantum memory.



MIT researchers develop a protocol to extend the life of quantum coherence.

For years, researchers have tried various ways to coax quantum bits — or qubits, the basic building blocks of quantum computers — to remain in their quantum state for ever-longer times, a key step in creating devices like quantum sensors, gyroscopes, and memories.

A team of physicists from MIT have taken an important step forward in that quest, and to do it, they borrowed a concept from an unlikely source — noise-canceling headphones.


Led by Ju Li, the Battelle Energy Alliance Professor in Nuclear Engineering and professor of materials science and engineering, and Paola Cappellaro, the Ford Professor of Engineering in the Department of Nuclear Science and Engineering and Research Laboratory of Electronics, and a professor of physics, the team described a method to achieve a 20-fold increase in the coherence times for nuclear-spin qubits. 

The work is described in a paper published in Physical Review Letters. The first author of the study is Guoqing Wang PhD ’23, a recent doctoral student in Cappellaro’s lab who is now a postdoc at MIT.


“This is one of the main problems in quantum information,” Li says. “Nuclear spin (ensembles) are very attractive platforms for quantum sensors, gyroscopes, and quantum memory, (but) they have coherence times on the order of 150 microseconds in the presence of electronic spins … and then the information just disappears. 

What we have shown is that, if we can understand the interactions, or the noise, in these systems, we can actually do much better.”  READ MORE...

Aliens!

 

Dark Energy

 

New Way to Measure Dark Energy

Researchers have discovered a method to potentially detect and measure dark energy by examining the motion between the Milky Way and Andromeda galaxies. This technique, still in its early stages, can estimate the upper value of the cosmological constant, a simple model of dark energy, which is five times higher than values determined from the early universe.




Researchers from the University of Cambridge have discovered a new way to measure dark energy – the mysterious force that makes up more than two-thirds of the universe and is responsible for its accelerating expansion – in our own cosmic backyard.

The researchers found that it may be possible to detect and measure dark energy by studying Andromeda, our galactic next-door neighbor that is on a slow-motion collision course with the Milky Way.


Since it was first identified in the late 1990s, scientists have used very distant galaxies to study dark energy but have yet to directly detect it. 

However, the Cambridge researchers found that by studying how Andromeda and the Milky Way are moving toward each other given their collective mass, they could place an upper limit on the value of the cosmological constant, which is the simplest model of dark energy. 

The upper limit they found is five times higher than the value of the cosmological constant that can be detected from the early universe.

Although the technique is still early in its development, the researchers say that it could be possible to detect dark energy by studying our own cosmic neighborhood. The results are reported in The Astrophysical Journal Letters.

Everything we can see in our world and in the skies – from tiny insects to massive galaxies – makes up just five percent of the observable universe. 

The rest is dark: scientists believe that about 27% of the universe is made of dark matter, which holds objects together, while 68% is dark energy, which pushes objects apart.  READ MORE...

Cat and Pony

 

Stamping Out Greed

 Eliminating GREED sounds like an honorable and worthy crusade to many Americans and to many foreigners who have experienced the GREED of Americans...

However, it is a losing battle.

We must look at GREED from several different angles in order to have enough information to make an intelligent decision.

• First, we have corporate greed
• Second, we have individual greed
• Third, we have political greed
• Fourth, we have economic greed     

Economic greed is absolutely necessary in order to have a growing economy.  Without economic greed our economy would remain stagnant, and while that would keep prices low, it would not offer much of a future.

Political Greed is not necessary and happens when politicians are more concerned about their financial wealth than they are about passing laws for Americans and their future.  It revolves around re-election, buying stock with insider information, and accepting unreported gifts from Lobbyists and donors.

Individual Greed takes place when individuals use their earning potential to invest in other ventures that generate additional wealth.  Individual wealth is good because these individuals are the one that primarily keep non-profits alive with their donations.  However, the downside is that these people NEVE pay their fair share of taxes since most of their wealth is sheltered in offshore bank accounts.

Corporate Greed is what many people consider to be the most insidious because Corporations have decided that they want to make this huge profit while giving bonuses to management and offering minimal wage increases to labor.  Corporate Greed has caused UNIONS to form to protect employees.  

A case could be made that Corporate Greed while somewhat appropriate should not be as high as they want it to be.  There are pros and cons on both sides of that argument.

Large profits create several opportunities:

1.  Companies can invest in Research and Development.

2.  Companies can invest in opening new markets.

3. Companies can pay dividends to stockholders that finance their operations.

NOTE:  Without these three opportunities, there would be no need for a company to grow and no need for a company to expand and hire more employees.

So, the questions are:  

• How much of a profit do you think is reasonable for companies to make?
• Should companies stop giving management bonuses?
• Should individuals not be allowed to shelter their money from taxes in offshore back accounts?
• How much of a wage increase can a company offer before it has to start increasing prices?

Pool Shark

 

Neutrinos and Dark Matter

PNNL chemist Isaac Arnquist examines ultra-low radiation copper cables specially created for sensitive physics detection experiments. Credit: Andrea Starr, Pacific Northwest National Laboratory



Ultra-low radiation cables reduce background noise for neutrino and dark matter detectors.

Imagine trying to tune a radio to a single station but instead encountering static noise and interfering signals from your own equipment. That is the challenge facing research teams searching for evidence of extremely rare events that could help understand the origin and nature of matter in the universe. 

It turns out that when you are trying to tune into some of the universe’s weakest signals, it helps to make your instruments very quiet.

Around the world, more than a dozen teams are listening for the pops and electronic sizzle that might mean they have finally tuned into the right channel. These scientists and engineers have gone to extraordinary lengths to shield their experiments from false signals created by cosmic radiation. 

Most such experiments are found in very inaccessible places—such as a mile underground in a nickel mine in Sudbury, Ontario, Canada, or in an abandoned gold mine in Lead, South Dakota—to shield them from naturally radioactive elements on Earth. 

However, one such source of fake signals comes from natural radioactivity in the very electronics that are designed to record potential signals.

Ultra-low radiation cables reduce background noise for neutrino and dark matter detectors.

Imagine trying to tune a radio to a single station but instead encountering static noise and interfering signals from your own equipment. That is the challenge facing research teams searching for evidence of extremely rare events that could help understand the origin and nature of matter in the universe. 

It turns out that when you are trying to tune into some of the universe’s weakest signals, it helps to make your instruments very quiet.

Around the world, more than a dozen teams are listening for the pops and electronic sizzle that might mean they have finally tuned into the right channel. These scientists and engineers have gone to extraordinary lengths to shield their experiments from false signals created by cosmic radiation. 

Most such experiments are found in very inaccessible places—such as a mile underground in a nickel mine in Sudbury, Ontario, Canada, or in an abandoned gold mine in Lead, South Dakota—to shield them from naturally radioactive elements on Earth. 

However, one such source of fake signals comes from natural radioactivity in the very electronics that are designed to record potential signals.  READ MORE...

Dark Matter

 

Peace Through Strength

 This is not my message, but it was the message of former President Ronald Reagan...  actor turned politician.  

At the time, I was a Democrat and thought it was ludicrous to have a Hollywood actor become President of the United States.  However, he had been governor of California and that did not bother me too much...  but President...  that was going a little too far for me.

Over the years, I left the Democratic Party and became a conservative, not at Republican, because of the business angle that the conservatives represented.

• Small Government
• Less Taxes
• Less Government Regulations
• Strong Military

I still believe in those values, but they come with several drawbacks.

• Less Social Programs
• Corporate Power and Wealth
• Marginal Wealth For Most Americans
• Less Consumer Protection

However, after the debacle during the Korean and Vietnam Wars and our pullout from Afghanistan, I am convinced beyond a shadow of a doubt that our military strength is VITAL to global peace.

China has declared without any hesitation that they want to dominate the world both economically and militarily...  that is a non-acceptable possibility for a variety of reasons:

1. China is a communist country
2. Russia is a communist country
3. North Korea is a communist country
4. Iran favors communism over democracy
5. Our global economy would suffer
6. There would be an elimination of FREEDOM

While there are drawbacks with USA Democracy and all its freedoms and capitalism based upon a free-market enterprise system of commerce, our system provides its citizens with a vast array of opportunities not available in communist countries.

I do not like wars.

I do not like senseless killing.

I do not like the bombing of countries.

I do not like damage done to innocent people.

BUT COMMUNIST COUNTRIES ONLY UNDERSTAND AND RESPECT AND FEAR POWER...  and, it is that fear that will keep the world safe.

Buffalo Springfield

 

ChatGPT Art Generator

OPENAI HAS ANNOUNCED Dall-E 3, its latest AI art tool. It uses OpenAI’s smash-hit chatbot, ChatGPT, to help create more complex and carefully composed works of art by automatically expanding on a prompt in a way that gives the generator more detailed and coherent instruction.

What’s new with Dall-E 3 is how it removes some of the complexity required with refining the text that is fed to the program—what’s known as “prompt engineering”—and how it allows users to make refinements through ChatGPT’s conversational interface. 

The new tool could help lower the bar for generating sophisticated AI artwork, and it could help OpenAI stay ahead of the competition thanks to the superior abilities of its chatbot.

Take this image of the potato king, for example.

This kind of quirky AI-generated art has become commonplace on social media thanks to a number of tools that turn a text prompt into a visual composition. 

But this one was created with a significant amount of artistic assistance from ChatGPT, which took a short prompt and turned it into a more detailed one, including instructions about how to compose it correctly.

That’s a big step forward not just for Dall-E, but for generative AI art as a whole. Dall-E, a portmanteau of the Pixar character Wall-E and the artist Salvador Dalí that was announced in 2021 and launched in 2022, consists of an algorithm that’s fed huge quantities of labeled images scraped from the web and other sources. 

It uses what’s known as a diffusion model to predict how to render an image for a given prompt. With sufficiently huge quantities of data this can produce complex, coherent, and aesthetically pleasing imagery. What’s different with Dall-E 3 is in the way humans and machines interact.  READ MORE...

Somewhat Political

 

There's Only Two Genders

Regardless of what you think or what you may want to believe or think you want to believe, there are only two genders:  Females and Males...

You can have your testicles and penis removed and you can have breast implants, but you are still biologically a male.

Call yourself transgendered if you would like, but you are still a male.

Males have different bone structures, muscle and tendon structures than a female.

This has nothing to do with my religious beliefs or preferences...  this is biology 101.

Body composition differs between men and women. Men have more lean mass, and women have more fat mass than men. Men are more likely to accumulate adipose tissue around the trunk and abdomen, whereas women usually accumulate adipose tissue around the hips and thighs.   SOURCE:  National Insitute of Health.gov

I am not opposed to males having their Gentelia removed, in fact, if that is what they really want, I support them wholeheartedly...  They can even take female hormones if they so desire.  Again, this is their choice and I support their freedom to make that choice.

BUT THEY ARE NOT FEMALES...

However, if individuals were born with both female and male Gentelia then fortunately have the ability to chose one or the other or both.    And, this happens.  There are always mutations of the DNA and that is a scientific fact.

Those people I suppose would need to be treated differently...  but again, they are not the normal and they are different biologically than males who want to become females.

If two males want to marry that if their decision and I support that.

If two females want to marry that is their decision as well and I support that.

If a trans male/female wants to marry another trans male/female or wants to marry a straight male/female, I support their choices as well...

But, that is not he issue here and because that happens, it does not mean that there are more than two genders.  It just means that those two genders have choices and have decided to exercise those choices.

 

Survival Instincts

 

World's Fastest Growing Cities

In this article, we will be taking a look at the 15 fastest growing cities in the world economically. If you want to skip our detailed analysis of emerging economies you can move directly to the 5 Fastest Growing Cities in the World Economically.

According to a report by the International Monetary Fund, the global growth rate is expected to fall to 3% in 2023 and 2024 from an expected 3.5% in 2022. The report suggests that rising inflation rates have contributed to the current state of the global economy. 

As per the current data, the global headline inflation rate is expected to fall from 6.8% in 2023 to 5.2% in 2024. Moreover, world trade growth is expected to decline from 5.2% in 2022 to 2.0% in 2023.

However, the future of the global economy is not as bleak as it may seem right now. The report suggests that 2024 may be slightly better for the world. The world trade rate is expected to rise to 3.7% in 2024. 

Emerging economies are expected to experience significant growth by the end of 2023 and 2024, at 4.0% and 4.1%, respectively. Particularly, emerging economies in Asia are expected to experience the highest growth globally and global growth is on track to rise to 5.3% in 2023 and 5.0% in 2024.

BRICS May Drive Future Economic Growth
Brazil, Russia, India, and China first grouped to form BRIC in 2006. In 2011, South Africa joined the group, which led the cluster to be renamed to the BRICS. These economies were grouped as expectations of high economic growth dominated the prospects for each country. 

You can take a look at some countries that are expected to experience significant economic growth.

On January 1 2024, BRICS is set to welcome new members formally. These include Saudi Arabia, Argentina, Egypt, Ethiopia, Iran, and the United Arab Emirates. On August 23, Forbes reported how the new arrangement between the BRICS countries could be a political move to attain energy dominance. 

As per the report, the arrangement immensely benefits China. Saudi Arabia, a major oil supplier to China, will benefit the country by the Riyadh-Teheran détente. The new treaty between Iran and Saudia Arabia promises trade and friendship between the two countries.  READ MORE...