Difference between revisions of "User:Ted"

From Wiki at Neela Nurseries
Jump to: navigation, search
(↑ ↓ plant and animal references)
m (^ Technology and Tools: add link to as yet not created page "Video games".)
 
(248 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
<center>
 
<center>
-- 2017-07-21 &#x0936;&#x0941;&#x0915;&#x094d;&#x0930;&#x0935;&#x093e;&#x0930; --<br />
+
-- 2017-07-21 [[Days_of_the_week|&#x0936;&#x0941;&#x0915;&#x094d;&#x0930;&#x0935;&#x093e;&#x0930;]] --<br />
 
User Ted's wiki page at [https://neelanurseries.com Neela Nurseries]<br />
 
User Ted's wiki page at [https://neelanurseries.com Neela Nurseries]<br />
 +
[[musica|musica, संगीत]]
 
</center>
 
</center>
  
Line 8: Line 9:
 
== OVERVIEW ==
 
== OVERVIEW ==
  
<p>This wiki document a starting point of Ted's notes on Linux use and configuration, Open Source Software and web development. Recent summer 2017 efforts of Ted's are focused on several high-level programming language and web development frameworks, which can be studied and used separately but are often glued together to achieve meaningful tasks and end-user tools and interfaces.  This personal page of Ted's notes on Neela Nurseries wiki not yet well organized, but here as a quick stash point for holding useful references, and a starting point for more complete and formal documentation.</p>
+
<p>This wiki document a starting point of Ted's notes on Linux use and configuration, Open Source Software and web development.
 +
</p>
 +
<p>This local notes page on Neela Nurseries wiki not yet well organized, but here as a quick stash point for holding useful references and a starting point for more complete and formal documentation.</p>
  
 +
[[Musica|Music notes here]] &nbsp;:::&nbsp; [[Microcontrollers#nn_keywords_template|NN keywords template]] &nbsp;:::&nbsp; [[RTOS#anchor_devzone_forum_posts|Nordic Devzone posts]] &nbsp;:::&nbsp; [https://community.jaredwolff.com/ CircuitDojo Forum] &nbsp;:::&nbsp; [[#to_untangle_c_declarations|Untangling complex C declarations]]
  
== [[#top|^]] Quick Links ==
+
{|
 +
|-
 +
|Keywords:  <code>Untangling</code> <code>Detangling</code> <code>[[#untangling_complex_c_delcarations|Untangling C Declarations]]</code> <code>[[Devzone_posts|Nordic Devzone]]</code> <code>[[Firmware_goals|firmware goals]]</code>
 +
|}
  
<ul>
+
<!-- comment -->
  <li> [[to-do|TO DO]] <br />
+
 
  <li> [[bulletin-board|NN bulletin board]] <br />
+
<span id="quick_links_user_ted"></span>
  <li> [[terminology|Terminology pages]] <br />
 
</ul>
 
  
 +
== [[#top|^]] Technology and Tools ==
  
<!-- comment -->
+
Quick links to local notes and references: <!--, also available but not consistently synchronized with [[quick_links|stand alone page]] on this wiki: -->
  
 +
{| class="wikitable"
  
__TOC__
+
|- <!-- TABLE ROW : topic group ids -->
 +
! scope="col" style="min-width: 250px; width: 20%;" | 1
 +
! scope="col" style="min-width: 250px; width: 20%;" | 2
 +
! scope="col" style="min-width: 250px; width: 20%;" | 3
 +
! scope="col" style="min-width: 250px; width: 20%;" | 4
  
 +
|- <!-- TABLE ROW : topic group names -->
 +
! scope="col" style="min-width: 250px; width: 20%;" | Technical groups
 +
! scope="col" style="min-width: 250px; width: 20%;" | Hardware references
 +
! scope="col" style="min-width: 250px; width: 20%;" | Operating systems
 +
! scope="col" style="min-width: 250px; width: 20%;" | Tools and Toolchains
  
 +
<!-- Note on CSS, 'style' tag supports 'width' property:  style="width: 250px;" -->
 +
|- <!-- TABLE ROW : topic groups -->
 +
| style="vertical-align: top;" |
  
<!-- SECTION - Countries and Politics -->
+
<ul><!-- TOPIC GROUP NAME "Technical groups" -->
  
=== [[#top|&uarr;]] [[#references|&darr;]] <i> Countries and politics </i> ===
+
<li> [https://tldp.org/ The Linux Documentation Project]
 +
<li> [https://hackaday.io/ Hackaday]
 +
<li> [https://circuitcellar.com/ Circuit Cellar]
 +
<li> [https://devzone.nordicsemi.com|Nordic Devzone]
 +
<li> [[Oresat-notes|Oresat notes]]
  
https://www.nytimes.com/2018/07/28/world/americas/china-latin-america.html
+
<li> <i>Embedded Muse . . . need URL</i>
 +
<li> [https://www.synopsys.com/designware-ip/technical-bulletin/true-random-number-generator-security-2019q3.html true RNG]
 +
<li> [[nordic_devzone_posts|Devzone posts and others]]
  
 +
</ul>
  
 +
| style="vertical-align: top;" |
  
<!-- comment -->
+
<ul><!-- TOPIC GROUP NAME "Hardware references" -->
  
<!-- SECTION - Community, Culture, the World -->
+
<li>  [[amplifiers|amplifiers]]
 +
<li>  [[radio|radio]]
 +
<li>  [[cell modules|modules_celulares]]
 +
<li>  [[Microcontrollers|Microcontrollers general]]
 +
<li>  [[Arduino notes|arduino-notes]]
 +
<li>  [[Raspberry_pi|Raspberry Pi notes]]
 +
<li>  [[memory_devices|memory devices]]
 +
<li>  [[LoRa|LoRa technology]]
 +
<li>  [[firmware_programmers|firmware programmers]]
 +
<li>  [https://www.baldengineer.com/low-side-vs-high-side-transistor-switch.html Baldengineer dot com]
 +
<li> [[debuggers|JLink debugger notes]]
 +
<li>  [[multi-core|multi-core RTOS notes]]
  
== [[#top|&uarr;]] [[#references|&darr;]]<!--[[new_page|&darr;]]--> Community, Culture, the World ==
+
</ul>
  
Following sections on Community, Geography, Culture, Musica and the world may become a separate wiki page in the future.
+
| style="vertical-align: top;" |
  
 +
<ul><!-- TOPIC GROUP NAME "Operating systems" -->
  
<!-- comment -->
+
<li>  [[Zephyr|Zephyr]]
 +
<li>  [[Containers_and_virtual_machines|Containers and VMs]]
 +
<li>  [[RTOS|RTOS notes]]
 +
<li>  [[ThreadX_notes|ThreadX notes]]
 +
<!-- local pages to review:
 +
<li>  [[Zephyr_toolchain|Zephyr toolchain]]
 +
<li>  [[RTOS#.5E_Zephyr_RTOS|Zephyr, west (RTOS page section)]]
 +
<li>  [[RTOS_Zephyr|Zephyr RTOS (new page 8-18)]]
 +
-->
 +
</ul>
  
=== [[#top|&uarr;]] [[#references|&darr;]] Geography and Place ===
+
| style="vertical-align: top;" |
  
*  https://www.usatoday.com/border-wall/story/flight-over-entire-us-mexico-border-fence/605855001/
+
<ul><!-- TOPIC GROUP NAME "Tools and toolchains" -->
  
*  Morocco weather climate and agriculture . . .
+
<li> [[Make_and_GCC|arm-none-eabi-gcc, gcc, make]]
**  [http://www.our-africa.org/morocco/climate-agriculture Morocco's climate - Our Africa site]
+
<li> [[gdb|gdb]] <font size=1>and general debugging</font>
**  http://www.essaouira.nu/ecology_climate.htm
+
<li> [[ld|ld linker]]
**  http://www.worldbank.org/en/news/feature/2015/11/23/green-growth-putting-morocco-in-the-lead-against-climate-change
+
<li> [[Openocd-setup|openocd]]
 +
<li> [[pyocd|pyocd]]
 +
<li> [[cmake|cmake notes]]
 +
<li> [[west_zephyr_project_manager|west meta-tool]] <!-- [https://docs.zephyrproject.org/latest/guides/west/index.html west meta-tool] -->
 +
<li> [[west_manifest_files|west manifest files]]
 +
<li> [[segger_nordic_version|Segger Nordic version]]
 +
<li> [[ctags|ctags]] <!-- [[Bazel build tool|bazel_notes]] -->
 +
</ul>
  
*  [https://www.sesptsa.org/featured/2018-tree-recycling/ Southeast Environmental School PTSA]
+
|} <!-- CLOSE OF WIKI TABLE -->
 +
<!--
 +
==== <i>edit point</i> ====
 +
-->
 +
{| class="wikitable"
  
*  [http://www.lensjoy.com/gallery/20.htm Tsagaglalal 'She Who Watches']
+
|- <!-- TABLE ROW : topic group ids -->
 +
! scope="col" style="min-width: 250px; width: 20%;" | 5
 +
! scope="col" style="min-width: 250px; width: 20%;" | 6
 +
! scope="col" style="min-width: 250px; width: 20%;" | 7
 +
! scope="col" style="min-width: 250px; width: 20%;" | 8
  
<!--
+
|- <!-- TABLE ROW : topic group names -->
*  https://workbasedlearning.pnnl.gov/pals/resource/cards/bunchgrass.stm
+
! scope="col" style="min-width: 250px; width: 20%;" | Documentation
*  http://calscape.org/Festuca-idahoensis-(Idaho-Fescue) . . . includes mention of purple needlegrass
+
! scope="col" style="min-width: 250px; width: 20%;" | Programming languages
*  https://en.wikipedia.org/wiki/Nassella_pulchra
+
! scope="col" style="min-width: 250px; width: 20%;" | Programming languages
  *  https://en.wikipedia.org/wiki/List_of_California_native_plants#Common_grasses
+
! scope="col" style="min-width: 250px; width: 20%;" | Data Integrity
  *  https://en.wikipedia.org/wiki/Category:Native_grasses_of_California
 
  * 
 
-->
 
  
 +
|- <!-- TABLE ROW : topic groups -->
 +
| style="vertical-align: top;" |
  
https://lebanonuntravelled.com/iris-sofarana-endemic-lebanese-flower/ Iris sofarana endemic to Lebanon
+
<ul><!-- TOPIC GROUP NAME "Documentation" -->
 +
<li> [https://www.nasa.gov/seh/appendix-c-how-to-write-a-good-requirement NASA Requirements How-To]
 +
<li> [[Presentation_tools|presentation tools]]
 +
<li> [[doxygen_notes|Doxygen notes]]
 +
<li> [[rst|Restructured Text (rst)]]
 +
</ul>
  
 +
| style="vertical-align: top;" |
  
<!-- comment -->
+
<ul><!-- TOPIC GROUP NAME "Programming languages" -->
 +
<li> [[assembly_language|assembly]]
 +
<li> [[C_programming_notes|C]]
 +
<li> [[Device_tree|Device Tree and dts]]
 +
<li> [[Kconfig|Kconfig]]
 +
<li> [[shell|shell]]
 +
</ul>
  
=== [[#top|&uarr;]] [[#references|&darr;]] People ===
+
| style="vertical-align: top;" |
  
Cultural and envinrmental:
+
<ul><!-- TOPIC GROUP NAME "Programming languages" -->
<ul>
+
<li> [https://ada-lang.io/ Ada]
https://www.hcn.org/issues/51.6/tribal-affairs-in-california-the-karuk-tribe-fights-a-growing-wildfire-threat-and-a-lack-of-funding
+
<li> [https://www.rust-lang.org/ Rust]
 +
<li> [https://inko-lang.org/ Inko]
 +
<li> [[Python_notes|Python notes]]
 +
<li> [[Perl|Perl]]
 
</ul>
 
</ul>
  
 +
| style="vertical-align: top;" |
  
*  https://www.opb.org/radio/programs/bbc-outlook/
+
<ul><!-- TOPIC GROUP NAME "Data Integrity" -->
<ul>
+
<li> [[data_integrity_methods|data integrity methods]]
*  https://www.bbc.co.uk/programmes/w3cswsmc
+
<li> [[programming_constructs|programming constructs]]
*  https://www.cnn.com/style/article/italy-umbrella-maker-talarico/index.html
 
 
</ul>
 
</ul>
  
 +
|} <!-- CLOSE OF WIKI TABLE -->
 +
 +
<!--
 +
==== <i>edit point </i> ====
 +
-->
 +
{| class="wikitable"
 +
 +
|- <!-- TABLE ROW : topic group ids -->
 +
! scope="col" style="min-width: 250px; width: 20%;" | 9
 +
! scope="col" style="min-width: 250px; width: 20%;" | 10
 +
! scope="col" style="min-width: 250px; width: 20%;" | 11
 +
! scope="col" style="min-width: 250px; width: 20%;" | 12
  
Encontrado 2019-12-30 lunes, commentario sobre Mahatma Gandhi:
+
|- <!-- TABLE ROW : topic group names -->
<ul>
+
! scope="col" style="min-width: 250px; width: 20%;" | Technologies
*  https://www.kolorkomplex.com/kolorkomplex-culture/2017/1/4/mahatma-gandhi
+
! scope="col" style="min-width: 250px; width: 20%;" | Local works
</ul>
+
! scope="col" style="min-width: 250px; width: 20%;" | Local works
 +
! scope="col" style="min-width: 250px; width: 20%;" | Code Libraries
  
 +
|- <!-- TABLE ROW : topic groups -->
 +
| style="vertical-align: top;" |
  
Tech authors, astronomy, more Linux reference material:
+
<ul><!-- TOPIC GROUP 9 NAME "Technologies" -->
  
<ul>
+
<li> [https://cartesiam-neai-docs.readthedocs-hosted.com/ Cartesiam]
https://www.howtogeek.com/author/lorikaufman/
+
<li> [https://cartesiam-neai-docs.readthedocs-hosted.com/studio/studio.html#ii-project-creation Cartesiam AI Studio]
https://www.theatlantic.com/science/archive/2017/05/aliens-on-your-packard-bell/527445/
+
<li> [[cybersecurity|security topics]]
 +
<li> [[wireless_communications|Wireless communications]]
 
</ul>
 
</ul>
  
<!-- comment -->
+
| style="vertical-align: top;" |
  
=== [[#top|&uarr;]] [[#references|&darr;]] Human languages ===
+
<ul><!-- TOPIC GROUP 10 NAME "Local works" -->
 +
 
 +
<li>[[zephyr_building_blocks|Zephyr building blocks <font size=1>reference</font>]]<br />
 +
^^^ <i>NEEDS ORGANIZATION</i> ^^^
 +
 
 +
<li>[[zephyr_device_driver_model|Zephyr device drivers, Jared Wolff<font size=1>study</font>]] <font size="1"><span style="background:#e6ffcc;>&nbsp;</span><span style="background:#ffffcc;>&nbsp;</span><span style="background:#ffe6cc;>&nbsp;</span><span style="background:#ffb3b3;>&nbsp;</span></font><br />
 +
<li>[https://github.com/tedhavelka/kionix-driver-demo Zephyr driver demo]
 +
<li>[[nrf_modem_library_notes|nRF modem lib <font size=1>study</font>]]
 +
<!-- vi /home/cpguest/embedded/ncs/v1.6.1/nrf/lib/nrf_modem_lib/nrf_modem_lib.c -->
 +
<li>[[spi_device_tree_source_code|SPI device tree source code]]
 +
<li> [[Pico-sdk_studies|RPi Pico SDK studies]]
 +
<li> [[Firmware_goals|firmware goals]]
 +
</ul>
  
*  [[nn-english-hindi-glossary|English-Hindi glossary at NN]]
+
| style="vertical-align: top;" |
  
*  [https://www.omniglot.com/writing/devanagari_conjuncts.php Devanagari conjunct characters]
+
<ul><!-- TOPIC GROUP 11 NAME "Local works" -->
  
[[cool_new_words|cool new words encountered . . .]]
+
<li>[[nrf_sample_app_aws_iot|sample aws_oit <font size=1>study</font>]]<br />
 +
<li>[[zephyr_rtos_threads|Zephyr RTOS threads <font size=1> </font>]]<br />
 +
<li>[[zephyr_in_tree_driver_use|In-tree driver]]<br />
 +
<li>[[iis2dh|ST Micro IIS2DH]]<br />
 +
<li>[[zephyr_board_porting|Zephyr board porting]]<br />
 +
<li>[[i2c_driver_notes|I2C driver notes]]
 +
</ul>
  
 +
| style="vertical-align: top;" |
  
- 2017-12-15 FRI -
+
<ul><!-- TOPIC GROUP 12 NAME "Code libraries" -->
  
*  https://etohautakuva.deviantart.com/art/Taugedei-Abugida-Alphasyllabary-Cheatsheet-610277914
+
<li> [[Nordicsemi-software-development-kit|Nordic nrf-sdk]]
*  http://langventure.strikingly.com/blog/hindi-abugida-in-action
+
<li> [[Zephyr-sdk-install-and-config|Zephyr SDK installation notes]]
*  https://wsotw.weebly.com/blog/alphabets-abugidas-and-syllabaries
+
<li> [[CMSIS_notes|CMSIS notes]]
 +
<li> [[curl_notes|libcurl notes]]
 +
<li> [[MCUXpresso_SDK|MCUXpresso SDK]]
 +
<li> [[NXP_HAL|NXP LPC HAL]]
 +
</ul>
  
 +
|} <!-- CLOSE OF WIKI TABLE -->
 
<!--
 
<!--
Gaurav
+
|-
Gaurav
+
| scope="col" style="min-width: 250px; max-width: 300px; column-span:4;" |
7 months ago
+
==== <i>edit point</i> ====
ओ पालनहारे निर्गुण और न्यारे
+
-->
ओ पालनहारे निर्गुण और न्यारे
+
{| class="wikitable"
तुमरे बिन हमरा कौनों नहीं
+
 
हमरी उलझन सुलझाओं भगवान
+
|- <!-- TABLE ROW : topic group ids -->
तुमरे बिन हमरा कौनों नहीं
+
! scope="col" style="min-width: 250px; width: 20%;" | 13
तुम्हे हमका हो संभाले
+
! scope="col" style="min-width: 250px; width: 20%;" | 14
तुम्हे हमरे रखवाले
+
! scope="col" style="min-width: 250px; width: 20%;" | 15
तुमरे बिन हमरा कौनों नहीं
+
! scope="col" style="min-width: 250px; width: 20%;" | 16
तुमरे बिन हमरा कौनों नहीं
+
 
 +
|-  <!-- TABLE ROW : topic group names -->
 +
! scope="col" style="min-width: 250px; max-width: 300px;" | Open software projects
 +
! scope="col" style="min-width: 250px; max-width: 300px;" | Comms protocols
 +
! scope="col" style="min-width: 250px; max-width: 300px;" | Encodings
 +
! scope="col" style="min-width: 250px; max-width: 300px;" | Hardware issues
 +
 
 +
|- <!-- TABLE ROW : topic groups -->
 +
| style="vertical-align: top;" |
  
चंदा में तुम्ह भरे हो चांदनी
+
<ul><!-- TOPIC GROUP NAME "open software projects" -->
सूरज में उजाला तुम्ह से
+
<li>  [https://github.com/apache/httpd/tree/trunk Apache2 webserver]
ये गगन है मगन
+
<li>  [https://www.mcuboot.com/about/ MCUBoot open governance]
तुम्हे तो दिए हो इससे तारे
+
</ul>
भगवान ये जीवन ना सवारोगे
 
तो क्या कोई सवारे
 
ओ पालनहारे निर्गुण और न्यारे
 
तुमरे बिन हमरा कौनों नहीं
 
तुमरे बिन हमरा कौनों नहीं
 
  
जो सनों तो कहे प्रभुजी हमरी है बिनती
+
| style="vertical-align: top;" |
दुखी हैं को धीरज दो
 
हारे नहीं वो कभी दुख से
 
तुम निर्बल को रक्षा के
 
रेह पाए निर्बल सुख से
 
भक्ति को शक्ति को
 
भक्ति को शक्ति को
 
जग के जो स्वामी हो
 
इतनी तो अरज सुनो
 
है पथ में अंधियारे
 
देदो वरदान में उजियारे
 
  
ओ पालनहारे निर्गुण और न्यारे
+
<ul><!-- TOPIC GROUP NAME "comms protocols" -->
तुमरे बिन हमरा कौनों नहीं
+
<li>  [[i2c|I2C]]
हमरी उलझन सुलझाओं भगवान
+
<li>  [https://learn.sparkfun.com/tutorials/serial-peripheral-interface-spi/all SPI Sparkfun tutorial]
तुमरे बिन हमरा कौनों नहीं
+
<li>  [[protocol_SPI|SPI]]
 +
<li>  [https://infocenter.nordicsemi.com/pdf/nrf91_at_commands_v1.2.pdf AT commands]
 +
<li>  [[lte_at_command_notes|LTE AT command notes]]
 +
<li>  [https://www.hivemq.com/blog/mqtt-essentials-part2-publish-subscribe/ MQTT 2/10 intro series]
 +
<li>  [[mqtt_notes|MQTT notes]]
 +
<li>  [[swd|notes serial wire debug SWD]]
 +
<li>  [[bootloading|notes serial bootloading]]
 +
</ul>
  
ओ पालनहारे निर्गुण और न्यारे
+
| style="vertical-align: top;" |
तुमरे बिन हमरा कौनों नहीं
 
हमरी उलझन सुलझाओं भगवान
 
तुमरे बिन हमरा कौनों नहीं
 
-->
 
  
<!-- comment -->
+
<ul><!-- TOPIC GROUP NAME "encodings" -->
 +
<li>  [[json|JSON notes]] <!-- [https://www.w3schools.com/whatis/whatis_json.asp JSON] -->
 +
<li>  [https://www.tutorialspoint.com/protobuf/index.htm Protobuf]
 +
<li>  [[protobuf_notes|Protobuf notes]]
 +
<li>  [[intel_hex_format|Intel hex format]]
 +
<li>  [[ASCII|ASCII]]
 +
</ul>
  
== - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - ==
+
| style="vertical-align: top;" |
  
<!-- comment -->
+
<ul><!-- TOPIC GROUP NAME "Hardware" -->
 +
<li> [[hardware_studies_specific|specific hardware studies]]
 +
<li> [[video_games|Classic video games]]
 +
</ul>
  
- 2017-10-05 - Ted noting here that would be good to have a [[technical_glossary|technical glossary]] to make easily accessible all the technical terms which arise in daily work and exploration of technologies . . .
+
|} <!-- CLOSE OF WIKI TABLE -->
 +
<!--
 +
|-
 +
| scope="col" style="min-width: 250px; max-width: 300px; column-span:4;" |
 +
==== <i>edit point</i> ====
 +
-->
 +
{| class="wikitable"
  
 +
|- <!-- TABLE ROW : topic group ids -->
 +
! scope="col" style="min-width: 250px; width: 20%;" | 17
 +
! scope="col" style="min-width: 250px; width: 20%;" | 18
 +
! scope="col" style="min-width: 250px; width: 20%;" | 19
 +
! scope="col" style="min-width: 250px; width: 20%;" | 20
  
- 2017-10-19 - TO-DO list:
+
|- <!-- TABLE ROW : topic group names -->
 +
! scope="col" style="min-width: 250px; max-width: 300px;" | Local stuff
 +
! scope="col" style="min-width: 250px; max-width: 300px;" | Academic
 +
! scope="col" style="min-width: 250px; max-width: 300px;" | Cloud based services
 +
! scope="col" style="min-width: 250px; max-width: 300px;" | Interesting projects
  
  *  [&#10003;] complete LFS 8.1 exercise
+
|- <!-- TABLE ROW : topic groups -->
  *  [ ] configure xserver to run stand-along without window manager (seems to be working on 1604 spare LTS host . . .)
+
| style="vertical-align: top;" |
  *  [ ] set up two mysql servers on one host
 
  *  [ ] write "best photo contribution" practices page for ASI
 
  *  [ ] code "re-use or reference text block" module for MediaWiki <i> &lt;-- this needs further explanation - TMH </i>
 
  *  [ ] in local Neela Nurseries PHP code base, amend hybrid building of nav menus to include highlighting parent page of given viewed page
 
  *  [ ] in OpenCart 2.x find way to customize top-of-page information and links
 
  *  [ ] in OpenCart 2.x find way to format product lists as compact lists, like Gmail inbox or Windows 'list view' of files
 
  
 +
<ul><!-- TOPIC GROUP NAME "" -->
  
<!-- comment -->
+
<li>  [[bulletin-board|NN bulletin board]]
 +
<li>  [[terminology|Terminology pages]]
 +
<li>  [[to-do|TO DO]]
 +
<li>  [[Bash_start_up_script|bookmarker]]
 +
</ul>
  
== [[#top|&uarr;]] [[#references|&darr;]] GNU Make and GCC Tools ==
+
| style="vertical-align: top;" |
<br />
 
<span style="background-color:#ffd0d0; border:maroon 1px dotted; padding:10px;"><i>2018-07-18 NOTE:  this section to be moved to separate [[Make_and_GCC|GCC and Make article]] . . .  - TMH</i></span>
 
  
<br />
+
<ul><!-- TOPIC GROUP NAME "" -->
  
* https://www.gnu.org/software/make/manual/html_node/Special-Targets.html
+
  [[ece-reference-materials|ECE reference materials]]
 +
</ul>
  
Using macros with gcc:
+
| style="vertical-align: top;" |
*  https://gcc.gnu.org/onlinedocs/gcc/Option-Summary.html  . . . gcc summary of options
 
*  https://gcc.gnu.org/onlinedocs/cpp/Macros.html          . . . defining macros with -Dmacro_name=expression
 
*  https://gcc.gnu.org/onlinedocs/gcc/Preprocessor-Options.html#Preprocessor-Options  . . . -MT and other preprocessor options
 
  
Code libraries and shared objects, expressing paths to them:
+
<ul><!-- TOPIC GROUP NAME "" -->
*  https://gist.github.com/gubatron/32f82053596c24b6bec6
 
  
gcc.gnu.org - 3.15 Specifying subprocesses and switches passed to them
+
<li>  [https://hub.docker.com/ Docker Hub site]
* https://gcc.gnu.org/onlinedocs/gcc-4.1.2/gcc/Spec-Files.html#Spec-Files
+
<li> [https://bifravst.github.io/bifravst/docs/aws/GettingStarted.html bifravst]
 +
<li>  [https://docs.aws.amazon.com/AmazonS3/latest/userguide/Versioning.html Amazon S3 versioning]
 +
<li>  [[AWS_notes|AWS notes]]
 +
<li>  [[character_sequences|CLI and character sequences]]
 +
</ul>
  
gcc how to show macros and pre-processor defines:
+
| style="vertical-align: top;" |
*  https://stackoverflow.com/questions/2224334/gcc-dump-preprocessor-defines
 
  
 +
<ul><!-- TOPIC GROUP NAME "Interesting projects" -->
  
<!-- comment -->
+
<li> [https://devzone.nordicsemi.com/nordic/nrf-connect-sdk-guides/b/software/posts/enter-the-multi-nus-a-simple-wireless-uart-network nRF multi-NUS]
 +
<li> [https://docs.zephyrproject.org/latest/samples/drivers/led_ws2812/README.html WS2812 Zephyr driver]
 +
<li> [https://github.com/EseyeIoT/EseyeTelemetryModule-STM32_library Eseye IoT telem STM32]
 +
</ul>
  
<!-- SECTION - Mediawiki Issues and Notes -->
+
|} <!-- CLOSE OF WIKI TABLE -->
  
== [[#top|&uarr;]] [[#references|&darr;]] Mediawiki Issues and Notes ==
+
== [[#top|^]] temporary section ==
  
- 2018-01-22 -
+
Note: useful to add ratings of completeness and organization to above links that point to local wiki pages.
While editing sidebar of Mediawiki instance at Neela, Ted noticing a difference in Mediawiki's treatment of hyperlinks in the sidebar. Links to external sites don't appear, and links to internal pages require single square brace enclosure to appear with alternate text as a link label . . .
 
  
<pre>
+
* https://devzone.nordicsemi.com/nordic/cellular-iot-guides/b/software-and-protocols/posts/connecting-to-aws-cloud-services-using-the-nrf9160
<!--
 
** [https://buildroot.org/downloads/manual/manual.html Buildroot manual]
 
<a href="https://buildroot.org/downloads/manual/manual.html">Buildroot manual</a>
 
  
- 2018-01-22 MON -
+
* https://community.helium.com/t/new-to-helium-start-here/80
** https://wiki.neelanurseries.com/index.php/Nn_embedded_linux_notes#.E2.86.91_.E2.86.93_Buildroot|Buildroot notes . . . only 'notes' shows as non-link text - TMH
+
http://iotfactory.eu/lorawan-world-frequency-map-lora-sigfox-nbiot-telecom-operators-per-country/ LoRaWAN world frequency map (not exhaustive)
-->
 
</pre>
 
  
 +
Always useful to review, wiki table syntax help:
  
=== [[#top|^]] File uploads ===
+
  *  [https://en.wikipedia.org/wiki/Help:Table wiki table help]
 +
<!-- comment -->
  
- 2018-06-29 FRI -
+
Wiki-driven table of contents here:
Issue adding .txt type files to whitelist of Mediawiki installation uploadable files:
 
  
<pre>
+
__TOC__
Action failed
 
  
Could not open lock file for "mwstore://local-backend/local-public/e/ec/Asi-officers-list-2018.txt".
 
  
Return to Main Page.
 
</pre>
 
  
[[media:arrow-up-prelight.png|200px|thumb|left|png type image]] to test file uploads of allowed image type . . .<br />
+
<!-- SECTION - Countries and Politics -->
[[media:arrow-up-prelight.png]]
 
  
 +
=== [[#top|&uarr;]] [[#references|&darr;]] <i> Countries and politics </i> ===
  
 +
*  https://www.nytimes.com/2018/07/28/world/americas/china-latin-america.html
  
Following link may have helpful information:
 
  
*  https://www.mediawiki.org/wiki/Topic:Qlib7k3p2zvi7pkq
 
  
- 2018-07-25 WED -
+
<!-- comment -->
  
*  https://www.mediawiki.org/wiki/Manual:Configuring_file_uploads  . . . be sure to examine $wgFileBlacklist in addition to $wgFileExtensions,
+
<!-- SECTION - Community, Culture, the World -->
  
 +
== [[#top|&uarr;]] [[#references|&darr;]]<!--[[new_page|&darr;]]--> Community, Culture, the World ==
  
<!-- comment -->
+
Following sections on Community, Geography, Culture, Musica and the world may become a separate wiki page in the future.
 
 
=== [[#top|^]] Mediawiki layout topics like multi column layout ===
 
 
 
- 2018-11-30 FRI -
 
*  https://www.mediawiki.org/wiki/Topic:Ube2zt7nhfk51l3s
 
  
  
 
<!-- comment -->
 
<!-- comment -->
  
<!-- SECTION - Web Site Building Blocks -->
+
=== [[#top|&uarr;]] [[#references|&darr;]] Geography and Place ===
  
== [[#top|&uarr;]] [[#references|&darr;]] Web Site Building Blocks - Summer 2017 to 2020 Q1 Work ==
+
*  https://www.usatoday.com/border-wall/story/flight-over-entire-us-mexico-border-fence/605855001/
  
Must begin a new section on web site security issuesHere are a couple of articles as starting points to sleuth out how the "WARNING - Please read me XMG" ransomeware attack can reach MYSQL databases of on-line hosts:
+
*  Morocco weather climate and agriculture . . .
 +
**  [http://www.our-africa.org/morocco/climate-agriculture Morocco's climate - Our Africa site]
 +
**  http://www.essaouira.nu/ecology_climate.htm
 +
** http://www.worldbank.org/en/news/feature/2015/11/23/green-growth-putting-morocco-in-the-lead-against-climate-change
  
<ul>
+
[https://www.sesptsa.org/featured/2018-tree-recycling/ Southeast Environmental School PTSA]
*  https://www.wordfence.com/blog/2017/07/searchreplacedb2-security/.
 
*  https://www.imperva.com/blog/ransomware-attacks-on-mysql-and-mongodb/
 
</ul>
 
  
 +
*  [http://www.lensjoy.com/gallery/20.htm Tsagaglalal 'She Who Watches']
  
2019-11-12
+
<!--
<ul>
+
*  https://workbasedlearning.pnnl.gov/pals/resource/cards/bunchgrass.stm
*  https://dev.mysql.com/doc/refman/5.7/en/server-logs.html
+
*  http://calscape.org/Festuca-idahoensis-(Idaho-Fescue) . . . includes mention of purple needlegrass
*  https://www.percona.com/blog/2012/12/28/auditing-login-attempts-in-mysql/
+
*  https://en.wikipedia.org/wiki/Nassella_pulchra
</ul>
+
  *  https://en.wikipedia.org/wiki/List_of_California_native_plants#Common_grasses
 +
  *  https://en.wikipedia.org/wiki/Category:Native_grasses_of_California
 +
  * 
 +
-->
  
  
* [[nn_web_site_building_blocks|Web site building blocks]] . . . now a separate wiki document, as of 2018-01-08.  - TMH
+
*  https://lebanonuntravelled.com/iris-sofarana-endemic-lebanese-flower/ Iris sofarana endemic to Lebanon
 
 
2020-01-27 htpasswd access files
 
<ul>
 
*  https://www.htaccesstools.com/articles/htpasswd/
 
</ul>
 
  
  
 
<!-- comment -->
 
<!-- comment -->
  
== [[#top|&uarr;]] [[#references|&darr;]] Open Source License Types ==
+
=== [[#top|&uarr;]] [[#references|&darr;]] People ===
  
*  https://lukasa.co.uk/2012/05/GPL_vs_MIT_Which_License_To_Use/
+
Cultural and envinrmental:
 +
<ul>
 +
*  https://www.hcn.org/issues/51.6/tribal-affairs-in-california-the-karuk-tribe-fights-a-growing-wildfire-threat-and-a-lack-of-funding
 +
</ul>
  
  
<!-- comment -->
+
*  https://www.opb.org/radio/programs/bbc-outlook/
 +
<ul>
 +
*  https://www.bbc.co.uk/programmes/w3cswsmc
 +
*  https://www.cnn.com/style/article/italy-umbrella-maker-talarico/index.html
 +
</ul>
 +
 
  
<!-- SECTION - Linux packages -->
+
Encontrado 2019-12-30 lunes, commentario sobre Mahatma Gandhi:
 +
<ul>
 +
*  https://www.kolorkomplex.com/kolorkomplex-culture/2017/1/4/mahatma-gandhi
 +
</ul>
  
== [[#top|&uarr;]] [[#references|&darr;]] Linux Packages (Separate Article) ==
 
  
[[nn_linux_software_package_notes|Linux software package notes]] a separate wiki document on Neela wiki.  - TMH
+
Tech authors, astronomy, more Linux reference material:
  
 +
<ul>
 +
*  https://www.howtogeek.com/author/lorikaufman/
 +
*  https://www.theatlantic.com/science/archive/2017/05/aliens-on-your-packard-bell/527445/
 +
</ul>
  
 
<!-- comment -->
 
<!-- comment -->
  
== - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - ==
+
=== [[#top|&uarr;]] [[#references|&darr;]] Human languages ===
  
 +
*  [[nn-english-hindi-glossary|English-Hindi glossary at NN]]
  
 +
*  [https://www.omniglot.com/writing/devanagari_conjuncts.php Devanagari conjunct characters]
  
<!-- comment -->
+
*  [[cool_new_words|cool new words encountered . . .]]
  
<!-- SECTION - Bash Shell Scripting -->
+
*  [https://www.pinterest.com/pin/836191855785684878/ US standard Braille and other symbol and language systems]
  
== [[#top|&uarr;]] [[#references|&darr;]] Bash Shell Scripting ==
+
- 2017-12-15 FRI -
  
 +
*  https://etohautakuva.deviantart.com/art/Taugedei-Abugida-Alphasyllabary-Cheatsheet-610277914
 +
*  http://langventure.strikingly.com/blog/hindi-abugida-in-action
 +
*  https://wsotw.weebly.com/blog/alphabets-abugidas-and-syllabaries
  
Bash (Bourne shell) Quick Reference:
+
<!--
 
+
Gaurav
<pre>
+
Gaurav
Shell Built-in Variables:
+
7 months ago
 +
ओ पालनहारे निर्गुण और न्यारे
 +
ओ पालनहारे निर्गुण और न्यारे
 +
तुमरे बिन हमरा कौनों नहीं
 +
हमरी उलझन सुलझाओं भगवान
 +
तुमरे बिन हमरा कौनों नहीं
 +
तुम्हे हमका हो संभाले
 +
तुम्हे हमरे रखवाले
 +
तुमरे बिन हमरा कौनों नहीं
 +
तुमरे बिन हमरा कौनों नहीं
  
  $0    Name of given shell script itself
+
चंदा में तुम्ह भरे हो चांदनी
  $1    Value of first command line parameter (similarly $2, $3, ...)
+
सूरज में उजाला तुम्ह से
  $#    In given shell script the number of command line parameters received
+
ये गगन है मगन
  $*    All of the command line parameters
+
तुम्हे तो दिए हो इससे तारे
  $-    Options given to the shell
+
भगवान ये जीवन ना सवारोगे
  $?    Return (or holds) the exit status of the last command
+
तो क्या कोई सवारे
  $$    Process id of given script (really the id of the shell running the script)
+
ओ पालनहारे निर्गुण और न्यारे
 +
तुमरे बिन हमरा कौनों नहीं
 +
तुमरे बिन हमरा कौनों नहीं
  
 +
जो सनों तो कहे प्रभुजी हमरी है बिनती
 +
दुखी हैं को धीरज दो
 +
हारे नहीं वो कभी दुख से
 +
तुम निर्बल को रक्षा के
 +
रेह पाए निर्बल सुख से
 +
भक्ति को शक्ति को
 +
भक्ति को शक्ति को
 +
जग के जो स्वामी हो
 +
इतनी तो अरज सुनो
 +
है पथ में अंधियारे
 +
देदो वरदान में उजियारे
 +
 +
ओ पालनहारे निर्गुण और न्यारे
 +
तुमरे बिन हमरा कौनों नहीं
 +
हमरी उलझन सुलझाओं भगवान
 +
तुमरे बिन हमरा कौनों नहीं
  
Shell test constructs:
+
ओ पालनहारे निर्गुण और न्यारे
 
+
तुमरे बिन हमरा कौनों नहीं
SYNTAX      NAME OF SHELL TEST                                NOTES
+
हमरी उलझन सुलझाओं भगवान
 +
तुमरे बिन हमरा कौनों नहीं
 +
-->
  
[          built-in test                                    considers its arguments as comparison expressions or file tests
+
<!-- comment -->
  
[[...]]     in Bash => 2.02 the extended test command
+
=== [[#top|&uarr;]] [[#references|&darr;]] Science ===
  
((...))    arithmetic tests                                  example:  (( 0 && 1 ))  # Logical AND
+
*  https://www.asbmb.org/asbmb-today/science/020721/a-brief-history-of-the-periodic-table
 +
*  https://en.wikipedia.org/wiki/List_of_elements_by_stability_of_isotopes
  
 +
== - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - ==
  
</pre>
+
<!-- comment -->
  
<i>
+
- 2017-10-05 - Ted noting here that would be good to have a [[technical_glossary|technical glossary]] to make easily accessible all the technical terms which arise in daily work and exploration of technologies . . .
References:
 
*  http://tldp.org/LDP/abs/html/testconstructs.html
 
*  http://tldp.org/LDP/abs/html/internal.html#BUILTINREF
 
*  http://tldp.org/LDP/abs/html/string-manipulation.html
 
</i>
 
  
  
 +
- 2017-10-19 - TO-DO list:
  
Shell scripting and use of built-in shell commands is a practical knowledge to employ, when working in Unix-like environmentsOne common task is to find all the instances of a given file or program.  The <code>locate</code> command can perform this kind of search, but it's results don't show whether the file instances differ. To check at the rough level of file size, we can use a one-line shell script technique involving shell piping, to "long list" the results of the <code>locate</code> command, like this . . .
+
  *  [&#10003;] complete LFS 8.1 exercise
 +
  *  [ ] configure xserver to run stand-along without window manager (seems to be working on 1604 spare LTS host . . .)
 +
  *  [ ] set up two mysql servers on one host
 +
  * [ ] write "best photo contribution" practices page for ASI
 +
  *  [ ] code "re-use or reference text block" module for MediaWiki <i> &lt;-- this needs further explanation - TMH </i>
 +
  *  [ ] in local Neela Nurseries PHP code base, amend hybrid building of nav menus to include highlighting parent page of given viewed page
 +
  *  [ ] in OpenCart 2.x find way to customize top-of-page information and links
 +
  *  [ ] in OpenCart 2.x find way to format product lists as compact lists, like Gmail inbox or Windows 'list view' of files
  
<pre>
 
  $ for file in `locate tavrasm | grep 'asm$'`; do ls -l ${file}; done
 
</pre>
 
  
Hmm strange, the above command calls `grep` with a pattern that ends in the shell end-of-line anchoring character $, and appears to filter for results of `locate` which end in 'asm'.  But on 2017-09-12 needed to add a "one or more wildcard" character pattern to limit search results for instances of `locate` results ending in 'qemu':
+
<!-- comment -->
  
<pre>
+
== [[#top|&uarr;]] [[#references|&darr;]] GNU Make and GCC Tools ==
    $ locate qemu | grep '.*qemu$'
 
</pre>
 
  
Why the apparent difference in command invocation? Need to test . . .  - TMH
+
<br />
 +
<span style="background-color:#ffd0d0; border:maroon 1px dotted; padding:10px;"><i>2018-07-18 NOTE: this section to be moved to separate [[Make_and_GCC|GCC and Make article]] . . .  - TMH</i></span>
  
 +
<br />
  
 +
*  https://gcc.gnu.org/onlinedocs/gcc-8.4.0/cpp/Stringizing.html
  
Command to break out first ten $PATH environment variable to individual paths each shown on a line of the shell:
+
*  https://www.gnu.org/software/make/manual/html_node/Special-Targets.html
  
<pre>
+
Using macros with gcc:
    $ for path in `echo $PATH | cut -d':' -f1-10 --output-delimiter=' '`; do echo $path; done
+
*  https://gcc.gnu.org/onlinedocs/gcc/Option-Summary.html  . . . gcc summary of options
</pre>
+
*  https://gcc.gnu.org/onlinedocs/cpp/Macros.html          . . . defining macros with -Dmacro_name=expression
 +
*  https://gcc.gnu.org/onlinedocs/gcc/Preprocessor-Options.html#Preprocessor-Options  . . . -MT and other preprocessor options
  
2018-04-23 - Monday, command to obtain summary of directories containing 1GB or more data:
+
Code libraries and shared objects, expressing paths to them:
<pre>
+
*  https://gist.github.com/gubatron/32f82053596c24b6bec6
    $ du -h . | grep [0-9]G
 
</pre>
 
  
 +
gcc.gnu.org - 3.15 Specifying subprocesses and switches passed to them
 +
*  https://gcc.gnu.org/onlinedocs/gcc-4.1.2/gcc/Spec-Files.html#Spec-Files
  
 +
gcc how to show macros and pre-processor defines:
 +
*  https://stackoverflow.com/questions/2224334/gcc-dump-preprocessor-defines
  
  
=== <i> [[#top|&uarr;]] [[#references|&darr;]] edit point - shell variable quoting</i> ===
+
<!-- comment -->
 +
 
 +
== [[#top|&uarr;]] [[#references|&darr;]] OpenOCD and Eagle set up notes ==
  
- 2017-10-19 THU -
+
Eagle fails to start due to symbols not resolve-able . . .
  
Running into issues when need to expand shell variable in single quotes pair . . .
+
  *  https://forums.autodesk.com/t5/eagle-forum/can-t-run-eagle-on-debian-10-testing/td-p/8312348
  
[https://unix.stackexchange.com/questions/178411/how-to-use-variables-inside-single-quotes Stack Exchange, Unix forum post 178411]<br />
+
Automake or autoconf or autoreconf -i fails for LIBTOOL undefined . . .
[http://tldp.org/LDP/abs/html/varassignment.html TLPD Advanced Bash Scripting Guide, chapter 4.2 example 4-3 double quotes preserve white space]<br />
 
  
 +
  *  https://stackoverflow.com/questions/18978252/error-libtool-library-used-but-libtool-is-undefined
  
WIKI WISH LIST - While adding to wiki, Ted noting that would be useful to have relative-depth wiki section markers.  The standard wiki section markers '== ==', '=== ===' and similar have fixed depth.  That is, '== ==' is always a top-level or first-level section in a wiki document, '=== ===' is always a sub-subsection of wiki documents, and '==== ====' a sub-sub-section.  When section gets re-factored into its own article, would be handy to have those section markers rise up to levels of top-most and successive section markers.  - TMH
 
  
  
 +
  *  https://stackoverflow.com/questions/43565009/failing-to-enable-stlink-in-openocd
  
 
<!-- comment -->
 
<!-- comment -->
  
=== [[#top|&uarr;]] [[#references|&darr;]] example shell script - back up several databases ===
+
<!-- SECTION - Mediawiki Issues and Notes -->
  
&nbsp;<br />
+
== [[#top|&uarr;]] [[#references|&darr;]] Mediawiki Issues and Notes ==
Here is a simple shell script to call mysqldump utility and back up several databases.  Couple of things Ted wants to add to this script include script variables to hold back-up filename prefix and infix patterns, and an option to compress the MYSQL dump files . . .
 
  
<i>Figure x - shell script to back-up multiple MYSQL databases</i>
+
- 2018-01-22 -
 +
While editing sidebar of Mediawiki instance at Neela, Ted noticing a difference in Mediawiki's treatment of hyperlinks in the sidebar.  Links to external sites don't appear, and links to internal pages require single square brace enclosure to appear with alternate text as a link label . . .
  
 
<pre>
 
<pre>
 +
<!--
 +
** [https://buildroot.org/downloads/manual/manual.html Buildroot manual]
 +
<a href="https://buildroot.org/downloads/manual/manual.html">Buildroot manual</a>
  
#!/bin/bash
+
- 2018-01-22 MON -
 +
** https://wiki.neelanurseries.com/index.php/Nn_embedded_linux_notes#.E2.86.91_.E2.86.93_Buildroot|Buildroot notes . . . only 'notes' shows as non-link text - TMH
 +
-->
 +
</pre>
  
  
DATABASE_LIST="information_schema mysql drupal_8p0 phpmyadmin wiki_database"
+
=== [[#top|^]] File uploads ===
  
user="root"
+
- 2018-06-29 FRI -
pass_phrase_for_mysql="mysql_user_password"
+
Issue adding .txt type files to whitelist of Mediawiki installation uploadable files:
options_extra="--skip-lock-tables"
 
  
response="n"
+
<pre>
 +
Action failed
  
mode_interactive="n"
+
Could not open lock file for "mwstore://local-backend/local-public/e/ec/Asi-officers-list-2018.txt".
  
 +
Return to Main Page.
 +
</pre>
  
 +
[[media:arrow-up-prelight.png|200px|thumb|left|png type image]] to test file uploads of allowed image type . . .<br />
 +
[[media:arrow-up-prelight.png]]
  
echo "shell script starting,"
 
  
  
 +
Following link may have helpful information:
  
for database in ${DATABASE_LIST};
+
*  https://www.mediawiki.org/wiki/Topic:Qlib7k3p2zvi7pkq
do echo "backing up alta-ubuntu database $database . . .";
 
  
#    command="mysqldump --databases $database -u$user -p$pass_phrase_for_mysql $options_extra >> au-database-back-up--${database}.sql"
+
- 2018-07-25 WED -
    command="mysqldump --databases $database -u$user -p$pass_phrase_for_mysql $options_extra"
+
 
    redirect="au-database-back-up--${database}.sql"
+
*  https://www.mediawiki.org/wiki/Manual:Configuring_file_uploads  . . . be sure to examine $wgFileBlacklist in addition to $wgFileExtensions,
  
    if [ $mode_interactive = 'y' ]; then
+
<!-- comment -->
  
        echo "build command '$command' and database back-up filename'$redirect',"
+
=== [[#top|^]] Images in wiki pages and image attributes ===
        echo "full command will be '$command' > '$redirect',"
 
        echo "trying running this command and redirect? [y/N/q] yes, no, 'q' to quit"
 
  
        read response
+
*  https://en.wikipedia.org/wiki/Wikipedia:Images_linking_to_articles
        if [ $response = 'Y' -o $response = 'y' ]; then
 
            ${command} > $redirect
 
        elif [ $response = 'N' -o $response = 'n' ]; then
 
            echo "skipping present command . . ."
 
        elif [ $response = 'Q' -o $response = 'q' ]; then
 
            echo "stopping script '$0' and exiting."
 
            break
 
        fi
 
        echo
 
  
    else
+
<!-- comment -->
  
        echo "$0:  backing up database '$database' to file '$redirect' . . ."
+
=== [[#top|^]] Mediawiki layout topics like multi column layout ===
        ${command} > $redirect
 
        ls -l $redirect
 
  
    fi
+
- 2018-11-30 FRI -
 +
*  https://www.mediawiki.org/wiki/Topic:Ube2zt7nhfk51l3s
  
done
 
  
 +
<!-- comment -->
  
echo "done."
+
=== [[#top|^]] Other Mediawiki topics ===
  
exit 0
+
*  https://www.mediawiki.org/wiki/Help:Moving_a_page
</pre>
 
  
=== [[#top|&uarr;]] [[#references|&darr;]] show kernel version script ===
+
<!-- comment -->
  
Following script 'showkversion' can be used in a Linux kernel source tree to determine the kernel's version number, based on the number elements defined in the kernel's top level makefile.
+
<!-- SECTION - Web Site Building Blocks -->
  
<i>Figure x - simple bash script to show kernel version in root of kernel sources tree</i>
+
== [[#top|&uarr;]] [[#references|&darr;]] Web Site Building Blocks - Summer 2017 to 2020 Q1 Work ==
  
<pre>
+
Must begin a new section on web site security issues.  Here are a couple of articles as starting points to sleuth out how the "WARNING - Please read me XMG" ransomeware attack can reach MYSQL databases of on-line hosts:
#!/bin/bash
 
  
## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
+
<ul>
## Started 2017-12-15 FRI - script to parse and show Linux kernel
+
*  https://www.wordfence.com/blog/2017/07/searchreplacedb2-security/.
## version from top-level makefile in set of kernel sources. Patterns
+
* https://www.imperva.com/blog/ransomware-attacks-on-mysql-and-mongodb/
##  to `grep` chosen based on kernel version identifiers in first
+
</ul>
##  three lines of typical kernel top-level makefile. Example:
 
##
 
##  $ head -n 6 Makefile
 
##  VERSION = 4
 
##  PATCHLEVEL = 9
 
##  SUBLEVEL = 66
 
##  EXTRAVERSION =
 
##  NAME = Roaring Lionus
 
##
 
##
 
## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
 
  
  
script_name="showkversion"
+
2019-11-12
 +
<ul>
 +
*  https://dev.mysql.com/doc/refman/5.7/en/server-logs.html
 +
*  https://www.percona.com/blog/2012/12/28/auditing-login-attempts-in-mysql/
 +
</ul>
  
  
if [ ]; then
+
* [[nn_web_site_building_blocks|Web site building blocks]] . . . now a separate wiki document, as of 2018-01-08.  - TMH
    head -n 5 Makefile | grep ^VERSION | cut -d " " -f 3
 
    head -n 5 Makefile | grep ^PATCH | cut -d " " -f 3
 
    head -n 5 Makefile | grep ^SUBLEVEL | cut -d " " -f 3
 
fi
 
  
MAJOR=$(head -n 5 Makefile | grep ^VERSION | cut -d " " -f 3)
+
2020-01-27 htpasswd access files
MINOR1=$(head -n 5 Makefile | grep ^PATCH | cut -d " " -f 3)
+
<ul>
MINOR2=$(head -n 5 Makefile | grep ^SUBLEVEL | cut -d " " -f 3)
+
*  https://www.htaccesstools.com/articles/htpasswd/
 +
</ul>
  
KERNEL_REVISION="${MAJOR}.${MINOR1}.${MINOR2}"
 
  
echo
+
<!-- comment -->
echo "Kernel version in present kernel sources tree, per makefile, is ${KERNEL_REVISION}"
 
echo
 
  
 +
== [[#top|&uarr;]] [[#references|&darr;]] Open Source License Types ==
  
exit 0
+
*  https://lukasa.co.uk/2012/05/GPL_vs_MIT_Which_License_To_Use/
</pre>
 
 
 
  
  
 
<!-- comment -->
 
<!-- comment -->
  
=== [[#top|&uarr;]] [[#references|&darr;]] Other useful shell tutorial references ===
+
<!-- SECTION - Linux packages -->
  
*  http://tldp.org/LDP/abs/html/textproc.html . . . commands cut, paste, join and others
+
== [[#top|&uarr;]] [[#references|&darr;]] Linux Packages (Separate Article) ==
*  https://unix.stackexchange.com/questions/131766/why-does-my-shell-script-choke-on-whitespace-or-other-special-characters . . . read shell input line by line
 
*  https://stackoverflow.com/questions/7427262/how-to-read-a-file-into-a-variable-in-shell . . . read file into shell variable
 
  
 +
[[nn_linux_software_package_notes|Linux software package notes]] a separate wiki document on Neela wiki.  - TMH
  
  
 
<!-- comment -->
 
<!-- comment -->
  
== [[#top|&uarr;]] [[#references|&darr;]] Regex tutorials ==
+
== - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - ==
 
 
*  https://www.ntu.edu.sg/home/ehchua/programming/howto/Regexe.html
 
  
2019-11-02 - An interesting blog post and replies, at, I think, Jamie Zawinski's home page.  This one on the use and some limits of regular expressions:
 
  
  *  https://www.jwz.org/blog/2011/11/you-doom-us-all-to-inhuman-toil-for-the-one-whose-name-cannot-be-expressed-in-the-basic-multilingual-plane/
 
  
 +
<!-- comment -->
  
<!-- comment -->
+
<!-- SECTION - Bash Shell Scripting -->
  
== [[#top|&uarr;]] &nbsp; [[#references|&darr;]] `sed` stream editor ==
+
== [[#top|&uarr;]] [[#references|&darr;]] Bash Shell Scripting ==
  
Unix `sed` stream editor, examples and references:
 
  
<Example 1 - rename multiple files where a substring need be changed:</i>
+
Bash (Bourne shell) Quick Reference:
  
 
<pre>
 
<pre>
  $ for file in `ls ./2109*.*`; do mv $file `ls -1 $file | sed s/2109/2019/` ; done
+
Shell Built-in Variables:
</pre>
 
  
References on `sed`:
+
  $0    Name of given shell script itself
 +
  $1    Value of first command line parameter (similarly $2, $3, ...)
 +
  $#    In given shell script the number of command line parameters received
 +
  $*    All of the command line parameters
 +
  $-    Options given to the shell
 +
  $?    Return (or holds) the exit status of the last command
 +
  $$    Process id of given script (really the id of the shell running the script)
  
<ul>
 
*  http://www.grymoire.com/Unix/Sed.html#uh-1
 
</ul>
 
  
 +
Shell test constructs:
  
<!-- comment -->
+
SYNTAX      NAME OF SHELL TEST                                NOTES
  
== [[#top|&uarr;]] &nbsp; [[#references|&darr;]] Other Computer Programming Languages ==
+
[           built-in test                                    considers its arguments as comparison expressions or file tests
  
 +
[[...]]    in Bash => 2.02 the extended test command
  
 +
((...))    arithmetic tests                                  example:  (( 0 && 1 ))  # Logical AND
  
<!-- comment -->
 
  
=== [[#top|&uarr;]] [[#references|&darr;]] Python Scripting Language ===
+
</pre>
  
https://docs.python.org/2/tutorial/index.html
+
<i>
 +
References:
 +
http://tldp.org/LDP/abs/html/testconstructs.html
 +
*  http://tldp.org/LDP/abs/html/internal.html#BUILTINREF
 +
*  http://tldp.org/LDP/abs/html/string-manipulation.html
 +
</i>
  
*  https://learn.onemonth.com/ruby-vs-python/
 
  
  
 +
Shell scripting and use of built-in shell commands is a practical knowledge to employ, when working in Unix-like environments.  One common task is to find all the instances of a given file or program.  The <code>locate</code> command can perform this kind of search, but it's results don't show whether the file instances differ.  To check at the rough level of file size, we can use a one-line shell script technique involving shell piping, to "long list" the results of the <code>locate</code> command, like this . . .
  
<!-- comment -->
+
<pre>
 +
  $ for file in `locate tavrasm | grep 'asm$'`; do ls -l ${file}; done
 +
</pre>
  
=== [[#top|&uarr;]] [[#references|&darr;]] Expect Utility by Don Libes ===
+
Hmm strange, the above command calls `grep` with a pattern that ends in the shell end-of-line anchoring character $, and appears to filter for results of `locate` which end in 'asm'.  But on 2017-09-12 needed to add a "one or more wildcard" character pattern to limit search results for instances of `locate` results ending in 'qemu':
  
Installing 'expect' on Ubuntu 16.04.x LTS host, typical dependencies:
+
<pre>
 +
    $ locate qemu | grep '.*qemu$'
 +
</pre>
  
<pre>
+
Why the apparent difference in command invocation?  Need to test . . .  - TMH
ted@localhost:~/projects/shell/expect-work$ sudo apt install expect
 
  
Reading package lists... Done
 
Building dependency tree     
 
Reading state information... Done
 
The following additional packages will be installed:
 
  libfontenc1 libxaw7 libxmu6 libxmuu1 libxtst6 libxv1 libxxf86dga1 tcl-expect tcl8.6 tk8.6 x11-utils xbitmaps xterm
 
Suggested packages:
 
  tcl-tclreadline mesa-utils xfonts-cyrillic
 
The following NEW packages will be installed:
 
  expect libfontenc1 libxaw7 libxmu6 libxmuu1 libxtst6 libxv1 libxxf86dga1 tcl-expect tcl8.6 tk8.6 x11-utils xbitmaps xterm
 
0 upgraded, 14 newly installed, 0 to remove and 5 not upgraded.
 
Need to get 1,373 kB of archives.
 
After this operation, 4,110 kB of additional disk space will be used.
 
Do you want to continue? [Y/n] y
 
  .
 
  .
 
  .
 
</pre>
 
  
  
Some 'expect' utility references:
+
Command to break out first ten $PATH environment variable to individual paths each shown on a line of the shell:
  
*  https://www.unix.com/shell-programming-and-scripting/176054-multiple-while-loops-expect-script.html?s=3aa3009c43b2e834326eea6dfa0d1139
+
<pre>
 +
    $ for path in `echo $PATH | cut -d':' -f1-10 --output-delimiter=' '`; do echo $path; done
 +
</pre>
  
Good short examples covering range of tasks here at Robert Elder blog page, noting md5sum expect script example . . .
+
2018-04-23 - Monday, command to obtain summary of directories containing 1GB or more data:
*  http://blog.robertelder.org/don-libes-expect-unix-automation-tool/
+
<pre>
 +
    $ du -h . | grep [0-9]G
 +
</pre>
  
*  https://www.ibm.com/developerworks/community/blogs/brian/entry/when_to_use_expect_scripting_and_when_to_avoid_it10?lang=en Expect script with while-loop
 
  
*  https://wiki.tcl.tk/11584 list of Expect tutorials
 
  
*  https://debaan.blogspot.com/2007/09/simple-expect-ssh-example.html
 
  
*  http://wiki.tcl.tk/11583
+
=== <i> [[#top|&uarr;]] [[#references|&darr;]] edit point - shell variable quoting</i> ===
  
How to capture specific results during an expect script's execution:
+
- 2017-10-19 THU -
*  https://stackoverflow.com/questions/2077721/how-do-you-save-and-parse-a-command-output-in-expect
 
  
 +
Running into issues when need to expand shell variable in single quotes pair . . .
  
- 2018-01-30 - Tuesday, picking up from last week researching how to redirect expect output and its spawned processes' output with filtering to log file.  The first reference here at Stackoverflow repeats the useful <code>lindex</code> syntax.  There is also mention of the <code>expect</code> manual and a syntax <code>$::env(action)</code> which can be expressed in an expect script to access an environment variable that is part of the controlling shell . . .
+
[https://unix.stackexchange.com/questions/178411/how-to-use-variables-inside-single-quotes Stack Exchange, Unix forum post 178411]<br />
https://stackoverflow.com/questions/11131318/how-to-use-bash-script-variables-in-expect-conditional-statements
+
[http://tldp.org/LDP/abs/html/varassignment.html TLPD Advanced Bash Scripting Guide, chapter 4.2 example 4-3 double quotes preserve white space]<br />
  
How to use expect's <code>log_file</code> key word in an expect script:
 
*  https://stackoverflow.com/questions/15965504/how-to-create-log-file-for-tcl-script
 
  
From the manual page for expect version 5.45:
+
WIKI WISH LIST - While adding to wiki, Ted noting that would be useful to have relative-depth wiki section markers. The standard wiki section markers '== ==', '=== ===' and similar have fixed depth.  That is, '== ==' is always a top-level or first-level section in a wiki document, '=== ===' is always a sub-subsection of wiki documents, and '==== ====' a sub-sub-section.  When section gets re-factored into its own article, would be handy to have those section markers rise up to levels of top-most and successive section markers.  - TMH
  
<ul>
 
<i>
 
<pre>
 
      log_file [args] [[-a] file]
 
            If a filename is provided, log_file will record a transcript of the session (beginning at that point) in
 
            the file.  log_file will stop recording if no argument is given.  Any previous log file is closed.
 
  
            Instead  of  a  filename,  a Tcl file identifier may be provided by using the -open or -leaveopen flags.
 
            This is similar to the spawn command.  (See spawn for more info.)
 
  
            The -a flag forces output to be logged that was suppressed by the log_user command.
+
<!-- comment -->
  
            By default, the log_file command appends to old files rather than truncating them, for  the  convenience
+
=== [[#top|&uarr;]] [[#references|&darr;]] example shell script - back up several databases ===
            of  being  able  to  turn  logging off and on multiple times in one session.  To truncate files, use the
 
            -noappend flag.
 
  
            The -info flag causes log_file to return a description of the most recent non-info arguments given.
+
&nbsp;<br />
</pre>
+
Here is a simple shell script to call mysqldump utility and back up several databases.  Couple of things Ted wants to add to this script include script variables to hold back-up filename prefix and infix patterns, and an option to compress the MYSQL dump files . . .
</i>
 
</ul>
 
  
 +
<i>Figure x - shell script to back-up multiple MYSQL databases</i>
  
Also from the expect manual page, Expect Hints section:
 
 
<ul>
 
<i>
 
 
<pre>
 
<pre>
EXPECT HINTS
 
      There are a couple of things about Expect that may be non-intuitive.  This section attempts to address some of
 
      these things with a couple of suggestions.
 
  
      A common expect problem is how to recognize shell prompts.  Since these are customized differently by  differ-
+
#!/bin/bash
      ently  people and different shells, portably automating rlogin can be difficult without knowing the prompt.  A
 
      reasonable convention is to have users store a regular expression describing their prompt (in particular,  the
 
      end  of it) in the environment variable EXPECT_PROMPT.  Code like the following can be used.  If EXPECT_PROMPT
 
      doesn't exist, the code still has a good chance of functioning correctly.
 
  
          set prompt "(%|#|\\$) $"          ;# default prompt
 
          catch {set prompt $env(EXPECT_PROMPT)}
 
  
          expect -re $prompt
+
DATABASE_LIST="information_schema mysql drupal_8p0 phpmyadmin wiki_database"
  
      I encourage you to write expect patterns that include the end of whatever you expect to see.  This avoids  the
+
user="root"
      possibility  of  answering a question before seeing the entire thing.  In addition . . .
+
pass_phrase_for_mysql="mysql_user_password"
</pre>
+
options_extra="--skip-lock-tables"
</i>
 
</ul>
 
  
 +
response="n"
  
The expect program has some built-in string buffers, and one of these may hold the latest characters received from a spawned process.  Here is a man page excerpt which shows use of one of these expect buffers:
+
mode_interactive="n"
  
<ul>
 
<i>
 
<pre>
 
      disconnect
 
            disconnects a forked process from the terminal.  It continues running in the background.  The process is
 
            given its own process group (if possible).  Standard I/O is redirected to /dev/null.
 
  
            The following fragment uses disconnect to continue running the script in the background.
 
  
                if {[fork]!=0} exit
+
echo "shell script starting,"
                disconnect
 
                . . .
 
  
            The following script reads a password, and then runs a program every hour that demands a  password  each
 
            time  it is run.  The script supplies the password so that you only have to type it once.  (See the stty
 
            command which demonstrates how to turn off password echoing.)
 
  
                send_user "password?\ "
 
                expect_user -re "(.*)\n"
 
                for {} 1 {} {
 
                    if {[fork]!=0} {sleep 3600;continue}
 
                    disconnect
 
                    spawn priv_prog
 
                    expect Password:
 
                    send "$expect_out(1,string)\r"
 
                    . . .
 
                    exit
 
                }
 
</pre>
 
</i>
 
</ul>
 
  
 +
for database in ${DATABASE_LIST};
 +
do echo "backing up alta-ubuntu database $database . . .";
  
Further looking for expect's built-in string buffers and variables . . .
+
#    command="mysqldump --databases $database -u$user -p$pass_phrase_for_mysql $options_extra >> au-database-back-up--${database}.sql"
 +
    command="mysqldump --databases $database -u$user -p$pass_phrase_for_mysql $options_extra"
 +
    redirect="au-database-back-up--${database}.sql"
  
*  http://wiki.tcl.tk/17378
+
    if [ $mode_interactive = 'y' ]; then
  
Pattern matching syntax in Don Libe's expect . . .
+
        echo "build command '$command' and database back-up filename'$redirect',"
 +
        echo "full command will be '$command' > '$redirect',"
 +
        echo "trying running this command and redirect? [y/N/q]  yes, no, 'q' to quit"
  
*  http://www.embecosm.com/appnotes/ean8/html/ch03s02s01.html
+
        read response
 +
        if [ $response = 'Y' -o $response = 'y' ]; then
 +
            ${command} > $redirect
 +
        elif [ $response = 'N' -o $response = 'n' ]; then
 +
            echo "skipping present command . . ."
 +
        elif [ $response = 'Q' -o $response = 'q' ]; then
 +
            echo "stopping script '$0' and exiting."
 +
            break
 +
        fi
 +
        echo
  
*  https://www.pantz.org/software/expect/expect_examples_and_tips.html . . . some timing stuff and <b>expect script blocks</b>
+
    else
  
* http://www.asic-world.com/scripting/tcl3.html . . . regex in Tcl must enclose pattern in braces.
+
        echo "$0: backing up database '$database' to file '$redirect' . . ."
 +
        ${command} > $redirect
 +
        ls -l $redirect
  
 +
    fi
  
 +
done
  
From another source, Tcl's string match command:
 
  
if [string match "f*b*" "foobar"] {
+
echo "done."
    puts "match"
 
else {
 
    puts "no match"
 
}
 
  
 
+
exit 0
 
 
<!-- comment -->
 
 
 
=== <i>[[#top|&uarr;]] [[#references|&darr;]] edit point - Tool command language Tcl </i> ===
 
 
 
 
 
<pre>
 
"Practical programming
 
in Tcl and Tk"
 
ISBN 0-13-038560-3
 
 
</pre>
 
</pre>
  
 +
=== [[#top|&uarr;]] [[#references|&darr;]] show kernel version script ===
  
In using Don Libes' <code>expect</code> utility or program, looks like it will be important and helpful to understand Tool Command Language Tcl to at least some fluency.  Here appears to be a good starting point tutorial for Tcl:
+
Following script 'showkversion' can be used in a Linux kernel source tree to determine the kernel's version number, based on the number elements defined in the kernel's top level makefile.
 
 
*  https://www.tutorialspoint.com/tcl-tk/tcl_commands.htm
 
  
 
+
<i>Figure x - simple bash script to show kernel version in root of kernel sources tree</i>
Tcl <code>puts</code> built-in command, channels and code to open log file,
 
*  https://www.tcl.tk/man/tcl8.4/TclCmd/puts.htm
 
  
 
<pre>
 
<pre>
Append a log message to a file:
+
#!/bin/bash
  
set chan [open my.log a]
+
## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
set timestamp [clock format [clock seconds]]
+
## Started 2017-12-15 FRI - script to parse and show Linux kernel
puts $chan "$timestamp - Hello, World!"
+
##  version from top-level makefile in set of kernel sources. Patterns
close $chan
+
##  to `grep` chosen based on kernel version identifiers in first
</pre>
+
##  three lines of typical kernel top-level makefile.  Example:
 +
##
 +
##  $ head -n 6 Makefile
 +
##  VERSION = 4
 +
##  PATCHLEVEL = 9
 +
##  SUBLEVEL = 66
 +
##  EXTRAVERSION =
 +
##  NAME = Roaring Lionus
 +
##
 +
##
 +
## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
  
  
Tcl regular expressions:
+
script_name="showkversion"
  
*  https://www.tcl.tk/man/tcl8.2.3/TclCmd/re_syntax.htm
 
  
 +
if [ ]; then
 +
    head -n 5 Makefile | grep ^VERSION | cut -d " " -f 3
 +
    head -n 5 Makefile | grep ^PATCH | cut -d " " -f 3
 +
    head -n 5 Makefile | grep ^SUBLEVEL | cut -d " " -f 3
 +
fi
  
Tcl reserved words:
+
MAJOR=$(head -n 5 Makefile | grep ^VERSION | cut -d " " -f 3)
 +
MINOR1=$(head -n 5 Makefile | grep ^PATCH | cut -d " " -f 3)
 +
MINOR2=$(head -n 5 Makefile | grep ^SUBLEVEL | cut -d " " -f 3)
  
<pre>
+
KERNEL_REVISION="${MAJOR}.${MINOR1}.${MINOR2}"
after append array auto_execok
+
 
auto_import auto_load auto_load_index auto_qualify
+
echo
binary Bgerror break catch
+
echo "Kernel version in present kernel sources tree, per makefile, is ${KERNEL_REVISION}"
cd Clock close concat
+
echo
continue Dde default else
+
 
elseif Encoding eof error
+
 
eval Exec exit expr
+
exit 0
fblocked Fconfigure fcopy file
 
fileevent Flush for foreach
 
format Gets glob global
 
history If info interp
 
join Lappend lindex linsert
 
list Llength load lrange
 
lreplace Lsearch lsort namespace
 
open Package pid pkg_mkIndex
 
proc Puts pwd read
 
regexp Regsub rename resource
 
return Scan seek set
 
socket Source split string
 
subst Switch tclLog tell
 
time Trace unknown unset
 
update Uplevel upvar variable
 
vwait While
 
 
</pre>
 
</pre>
  
Line 812: Line 911:
 
<!-- comment -->
 
<!-- comment -->
  
=== <i>[[#top|&uarr;]] [[#references|&darr;]] edit point - Tcl pattern matching and anchoring, symbols ^ and $ wrt data not lines</i> ===
+
=== [[#top|&uarr;]] [[#references|&darr;]] Other useful shell tutorial references ===
 +
 
 +
*  http://tldp.org/LDP/abs/html/textproc.html . . . commands cut, paste, join and others
 +
*  https://unix.stackexchange.com/questions/131766/why-does-my-shell-script-choke-on-whitespace-or-other-special-characters . . . read shell input line by line
 +
*  https://stackoverflow.com/questions/7427262/how-to-read-a-file-into-a-variable-in-shell . . . read file into shell variable
 +
 
 +
 
  
From the Tcl manual page on-line here is a clue about pattern matching in Tcl scripts, which may explain why we are struggling to obtain matched substrings from sequences of bytes from expect-spawned processes . . .
+
<!-- comment -->
  
<ul>
+
== [[#top|&uarr;]] [[#references|&darr;]] Regex tutorials ==
<i>
 
<pre>
 
    Note that in many editors, the ^ and $ match the beginning and end of lines respectively. However, because expect is not line oriented, these characters match the beginning and end of the data (as opposed to lines) currently in the expect matching buffer. (Also, see the note below on "system indigestion.")
 
</pre>
 
</i>
 
</ul>
 
  
 +
*  https://www.ntu.edu.sg/home/ehchua/programming/howto/Regexe.html
  
Tcl regular expression syntax:
+
2019-11-02 - An interesting blog post and replies, at, I think, Jamie Zawinski's home page.  This one on the use and some limits of regular expressions:
  
*  https://www.tcl.tk/man/tcl8.2.3/TclCmd/re_syntax.htm#M57
+
  *  https://www.jwz.org/blog/2011/11/you-doom-us-all-to-inhuman-toil-for-the-one-whose-name-cannot-be-expressed-in-the-basic-multilingual-plane/
  
  
Expect variables, using global and upvar keywords in Tcl scripts:
+
<!-- comment -->
  
*  http://www.huecker.com/msw/tcl/tutorial/Tcl13.shtml
+
== [[#top|&uarr;]] [[#references|&darr;]] `sed` stream editor ==
  
 +
Unix `sed` stream editor, examples and references:
  
Excerpt on Tcl pattern matching from Inguza web site:
+
<i>Code snippet - rename multiple files where a substring need be changed:</i>
  
 
<pre>
 
<pre>
2  Expect
+
  $ for file in `ls ./2109*.*`; do mv $file `ls -1 $file | sed s/2109/2019/` ; done
The expect suite actually consist just of a few commands: expect, send, spawn and interact and is an extension to TCL.
+
</pre>
Before the expect command can be used a program must be spawned, see expect commands below.
+
 
expect \
+
References on `sed`:
  {match1} {action1} \
+
 
  {match2} {action2} \
+
*  http://www.grymoire.com/Unix/Sed.html#uh-1
  {match3} {action3} \
+
 
  {match4} {action4}
+
2021-08-26:
It is possible that no such output is encountered within the time period defined by the timeout (variable name "timeout" in seconds, default to 2). In this case expect stops waiting and continues with the next command in the script.
+
* https://unix.stackexchange.com/questions/375530/use-sed-to-find-and-replace-a-string-in-multiple-files
You can use '*' to match any characters. You can also match using [] syntax and similar.
+
 
expect "\[a-f0-9]"  ; # strongly preferred as \n and similar is not taken as litteral charactesr \ and n.
+
<!-- comment -->
expect {a-f0-9}    ; # can also be used
+
 
A note on \ characters. The pattern matcher translate \x to x but this is done once before the pattern matcher. So you need to type \\n to match n. This is especially important for * and ? characters.
+
== [[#top|&uarr;]] [[#references|&darr;]] Other Computer Programming Languages ==
expect "*" ;# match anything (*)
+
 
expect "\n" ;# match linefeed
+
 
expect "\*" ;# match anything
+
 
expect "\\*" ;# match * character
+
<!-- comment -->
expect "\\\*" ;# match * character
+
 
expect "\\\\*" ;# match \ followed by anything
+
=== [[#top|&uarr;]] [[#references|&darr;]] Python Scripting Language ===
expect "\\\\\*" ;# match \ followed by anything
+
 
expect "\\\\\\*" ;# match \ followed * character
+
*  https://docs.python.org/2/tutorial/index.html
The [ character is special to both tcl and the pattern matcher so it is especially messy.
+
 
proc xy {} { return "n*w" }
+
* https://learn.onemonth.com/ruby-vs-python/
expect "[xy]" ;# match n followed by anything followed by w
+
 
expect "\[xy]" ;# match x or y
+
 
expect "\\[xy]" ;# match n followed by anything followed by w
+
 
expect "\\\[xy]" ;# match [xy]
+
<!-- comment -->
expect "\\\\[xy]" ;# match \ followed by n followed ...
+
 
expect "\\\\\[xy]" ;# match sequence of \ and then x or y.
+
=== [[#top|&uarr;]] [[#references|&darr;]] Expect Utility by Don Libes ===
The expect command can also take flags. The default flag is -gl for glob pattern matching. It can also take the flag -re for regular expression matching.
+
 
expect {
+
Installing 'expect' on Ubuntu 16.04.x LTS host, typical dependencies:
  -re "a*" { action_when_a_followed_by_any_a }
+
 
  "b*" { action_when_b_followed_by_anything }
+
<pre>
  -gl "-re" { action_when_real_dash_r_e }
+
ted@localhost:~/projects/shell/expect-work$ sudo apt install expect
  eof { action_on_end_of_file }
+
 
  timeout { action_on_command_timeout }
+
Reading package lists... Done
  default { action_on_command_timeout_or_eof }
+
Building dependency tree     
  -re "(abc)*" { action_on_any_number_of_a_b_c }
+
Reading state information... Done
  -re "-?(0|\[1-9]\[0-9]*)?\\.?\[0-9]*" { action_on_float_or_integer }
+
The following additional packages will be installed:
}
+
  libfontenc1 libxaw7 libxmu6 libxmuu1 libxtst6 libxv1 libxxf86dga1 tcl-expect tcl8.6 tk8.6 x11-utils xbitmaps xterm
You can also pass the pattern as a variable.
+
Suggested packages:
set v2pats "pat2 act2"
+
   tcl-tclreadline mesa-utils xfonts-cyrillic
set v3pats "pat3 act3"
+
The following NEW packages will be installed:
expect pat1 act1 $v2pats $v3pats
+
  expect libfontenc1 libxaw7 libxmu6 libxmuu1 libxtst6 libxv1 libxxf86dga1 tcl-expect tcl8.6 tk8.6 x11-utils xbitmaps xterm
Observe that the following expect string is wrong as $v2pats and $v3pats is considered as two different arguments. It will try to match $v2pats as a pattern and $v3pats as an action. Instead build up a string and use the -brace flag. You can not use double quotes for that though, unless you use eval and then the -brace flag is not necessary. You also need to protect the pattern and action inside a [list x] or an extra brace if they contain whitespaces.
+
0 upgraded, 14 newly installed, 0 to remove and 5 not upgraded.
2.1  Parentheses for feedback
+
Need to get 1,373 kB of archives.
In the previous section, parantheses were used to group subpatterns together. They can also play another role. When a regular expression successfully matches a string each part of the string that matches a paranthensized subpattern is stored in "expect_out(1,string)" the second in "expect_out(2,string)" etc up to "expect_out(9,string)". The entire pattern matched is stored in "expect_out(0,string)". Everthing before the pattern and the pattern matched is stored in "expect_out(buffer)". The last two assignments work in glob pattern too.
+
After this operation, 4,110 kB of additional disk space will be used.
"a*((ab)*|b)"
+
Do you want to continue? [Y/n] y
How is this passed to expect_out? It is quite simple. The entire string withing the first parenthesis is stored in 1 (which means up to end of string). The second fount parenthesis is stored in 2. Look for the left parenthesis to determine where the data is put.
+
  .
2.2   Flags
+
  .
-re
+
  .
-gl
+
</pre>
-nocase Ignore case. Do not use -nocase with uppercase characters in the pattern as it will never match.
+
 
-notransfer Prevent expect from removing matching characters from the internal buffer. The characters can be matched repeatedly as long as this option is associated with the pattern. It can be abbreviated with "-n" when expect is running interactively.
+
 
-brace Expect normally see the first argument as a pattern to match, but sometimes you want to give a list of patterns and actions to expect. You can then use -brace to expand the list before it is handled by expect.
+
Some 'expect' utility references:
expect -brace { pat1 act1 pat2 act2 }
+
 
This can be useful when building up lists of pattern to match with corresponding actions to do.
+
* https://www.unix.com/shell-programming-and-scripting/176054-multiple-while-loops-expect-script.html?s=3aa3009c43b2e834326eea6dfa0d1139
-i n Use an alternative spawn_id. This applies to all patterns after the -i flag.
+
 
expect {
+
Good short examples covering range of tasks here at Robert Elder blog page, noting md5sum expect script example . . .
-i $ftp
+
*  http://blog.robertelder.org/don-libes-expect-unix-automation-tool/
"ftp>" "exit"
+
 
eof "exit"
+
*  https://www.ibm.com/developerworks/community/blogs/brian/entry/when_to_use_expect_scripting_and_when_to_avoid_it10?lang=en Expect script with while-loop
}
+
 
You can also expect values from multiple spawned processes at the same time. At most one action can be executed just as expect normally do.
+
*  https://wiki.tcl.tk/11584 list of Expect tutorials
expect {
+
 
  -i $ftp "ftp> " { ftp_action }
+
*  https://debaan.blogspot.com/2007/09/simple-expect-ssh-example.html
-i $shell $prompt { shell_action }
+
 
}
+
*  http://wiki.tcl.tk/11583
There is an input buffer associated with each spawn id. So any output from ftp is kept separate from thta of the shell in the example above. When output appear on terminal it will be mixed, unless you expect one at a time or set log_user 0 and then wrote output explictly using send_user $expect_out(buffer). The process that did not match will keep its buffer until matched by next expect command.
+
 
When the expect command match something it record the spawn_id to expect_out(spawn_id) so you can know which process that it matched against.
+
How to capture specific results during an expect script's execution:
You can also set the spawn_id definition to a list of spawn_ids.
+
*  https://stackoverflow.com/questions/2077721/how-do-you-save-and-parse-a-command-output-in-expect
expect {
 
  -i "$host1 $host2 $host3" $prompt {
 
    an_action $expect_out(spawn_id)
 
  }
 
  eof exit
 
  -i $host1 another_pattern {host1_action}
 
}
 
This example will do an_action if $prompt is matched agains any of the $hostnr, exit if end of file is matched against same list and do host1_action if matchina another_pattern from host1.
 
2.3  Special patterns
 
Note that these patcherns will only match if none of the '-gl', '-re' or '-ex' flags has been used.
 
eof Match when end of file is reached.
 
timeout Match when the timeout value has been reached.
 
default Match when end of file or timeout is reached.
 
full_buffer Match when no other pattern match and expect would otherwise throw away part of the input to make room fore more. When this matches, all of the unmatched input is moved to expect_out(buffer).
 
null
 
By default null characters are removed from the buffer before expect matching is done. This can be disabled using the remove_nulls command below. If it is disabled null characters will be matched using this special keyword. Null characters can not be matched inside a pattern as expect first look for null characters and then do pattern matching. If a null character is found the characters before it is skilled. These caracters can be found in expect_out(buffer).
 
Since the null character is used internally to represent the end of a string unanchored patterns cannot be matched past a null. This is not a problem since null pattern can always be listed last.
 
  
</pre>
 
  
 +
- 2018-01-30 - Tuesday, picking up from last week researching how to redirect expect output and its spawned processes' output with filtering to log file.  The first reference here at Stackoverflow repeats the useful <code>lindex</code> syntax.  There is also mention of the <code>expect</code> manual and a syntax <code>$::env(action)</code> which can be expressed in an expect script to access an environment variable that is part of the controlling shell . . .
 +
*  https://stackoverflow.com/questions/11131318/how-to-use-bash-script-variables-in-expect-conditional-statements
  
<!-- comment -->
+
How to use expect's <code>log_file</code> key word in an expect script:
 +
*  https://stackoverflow.com/questions/15965504/how-to-create-log-file-for-tcl-script
  
=== [[#top|&uarr;]] [[#references|&darr;]] Rust programming language ===
+
From the manual page for expect version 5.45:
  
There are two editions of the Rust Programming bookThe Rust home page recommends to start by reading the second edition:
+
<ul>
* https://doc.rust-lang.org/book/second-edition/
+
<i>
 +
<pre>
 +
      log_file [args] [[-a] file]
 +
            If a filename is provided, log_file will record a transcript of the session (beginning at that point) in
 +
            the filelog_file will stop recording if no argument is given. Any previous log file is closed.
  
* https://doc.rust-lang.org/nomicon/
+
            Instead of  a  filename,  a Tcl file identifier may be provided by using the -open or -leaveopen flags.
 +
            This is similar to the spawn command. (See spawn for more info.)
  
 +
            The -a flag forces output to be logged that was suppressed by the log_user command.
  
=== [[#top|^]] C programming notes ===
+
            By default, the log_file command appends to old files rather than truncating them, for  the  convenience
 +
            of  being  able  to  turn  logging off and on multiple times in one session.  To truncate files, use the
 +
            -noappend flag.
  
This section really should be in a more prominent space of this wiki. - TMH
+
            The -info flag causes log_file to return a description of the most recent non-info arguments given.
 +
</pre>
 +
</i>
 +
</ul>
  
Click here -> [[c_programming_notes|C programming notes]] <- for separate wiki article.
 
  
Typedef and type defining function pointers:
+
Also from the expect manual page, Expect Hints section:
  
 
<ul>
 
<ul>
*  2019-06-11 https://www.learncpp.com/cpp-tutorial/78-function-pointers/
+
<i>
</ul>
+
<pre>
 +
EXPECT HINTS
 +
      There are a couple of things about Expect that may be non-intuitive. This section attempts to address some of
 +
      these things with a couple of suggestions.
  
CRC types and implementations:
+
      A common expect problem is how to recognize shell prompts.  Since these are customized differently by  differ-
 +
      ently  people and different shells, portably automating rlogin can be difficult without knowing the prompt.  A
 +
      reasonable convention is to have users store a regular expression describing their prompt (in particular,  the
 +
      end  of it) in the environment variable EXPECT_PROMPT.  Code like the following can be used.  If EXPECT_PROMPT
 +
      doesn't exist, the code still has a good chance of functioning correctly.
  
<ul>
+
          set prompt "(%|#|\\$) $"          ;# default prompt
*  https://stackoverflow.com/questions/10564491/function-to-calculate-a-crc16-checksum
+
          catch {set prompt $env(EXPECT_PROMPT)}
</ul>
 
  
Floating point representation and conversions:
+
          expect -re $prompt
  
<ul>
+
      I encourage you to write expect patterns that include the end of whatever you expect to see.  This avoids  the
* http://www.ryanjuckett.com/programming/printing-floating-point-numbers/
+
      possibility of  answering a question before seeing the entire thing.  In addition . . .
 +
</pre>
 +
</i>
 
</ul>
 
</ul>
  
  
<!-- comment -->
+
The expect program has some built-in string buffers, and one of these may hold the latest characters received from a spawned process. Here is a man page excerpt which shows use of one of these expect buffers:
 
 
=== [[#top|^]] C++ references ===
 
 
 
This section contains beginning level C++ issues and references.  Section here created by need to note some Qt5 related project elements, as Qt is based on C++.  First issue is to understand and document how to implement a QDialog object to act as a sensible dialog box, which can post run-time data to a larger Qt based application.  The first reference below mentions QDialog built-in class functions exec(), accept() and reject(), which appear to be the means to start and show, and to close out a Qt based dialog box . . .
 
  
 
<ul>
 
<ul>
* https://stackoverflow.com/questions/12470806/qdialog-exec-and-getting-result-value
+
<i>
</ul>
+
<pre>
 +
      disconnect
 +
            disconnects a forked process from the terminal.  It continues running in the background. The process is
 +
            given its own process group (if possible). Standard I/O is redirected to /dev/null.
 +
 
 +
            The following fragment uses disconnect to continue running the script in the background.
  
Per help index in QtCreator 3.2.1:
+
                if {[fork]!=0} exit
 +
                disconnect
 +
                . . .
  
<i>
+
            The following script reads a password, and then runs a program every hour that demands a  password  each
<pre>
+
            time  it is run.  The script supplies the password so that you only have to type it once.  (See the stty
void QDialog::accept() [virtual slot]
+
            command which demonstrates how to turn off password echoing.)
Hides the modal dialog and sets the result code to Accepted.
 
  
See also reject() and done().
+
                send_user "password?\ "
 +
                expect_user -re "(.*)\n"
 +
                for {} 1 {} {
 +
                    if {[fork]!=0} {sleep 3600;continue}
 +
                    disconnect
 +
                    spawn priv_prog
 +
                    expect Password:
 +
                    send "$expect_out(1,string)\r"
 +
                    . . .
 +
                    exit
 +
                }
 
</pre>
 
</pre>
 
</i>
 
</i>
 +
</ul>
  
  
The Qt method <code>done()</code> performs more significant work and at least in cases of a dialog being shown with a call to <code>exec()</code> the done() method stops dialog event loop execution:
+
Further looking for expect's built-in string buffers and variables . . .
  
<i>
+
*  http://wiki.tcl.tk/17378
<pre>
 
void QDialog::done(int r) [virtual slot]
 
Closes the dialog and sets its result code to r. If this dialog is shown with exec(), done() causes the local event loop to finish, and exec() to return r.
 
  
As with QWidget::close(), done() deletes the dialog if the Qt::WA_DeleteOnClose flag is set. If the dialog is the application's main widget, the application terminates. If the dialog is the last window closed, the QApplication::lastWindowClosed() signal is emitted.
+
Pattern matching syntax in Don Libe's expect . . .
  
See also accept(), reject(), QApplication::activeWindow(), and QApplication::quit().
+
*  http://www.embecosm.com/appnotes/ean8/html/ch03s02s01.html
</pre>
 
</i>
 
  
 +
*  https://www.pantz.org/software/expect/expect_examples_and_tips.html . . . some timing stuff and <b>expect script blocks</b>
  
So it looks like if we do not call done() then we want to assure that we call exec() only one time during a use session of GWN Unified Tester. - TMH
+
*  http://www.asic-world.com/scripting/tcl3.html . . . regex in Tcl must enclose pattern in braces.
  
  
<!-- comment -->
 
2019-10-28 Monday:
 
G++ error, "template has C linkage":
 
  
*  https://stackoverflow.com/questions/4877705/why-cant-templates-be-within-extern-c-blocks
+
From another source, Tcl's string match command:
  
2019-10-30 Wednesday:
+
if [string match "f*b*" "foobar"] {
The purposes and use of extern "C" . . .
+
    puts "match"
<ul>
+
else {
* https://stackoverflow.com/questions/1041866/what-is-the-effect-of-extern-c-in-c
+
    puts "no match"
</ul>
+
  }
  
  
Line 1,020: Line 1,130:
 
<!-- comment -->
 
<!-- comment -->
  
== - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - ==
+
=== <i>[[#top|&uarr;]] [[#references|&darr;]] edit point - Tool command language Tcl </i> ===
  
  
 +
<pre>
 +
"Practical programming
 +
in Tcl and Tk"
 +
ISBN 0-13-038560-3
 +
</pre>
  
<!-- comment -->
 
  
<!-- SECTION - Aboriginal Linux -->
+
In using Don Libes' <code>expect</code> utility or program, looks like it will be important and helpful to understand Tool Command Language Tcl to at least some fluency.  Here appears to be a good starting point tutorial for Tcl:
  
== [[#top|&uarr;]] [[#references|&darr;]] Aboriginal Linux - project now defunct, new project is 'makeroot' ==
+
*  https://www.tutorialspoint.com/tcl-tk/tcl_commands.htm
  
  
Ok, looks like Robert Landley's [https://landley.net/aboriginal/about.html Aboriginal Linux] project has been superceded by [http://landley.net/aboriginal/ mkroot]. Ladnley's newer makeroot project sources are available at GitHub:
+
Tcl <code>puts</code> built-in command, channels and code to open log file,
 +
https://www.tcl.tk/man/tcl8.4/TclCmd/puts.htm
  
 +
<pre>
 +
Append a log message to a file:
  
[https://github.com/landley/mkroot makeroot project on GitHub]
+
set chan [open my.log a]
 +
set timestamp [clock format [clock seconds]]
 +
puts $chan "$timestamp - Hello, World!"
 +
close $chan
 +
</pre>
  
  
Having trouble carrying out the basic build of Aboriginal Linux with armv6l as target . . .
+
Tcl regular expressions:
  
<pre>
+
*  https://www.tcl.tk/man/tcl8.2.3/TclCmd/re_syntax.htm
  
  .
 
  .
 
  .
 
  
Confirmed e2fsprogs-1.42.13.tar.gz
+
Tcl reserved words:
Confirmed zlib-1.2.7.tar.bz2
 
Confirmed squashfs-4.2.tar.gz
 
=== Got all source.
 
 
 
real    0m2.240s
 
user    0m1.188s
 
sys    0m0.176s
 
=== toybox (host host-tools)
 
Snapshot 'toybox'...
 
scripts/genconfig.sh
 
cc -o kconfig/conf kconfig/conf.c kconfig/zconf.tab.c -DKBUILD_NO_NLS=1 \
 
                -DPROJECT_NAME=\"ToyBox\"
 
kconfig/conf -D /dev/null Config.in > /dev/null
 
scripts/make.sh
 
Generate headers from toys/*/*.c...
 
generated/newtoys.h Library probe.......
 
Make generated/config.h from .config.
 
generated/flags.h generated/globals.h generated/help.h
 
Compile toybox................................................................................................................................................................generated/obj/nsenter.o: In function `unshare_main':
 
nsenter.c:(.text.unshare_main+0x152): undefined reference to `setns'
 
collect2: error: ld returned 1 exit status
 
make: *** [toybox] Error 1
 
 
 
Exiting due to errors (host host-tools toybox)
 
  
 +
<pre>
 +
after append array auto_execok
 +
auto_import auto_load auto_load_index auto_qualify
 +
binary Bgerror break catch
 +
cd Clock close concat
 +
continue Dde default else
 +
elseif Encoding eof error
 +
eval Exec exit expr
 +
fblocked Fconfigure fcopy file
 +
fileevent Flush for foreach
 +
format Gets glob global
 +
history If info interp
 +
join Lappend lindex linsert
 +
list Llength load lrange
 +
lreplace Lsearch lsort namespace
 +
open Package pid pkg_mkIndex
 +
proc Puts pwd read
 +
regexp Regsub rename resource
 +
return Scan seek set
 +
socket Source split string
 +
subst Switch tclLog tell
 +
time Trace unknown unset
 +
update Uplevel upvar variable
 +
vwait While
 
</pre>
 
</pre>
 
*  [http://man7.org/linux/man-pages/man2/setns.2.html Linux kernel routine to setns()]
 
 
 
Robert Landley also has a presence on [https://www.patreon.com/landley www.patreon.com/landley], where he talks about the over-arching goals in his programming and software systems level work.
 
  
  
Line 1,082: Line 1,195:
 
<!-- comment -->
 
<!-- comment -->
  
<!-- SECTION - Linux From Scratch 8.1 - Separate Article -->
+
=== <i>[[#top|&uarr;]] [[#references|&darr;]] edit point - Tcl pattern matching and anchoring, symbols ^ and $ wrt data not lines</i> ===
  
== [[#top|&uarr;]] [[#references|&darr;]] Linux From Scratch (Separate Article) ==
+
From the Tcl manual page on-line here is a clue about pattern matching in Tcl scripts, which may explain why we are struggling to obtain matched substrings from sequences of bytes from expect-spawned processes . . .
  
[[LFS-book-8p1-notes|Linux From Scratch Book 8.1 - Build and Notes]]
+
<ul>
 +
<i>
 +
<pre>
 +
    Note that in many editors, the ^ and $ match the beginning and end of lines respectively. However, because expect is not line oriented, these characters match the beginning and end of the data (as opposed to lines) currently in the expect matching buffer. (Also, see the note below on "system indigestion.")
 +
</pre>
 +
</i>
 +
</ul>
  
  
 +
Tcl regular expression syntax:
  
<!-- comment -->
+
*  https://www.tcl.tk/man/tcl8.2.3/TclCmd/re_syntax.htm#M57
  
<!-- SECTION - QEMU Emulator -->
 
  
== [[#top|&uarr;]] [[#references|&darr;]] QEMU Emulator ==
+
Expect variables, using global and upvar keywords in Tcl scripts:
  
<b>Overview</b>
+
*  http://www.huecker.com/msw/tcl/tutorial/Tcl13.shtml
  
Notes on QEMU, an emulator which can help with building and configuring Linux systems to run on embedded computers and development boards.  Ted noting 2017-09-08 that to compile today's latest QEMU source, a 2.10.x release, needed to install Debian stretch packages pkg-config, libglib2.0-dev, dhautoreconf.  Here are some links to downloading QEMU project sources, a manual for using QEMU, and an article about emulating a RaspberryPi system by using QEMU:
 
  
 +
Excerpt on Tcl pattern matching from Inguza web site:
  
<b>References:</b>
+
<pre>
 
+
2  Expect
*  [https://www.qemu.org/download/#source QEMU Emulator, source code download site]
+
The expect suite actually consist just of a few commands: expect, send, spawn and interact and is an extension to TCL.
* [https://qemu.weilnetz.de/doc/qemu-doc.html QEMU manual]
+
Before the expect command can be used a program must be spawned, see expect commands below.
* [https://en.wikibooks.org/wiki/QEMU/Images How to invoke qemu and give it image to run as operating system]
+
expect \
 
+
  {match1} {action1} \
QEMU to emulate Arm on Linux . . .
+
  {match2} {action2} \
* [https://gist.github.com/Liryna/10710751 Emulating ARM on Ubuntu and Debian]
+
  {match3} {action3} \
[http://embedonix.com/articles/linux/emulating-raspberry-pi-on-linux/ Emulating Raspberry Pi under Linux, Embedonix article]
+
  {match4} {action4}
[https://medicineyeh.wordpress.com/2016/03/29/buildup-your-arm-image-for-qemu/ Medicineyeh - Build your Arm image for QEMU]
+
It is possible that no such output is encountered within the time period defined by the timeout (variable name "timeout" in seconds, default to 2). In this case expect stops waiting and continues with the next command in the script.
 
+
You can use '*' to match any characters. You can also match using [] syntax and similar.
How to avoid "raw image format" warning . . .
+
expect "\[a-f0-9]" ; # strongly preferred as \n and similar is not taken as litteral charactesr \ and n.
*  https://unix.stackexchange.com/questions/276480/booting-a-raw-disk-image-in-qemu
+
expect {a-f0-9}    ; # can also be used
 
+
A note on \ characters. The pattern matcher translate \x to x but this is done once before the pattern matcher. So you need to type \\n to match n. This is especially important for * and ? characters.
 
+
expect "*" ;# match anything (*)
 
+
expect "\n" ;# match linefeed
So got QEMU 2.10.0 sources and dependencies installed, ran `configure` and `make` steps, and let the build process run for an hour or two. But in the end could not find any `qemu` executable.  Why is the emulator itself apparently missing? Building latest QEMU under Linux . . .
+
expect "\*" ;# match anything
 
+
expect "\\*" ;# match * character
[https://wiki.qemu.org/Hosts/Linux Building QEMU on Linux type hosts]
+
expect "\\\*" ;# match * character
 
+
expect "\\\\*" ;# match \ followed by anything
 
+
expect "\\\\\*" ;# match \ followed by anything
So I'm following the above article author's typical build steps, and run into this message part-way down those steps, at the step of calling `make`:
+
expect "\\\\\\*" ;# match \ followed * character
 
+
The [ character is special to both tcl and the pattern matcher so it is especially messy.
<pre>
+
proc xy {} { return "n*w" }
user@host-6:~/Downloads/qemu/qemu-2.10.0/bin/debug/native$ make
+
expect "[xy]" ;# match n followed by anything followed by w
Makefile:21: *** This is an out of tree build but your source tree (/home/veris/Downloads/qemu/qemu-2.10.0) seems to have been used for an in-tree build. You can fix this by running "make distclean && rm -rf *-linux-user *-softmmu" in your source tree. Stop.
+
expect "\[xy]" ;# match x or y
user@host-6:~/Downloads/qemu/qemu-2.10.0/bin/debug/native$
+
expect "\\[xy]" ;# match n followed by anything followed by w
</pre>
+
expect "\\\[xy]" ;# match [xy]
 
+
expect "\\\\[xy]" ;# match \ followed by n followed ...
 
+
expect "\\\\\[xy]" ;# match sequence of \ and then x or y.
Ok interesting, I know that QEMU is a complicated project with a complex build process, but clearly I don't know what I'm doing.  Following the above 'distclean' command given in the error message from QEMU's makefile, I'm now able to begin an "out of tree" build as described in the "Building QEMU" article at qemu.org just above. Tired already however of QEMU project builds taking more than an hour to complete. Here is one of many articles describing how to invoke `make` to build only limited parts of QEMU project, for example just the pieces needed to emulate ARM type systems:
+
The expect command can also take flags. The default flag is -gl for glob pattern matching. It can also take the flag -re for regular expression matching.
 
+
expect {
 
+
  -re "a*" { action_when_a_followed_by_any_a }
*  [https://www.cnx-software.com/2012/03/08/how-to-build-qemu-system-arm-in-linux/ Build qemu-system-arm on Linux host]
+
  "b*" { action_when_b_followed_by_anything }
 
+
  -gl "-re" { action_when_real_dash_r_e }
 
+
  eof { action_on_end_of_file }
Ted to test this type of build soon . . .
+
  timeout { action_on_command_timeout }
 
+
  default { action_on_command_timeout_or_eof }
On a different note, QEMU build has completed and the stock RaspberryPi Debian "Stretch" image is coming up.  Needed to install a VNC client to interact with the emulated RaspberryPi operating and software, stored in the downloaded .img file from Rpi's web site. Here's a link to a forum post which clued Ted into Remmina VNC client:
+
  -re "(abc)*" { action_on_any_number_of_a_b_c }
 
+
  -re "-?(0|\[1-9]\[0-9]*)?\\.?\[0-9]*" { action_on_float_or_integer }
 
+
}
* [https://www.quora.com/How-could-I-connect-to-a-VNC-server-running-on-1-5900 Quora dot com, connect to VNC server]
+
You can also pass the pattern as a variable.
 
+
set v2pats "pat2 act2"
 
+
set v3pats "pat3 act3"
 
+
expect pat1 act1 $v2pats $v3pats
- 2017-11-21 Tuesday -
+
Observe that the following expect string is wrong as $v2pats and $v3pats is considered as two different arguments. It will try to match $v2pats as a pattern and $v3pats as an action. Instead build up a string and use the -brace flag. You can not use double quotes for that though, unless you use eval and then the -brace flag is not necessary. You also need to protect the pattern and action inside a [list x] or an extra brace if they contain whitespaces.
 
+
2.1  Parentheses for feedback
The version of qemu which installed from Debian's package list didn't seem to work. It's been some weeks now since trying that instance, but qemu 2.10.0 works to bring up a command line image built for RaspberryPi. Here are the versions of the two qemu instances:
+
In the previous section, parantheses were used to group subpatterns together. They can also play another role. When a regular expression successfully matches a string each part of the string that matches a paranthensized subpattern is stored in "expect_out(1,string)" the second in "expect_out(2,string)" etc up to "expect_out(9,string)". The entire pattern matched is stored in "expect_out(0,string)". Everthing before the pattern and the pattern matched is stored in "expect_out(buffer)". The last two assignments work in glob pattern too.
 
+
"a*((ab)*|b)"
<i>Figure x - locating qemu instances, determining their versions</i>
+
How is this passed to expect_out? It is quite simple. The entire string withing the first parenthesis is stored in 1 (which means up to end of string). The second fount parenthesis is stored in 2. Look for the left parenthesis to determine where the data is put.
 
+
2.2  Flags
<pre>
+
-re
 
+
-gl
user@localhost:~$ which qemu
+
-nocase Ignore case. Do not use -nocase with uppercase characters in the pattern as it will never match.
/usr/bin/qemu
+
-notransfer Prevent expect from removing matching characters from the internal buffer. The characters can be matched repeatedly as long as this option is associated with the pattern. It can be abbreviated with "-n" when expect is running interactively.
 
+
-brace Expect normally see the first argument as a pattern to match, but sometimes you want to give a list of patterns and actions to expect. You can then use -brace to expand the list before it is handled by expect.
user@localhost:~$ /usr/bin/qemu --version
+
expect -brace { pat1 act1 pat2 act2 }
QEMU emulator version 1.1.2 (Debian 1.1.2+dfsg-6+deb7u23), Copyright (c) 2003-2008 Fabrice Bellard
+
This can be useful when building up lists of pattern to match with corresponding actions to do.
 
+
-i n Use an alternative spawn_id. This applies to all patterns after the -i flag.
user@localhost:~$ ls /opt/qemu
+
expect {
qemu-system-arm
+
-i $ftp
 
+
"ftp>" "exit"
user@localhost:~$ ls -l /opt/qemu/qemu-system-arm
+
  eof "exit"
lrwxrwxrwx 1 root root 83 Sep 12 16:37 /opt/qemu/qemu-system-arm -> /home/user/Downloads/qemu/qemu-2.10.0/bin/debug/native/arm-softmmu/qemu-system-arm
+
}
 
+
You can also expect values from multiple spawned processes at the same time. At most one action can be executed just as expect normally do.
user@localhost:~$ /opt/qemu/qemu-system-arm --version
+
expect {
QEMU emulator version 2.10.0
+
-i $ftp "ftp> " { ftp_action }
Copyright (c) 2003-2017 Fabrice Bellard and the QEMU Project developers
+
-i $shell $prompt { shell_action }
 
+
}
user@localhost:~
+
There is an input buffer associated with each spawn id. So any output from ftp is kept separate from thta of the shell in the example above. When output appear on terminal it will be mixed, unless you expect one at a time or set log_user 0 and then wrote output explictly using send_user $expect_out(buffer). The process that did not match will keep its buffer until matched by next expect command.
 +
When the expect command match something it record the spawn_id to expect_out(spawn_id) so you can know which process that it matched against.
 +
You can also set the spawn_id definition to a list of spawn_ids.
 +
expect {
 +
  -i "$host1 $host2 $host3" $prompt {
 +
    an_action $expect_out(spawn_id)
 +
  }
 +
  eof exit
 +
  -i $host1 another_pattern {host1_action}
 +
}
 +
This example will do an_action if $prompt is matched agains any of the $hostnr, exit if end of file is matched against same list and do host1_action if matchina another_pattern from host1.
 +
2.3  Special patterns
 +
Note that these patcherns will only match if none of the '-gl', '-re' or '-ex' flags has been used.
 +
eof Match when end of file is reached.
 +
timeout Match when the timeout value has been reached.
 +
default Match when end of file or timeout is reached.
 +
full_buffer Match when no other pattern match and expect would otherwise throw away part of the input to make room fore more. When this matches, all of the unmatched input is moved to expect_out(buffer).
 +
null
 +
By default null characters are removed from the buffer before expect matching is done. This can be disabled using the remove_nulls command below. If it is disabled null characters will be matched using this special keyword. Null characters can not be matched inside a pattern as expect first look for null characters and then do pattern matching. If a null character is found the characters before it is skilled. These caracters can be found in expect_out(buffer).
 +
Since the null character is used internally to represent the end of a string unanchored patterns cannot be matched past a null. This is not a problem since null pattern can always be listed last.
  
 
</pre>
 
</pre>
  
  
 +
<!-- comment -->
  
- 2017-11-22 Wednesday -
+
=== [[#top|&uarr;]] [[#references|&darr;]] Rust programming language ===
  
Yesterday could not bring up raspbian image in qemu, same image which booted and appeared, and permitted shell based login and shell use a month ago on the local hostLooking at a new on-line reference for running raspbian images in qemu:
+
There are two editions of the Rust Programming bookThe Rust home page recommends to start by reading the second edition:
 +
*  https://doc.rust-lang.org/book/second-edition/
  
 +
*  https://doc.rust-lang.org/nomicon/
  
  *  https://ownyourbits.com/2017/02/06/raspbian-on-qemu-with-network-access/
 
  
 +
=== [[#top|^]] C programming notes ===
  
This above article looks really interesting, appears to go to a second installment of the article where the developers there are building some kind of cloud-based or cloud involved web, database, mail and PHP serversBut on my end having trouble with a kernel panic this morning when invoking qemu-system-arm with a large set of options . . . ok, just located a different invocation of qemu-system-arm version 2.10.0, noting here in following code figure:
+
This section really should be in a more prominent space of this wiki.  - TMH
  
 +
This section contains link to Brian Barto post about Untangling Complex C Declarations.  Click here -> [[c_programming_notes|C programming notes]] <- for separate wiki article.
  
<i>Figure x - emulate-rpi shell script</i>
+
Typedef and type defining function pointers:
  
<pre>
+
<ul>
 +
*  2019-06-11 https://www.learncpp.com/cpp-tutorial/78-function-pointers/
 +
</ul>
  
#!/bin/bash
+
CRC types and implementations:
# Starts raspberry pi image in configuration mode
 
  
 +
<ul>
 +
*  https://stackoverflow.com/questions/10564491/function-to-calculate-a-crc16-checksum
 +
</ul>
  
##----------------------------------------------------------------------
+
Floating point representation and conversions:
## - SECTION - script variables
 
##----------------------------------------------------------------------
 
  
EMULATOR=/home/veris/Downloads/qemu/qemu-2.10.0/bin/debug/native/arm-softmmu/qemu-system-arm
+
<ul>
 +
*  http://www.ryanjuckett.com/programming/printing-floating-point-numbers/
  
 +
<span id="to_untangle_c_declarations"></span> <span id="untangling_complex_c_delcarations"></span>
 +
C programmatic reference and dereference rules, dereferencing pointers and pointer expressions:
 +
*  https://medium.com/@bartobri/untangling-complex-c-declarations-9b6a0cf88c96  <i>"I liked this post about untangling complicated pointer declarations and operators - T.D."</i>
 +
</ul>
  
  
##----------------------------------------------------------------------
+
2021-11-03
## - SECTION - original emulator invocation, everything hard-coded
+
*  https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.47.1127&rep=rep1&type=pdf
##----------------------------------------------------------------------
 
  
# qemu-system-arm -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw init=/bin/bash" -hda rpi.img
+
<!-- comment -->
  
# qemu-system-arm -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw" -hda rpi.img
+
=== [[#top|^]] C++ references ===
  
 +
This section contains beginning level C++ issues and references.  Section here created by need to note some Qt5 related project elements, as Qt is based on C++.  First issue is to understand and document how to implement a QDialog object to act as a sensible dialog box, which can post run-time data to a larger Qt based application.  The first reference below mentions QDialog built-in class functions exec(), accept() and reject(), which appear to be the means to start and show, and to close out a Qt based dialog box . . .
  
 +
<ul>
 +
*  https://stackoverflow.com/questions/12470806/qdialog-exec-and-getting-result-value
 +
</ul>
  
##----------------------------------------------------------------------
+
Per help index in QtCreator 3.2.1:
## - SECTION - invocation, emulator as variable:
 
##----------------------------------------------------------------------
 
  
# ${EMULATOR} -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw init=/bin/bash" -hda rpi.img
+
<i>
 +
<pre>
 +
void QDialog::accept() [virtual slot]
 +
Hides the modal dialog and sets the result code to Accepted.
  
# Start RaspberryPi in fully functional mode:
+
See also reject() and done().
${EMULATOR} -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw" -hda rpi.img
+
</pre>
 +
</i>
  
  
 +
The Qt method <code>done()</code> performs more significant work and at least in cases of a dialog being shown with a call to <code>exec()</code> the done() method stops dialog event loop execution:
  
 +
<i>
 +
<pre>
 +
void QDialog::done(int r) [virtual slot]
 +
Closes the dialog and sets its result code to r. If this dialog is shown with exec(), done() causes the local event loop to finish, and exec() to return r.
  
 +
As with QWidget::close(), done() deletes the dialog if the Qt::WA_DeleteOnClose flag is set. If the dialog is the application's main widget, the application terminates. If the dialog is the last window closed, the QApplication::lastWindowClosed() signal is emitted.
  
 +
See also accept(), reject(), QApplication::activeWindow(), and QApplication::quit().
 +
</pre>
 +
</i>
  
## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
 
## 2017-09-08 FRI - this script copied from http://embedonix.com/articles/linux/emulating-raspberry-pi-on-linux/
 
## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
 
  
exit 0
+
So it looks like if we do not call done() then we want to assure that we call exec() only one time during a use session of GWN Unified Tester.  - TMH
  
</pre>
 
  
 +
<!-- comment -->
 +
2019-10-28 Monday:
 +
G++ error, "template has C linkage":
  
The final token <code>rpi.img</code> points to <code>localhost:/home/user/Downloads/raspberrypi/2017-08-16-raspbian-stretch-lite.img</code> which we downloaded from https://www.raspberrypi.org/downloads/raspbian/.  The working qemu invocation doesn't open qemu's native window, but puts to standard out that is the same shell in which qemu invoked, a couple of lines of output from the booting kernel image.  Then using remmina we connect via "VNC server running on ::1:5900".
+
*  https://stackoverflow.com/questions/4877705/why-cant-templates-be-within-extern-c-blocks
 +
 
 +
2019-10-30 Wednesday:
 +
The purposes and use of extern "C" . . .
 +
<ul>
 +
https://stackoverflow.com/questions/1041866/what-is-the-effect-of-extern-c-in-c
 +
</ul>
  
In summary shell script in latest figure successfully invokes qemu-system-arm 2.10.0 built from sources about August 2017, and boots up Raspbian Stretch lite image and kernel named kernel-qemu-4.4.34-jessie.  Next figure is screenshot showing successful login, and last login message . . . though emulation was and is very slow on host system!
 
  
  
<i>Figure x - emulated raspbian stretch lite screenshot, Remmina window</i>
+
<!-- comment -->
  
[[media:z.png]]
+
== - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - ==
  
  
A shorter script to start raspberrypi kernel plus image, running in QEMU:
 
  
<pre>
+
<!-- comment -->
#!/bin/bash
 
  
qemu-system-arm -kernel ./kernel-qemu-4.4.34-jessie -cpu arm1176 -m 256 -M versatilepb -serial stdio -append "root=/dev/sda2 rootfstype=ext4 rw" -hda ./2017-09-07-raspbian-stretch-lite.img -redir tcp:5022::22 -no-reboot
+
<!-- SECTION - Aboriginal Linux -->
  
exit 0
+
== [[#top|&uarr;]] [[#references|&darr;]] Aboriginal Linux - project now defunct, new project is 'makeroot' ==
</pre>
 
  
  
 +
Ok, looks like Robert Landley's [https://landley.net/aboriginal/about.html Aboriginal Linux] project has been superceded by [http://landley.net/aboriginal/ mkroot].  Ladnley's newer makeroot project sources are available at GitHub:
  
- 2017-12-12 WED -
 
  
An excerpt from qemu.org/download#source, on how to download, configure and compile latest QEMU sources:
+
*  [https://github.com/landley/mkroot makeroot project on GitHub]
  
<pre>
 
"
 
Build instructions
 
  
To download and build QEMU 2.11.0-rc5:
+
Having trouble carrying out the basic build of Aboriginal Linux with armv6l as target . . .
  
wget https://download.qemu.org/qemu-2.11.0-rc5.tar.xz
+
<pre>
tar xvJf qemu-2.11.0-rc5.tar.xz
 
cd qemu-2.11.0-rc5
 
./configure
 
make
 
  
To download and build QEMU from git:
+
  .
 +
  .
 +
  .
  
git clone git://git.qemu.org/qemu.git
+
Confirmed e2fsprogs-1.42.13.tar.gz
cd qemu
+
Confirmed zlib-1.2.7.tar.bz2
git submodule init
+
Confirmed squashfs-4.2.tar.gz
git submodule update --recursive
+
=== Got all source.
./configure
 
make
 
  
The latest development happens on the master branch. The stable trees are located in branches named stable-X.YY branch, where X.YY is the release version.
+
real    0m2.240s
"
+
user    0m1.188s
</pre>
+
sys    0m0.176s
 
+
=== toybox (host host-tools)
 
+
Snapshot 'toybox'...
 
+
scripts/genconfig.sh
<!-- comment -->
+
cc -o kconfig/conf kconfig/conf.c kconfig/zconf.tab.c -DKBUILD_NO_NLS=1 \
 +
                -DPROJECT_NAME=\"ToyBox\"
 +
kconfig/conf -D /dev/null Config.in > /dev/null
 +
scripts/make.sh
 +
Generate headers from toys/*/*.c...
 +
generated/newtoys.h Library probe.......
 +
Make generated/config.h from .config.
 +
generated/flags.h generated/globals.h generated/help.h
 +
Compile toybox................................................................................................................................................................generated/obj/nsenter.o: In function `unshare_main':
 +
nsenter.c:(.text.unshare_main+0x152): undefined reference to `setns'
 +
collect2: error: ld returned 1 exit status
 +
make: *** [toybox] Error 1
  
<!-- SECTION - Embedded Linux Notes, focus on Rpi Linux Kernel Config -->
+
Exiting due to errors (host host-tools toybox)
  
== [[#top|&uarr;]] [[#references|&darr;]] Embedded Linux Notes, focus on Rpi Linux Kernel Config ==
+
</pre>
  
2018-11-09 - Ted to create [[nn_embedded_work|embedded work]] article on this wiki installation, so noting this Friday evening.  - TMH
+
*  [http://man7.org/linux/man-pages/man2/setns.2.html Linux kernel routine to setns()]
  
Ted looking into a couple of areas of embedded Linux, including [[nn_embedded_linux_notes|custom kernel config for Rpi]], the open source Buildroot project, Tiny-Core Linux and FreeRTOS.  Ted also stashing some links to embedded studies notes on this wiki here:
 
  
[[system_partitions_to_hard_disk|Copying Rpi Linux partitions to hard disk]]
+
Robert Landley also has a presence on [https://www.patreon.com/landley www.patreon.com/landley], where he talks about the over-arching goals in his programming and software systems level work.
  
  
Line 1,305: Line 1,472:
 
<!-- comment -->
 
<!-- comment -->
  
== [[#top|&uarr;]] [[#references|&darr;]] FreeRTOS Notes (Separate Article) ==
+
<!-- SECTION - Linux From Scratch 8.1 - Separate Article -->
  
<!-- 2017-12-08 FRI -->
+
== [[#top|&uarr;]] [[#references|&darr;]] Linux From Scratch (Separate Article) ==
  
 +
[[LFS-book-8p1-notes|Linux From Scratch Book 8.1 - Build and Notes]]
  
[[FreeRTOS|FreeRTOS notes]]
 
  
Ted to move this link to nn wiki article named 'FreeRTOS'.  For now however Ted noting an openssl library named Wolfssl:
 
  
*  https://freertos.org/FreeRTOS-Plus/WolfSSL/WolfSSL.shtml
+
<!-- comment -->
*  https://www.wolfssl.com/
+
 
*  https://www.wolfssl.com/license/
+
<!-- SECTION - QEMU Emulator -->
 +
 
 +
== [[#top|&uarr;]] [[#references|&darr;]] QEMU Emulator ==
 +
 
 +
<b>Overview</b>
  
 +
Notes on QEMU, an emulator which can help with building and configuring Linux systems to run on embedded computers and development boards.  Ted noting 2017-09-08 that to compile today's latest QEMU source, a 2.10.x release, needed to install Debian stretch packages pkg-config, libglib2.0-dev, dhautoreconf.  Here are some links to downloading QEMU project sources, a manual for using QEMU, and an article about emulating a RaspberryPi system by using QEMU:
  
NOTE 2017-12-10:  this section 'embedded operating systems' to become a shorter list of major significant embedded OS's.  As of 2017 winter Ted studying couple distributions of embedded Linux and FreeRTOS.
 
  
 +
<b>References:</b>
  
 +
*  [https://www.qemu.org/download/#source QEMU Emulator, source code download site]
 +
*  [https://qemu.weilnetz.de/doc/qemu-doc.html QEMU manual]
 +
*  [https://en.wikibooks.org/wiki/QEMU/Images How to invoke qemu and give it image to run as operating system]
 +
 +
QEMU to emulate Arm on Linux . . .
 +
*  [https://gist.github.com/Liryna/10710751 Emulating ARM on Ubuntu and Debian]
 +
*  [http://embedonix.com/articles/linux/emulating-raspberry-pi-on-linux/ Emulating Raspberry Pi under Linux, Embedonix article]
 +
*  [https://medicineyeh.wordpress.com/2016/03/29/buildup-your-arm-image-for-qemu/ Medicineyeh - Build your Arm image for QEMU]
 +
 +
How to avoid "raw image format" warning . . .
 +
*  https://unix.stackexchange.com/questions/276480/booting-a-raw-disk-image-in-qemu
  
<!-- comment -->
 
  
== [[#top|&uarr;]] [[#references|&darr;]] Bootloader U-Boot ==
 
  
Ted noting after several custom Linux-for-Rpi kernel build attempts that Raspberry Pi board uses a bootloader typically other than GRUB, commonly uses U-bootA first tutorial . . . also running into U-boot sources makefile calling a project script which fails to find gcc-6, though /usr/bin/gcc is a symlink to that newer gcc . . .
+
So got QEMU 2.10.0 sources and dependencies installed, ran `configure` and `make` steps, and let the build process run for an hour or twoBut in the end could not find any `qemu` executable. Why is the emulator itself apparently missing?  Building latest QEMU under Linux . . .
  
 +
*  [https://wiki.qemu.org/Hosts/Linux Building QEMU on Linux type hosts]
  
*  http://etutorials.org/Linux+systems/embedded+linux+systems/Chapter+9.+Setting+Up+the+Bootloader/9.5+U-Boot/
 
*  https://blog.christophersmart.com/2016/10/27/building-and-booting-upstream-linux-and-u-boot-for-raspberry-pi-23-arm-boards/
 
  
After installing manually some twenty or thirty gcc-6-arm-linux and gcc-6, gcc-7 files, and installing more modern version of build-essentials package from Ubuntu release codenamed 'bionic', can now build u-boot.  Tail of messages from build process . . .
+
So I'm following the above article author's typical build steps, and run into this message part-way down those steps, at the step of calling `make`:
  
 
<pre>
 
<pre>
  CC      lib/strto.o
+
user@host-6:~/Downloads/qemu/qemu-2.10.0/bin/debug/native$ make
  CC      lib/strmhz.o
+
Makefile:21: *** This is an out of tree build but your source tree (/home/veris/Downloads/qemu/qemu-2.10.0) seems to have been used for an in-tree build. You can fix this by running "make distclean && rm -rf *-linux-user *-softmmu" in your source treeStop.
  LD      lib/built-in.o
+
user@host-6:~/Downloads/qemu/qemu-2.10.0/bin/debug/native$
  CC      examples/standalone/stubs.o
+
</pre>
  CC      CC      lib/strto.o
+
 
  CC      lib/strmhz.o
+
 
  LD      lib/built-in.o
+
Ok interesting, I know that QEMU is a complicated project with a complex build process, but clearly I don't know what I'm doing.  Following the above 'distclean' command given in the error message from QEMU's makefile, I'm now able to begin an "out of tree" build as described in the "Building QEMU" article at qemu.org just above.  Tired already however of QEMU project builds taking more than an hour to complete. Here is one of many articles describing how to invoke `make` to build only limited parts of QEMU project, for example just the pieces needed to emulate ARM type systems:
  CC      examples/standalone/stubs.o
+
 
  CC      examples/standalone/hello_world.o
+
 
  LD      examples/standalone/libstubs.o
+
*  [https://www.cnx-software.com/2012/03/08/how-to-build-qemu-system-arm-in-linux/ Build qemu-system-arm on Linux host]
  LD      examples/standalone/hello_world
+
 
  OBJCOPY examples/standalone/hello_world.srec
+
 
  OBJCOPY examples/standalone/hello_world.bin
+
Ted to test this type of build soon . . .
  LD      u-boot
+
 
  OBJCOPY u-boot.srec
+
On a different note, QEMU build has completed and the stock RaspberryPi Debian "Stretch" image is coming upNeeded to install a VNC client to interact with the emulated RaspberryPi operating and software, stored in the downloaded .img file from Rpi's web site. Here's a link to a forum post which clued Ted into Remmina VNC client:
  OBJCOPY u-boot-nodtb.bin
+
 
  SYM    u-boot.sym
 
  COPY    u-boot.bin
 
  CFGCHK u-boot.cfg
 
ted@rangari:/var/local/ted/projects/u-boot$ examples/standalone/hello_world.o
 
  LD      examples/standalone/libstubs.o
 
  LD      examples/standalone/hello_world
 
  OBJCOPY examples/standalone/hello_world.srec
 
  OBJCOPY examples/standalone/hello_world.bin
 
  LD      u-boot
 
  OBJCOPY u-boot.srec
 
  OBJCOPY u-boot-nodtb.bin
 
  SYM    u-boot.sym
 
  COPY    u-boot.bin
 
  CFGCHK u-boot.cfg
 
ted@rangari:/var/local/ted/projects/u-boot$
 
</pre>
 
  
 +
*  [https://www.quora.com/How-could-I-connect-to-a-VNC-server-running-on-1-5900 Quora dot com, connect to VNC server]
  
  
<!-- comment -->
 
  
== [[#top|&uarr;]] [[#references|&darr;]] LPC11U6x Development Board ==
+
- 2017-11-21 Tuesday -
  
*  https://community.nxp.com/thread/389139
+
The version of qemu which installed from Debian's package list didn't seem to workIt's been some weeks now since trying that instance, but qemu 2.10.0 works to bring up a command line image built for RaspberryPiHere are the versions of the two qemu instances:
* http://www.embeddedartists.com/products/lpcxpresso/lpclink2.php
 
* https://os.mbed.com/teams/Semtech/code/SX1276TxContinuousWave/
 
  
 +
<i>Figure x - locating qemu instances, determining their versions</i>
  
 +
<pre>
  
<!-- comment -->
+
user@localhost:~$ which qemu
 +
/usr/bin/qemu
  
== [[#top|&uarr;]] [[#references|&darr;]] avr-libc ==
+
user@localhost:~$ /usr/bin/qemu --version
 +
QEMU emulator version 1.1.2 (Debian 1.1.2+dfsg-6+deb7u23), Copyright (c) 2003-2008 Fabrice Bellard
 +
 
 +
user@localhost:~$ ls /opt/qemu
 +
qemu-system-arm
 +
 
 +
user@localhost:~$ ls -l /opt/qemu/qemu-system-arm
 +
lrwxrwxrwx 1 root root 83 Sep 12 16:37 /opt/qemu/qemu-system-arm -> /home/user/Downloads/qemu/qemu-2.10.0/bin/debug/native/arm-softmmu/qemu-system-arm
 +
 
 +
user@localhost:~$ /opt/qemu/qemu-system-arm --version
 +
QEMU emulator version 2.10.0
 +
Copyright (c) 2003-2017 Fabrice Bellard and the QEMU Project developers
 +
 
 +
user@localhost:~
 +
 
 +
</pre>
  
<pre>
 
./avr-libc-1.8.0/include/avr/iom8.h:634:#if !defined(__AVR_LIBC_DEPRECATED_ENABLE__)
 
./avr-libc-1.8.0/include/avr/iom8.h:657:#endif  /* !defined(__AVR_LIBC_DEPRECATED_ENABLE__) */
 
  
.
 
.
 
.
 
  
633 /* Deprecated items */
+
- 2017-11-22 Wednesday -
634 #if !defined(__AVR_LIBC_DEPRECATED_ENABLE__)
 
635
 
636 #pragma GCC system_header
 
637
 
638 #pragma GCC poison SIG_INTERRUPT0
 
639 #pragma GCC poison SIG_INTERRUPT1
 
640 #pragma GCC poison SIG_OUTPUT_COMPARE2
 
641 #pragma GCC poison SIG_OVERFLOW2
 
642 #pragma GCC poison SIG_INPUT_CAPTURE1
 
643 #pragma GCC poison SIG_OUTPUT_COMPARE1A
 
644 #pragma GCC poison SIG_OUTPUT_COMPARE1B
 
645 #pragma GCC poison SIG_OVERFLOW1
 
646 #pragma GCC poison SIG_OVERFLOW0
 
647 #pragma GCC poison SIG_SPI
 
648 #pragma GCC poison SIG_UART_RECV
 
649 #pragma GCC poison SIG_UART_DATA
 
650 #pragma GCC poison SIG_UART_TRANS
 
651 #pragma GCC poison SIG_ADC
 
652 #pragma GCC poison SIG_EEPROM_READY
 
653 #pragma GCC poison SIG_COMPARATOR
 
654 #pragma GCC poison SIG_2WIRE_SERIAL
 
655 #pragma GCC poison SIG_SPM_READY
 
656
 
657 #endif  /* !defined(__AVR_LIBC_DEPRECATED_ENABLE__) */
 
  
</pre>
+
Yesterday could not bring up raspbian image in qemu, same image which booted and appeared, and permitted shell based login and shell use a month ago on the local host.  Looking at a new on-line reference for running raspbian images in qemu:
  
  
<!-- comment -->
+
  *  https://ownyourbits.com/2017/02/06/raspbian-on-qemu-with-network-access/
  
== [[#top|&uarr;]] [[#references|&darr;]] EWAVR, IAR Workbench, Keil compiler notes ==
 
  
2019-01-03 THU
+
This above article looks really interesting, appears to go to a second installment of the article where the developers there are building some kind of cloud-based or cloud involved web, database, mail and PHP servers.  But on my end having trouble with a kernel panic this morning when invoking qemu-system-arm with a large set of options . . . ok, just located a different invocation of qemu-system-arm version 2.10.0, noting here in following code figure:
  
*  http://www.keil.com/support/man/docs/c51/c51_le_sfr.htm
 
  
 +
<i>Figure x - emulate-rpi shell script</i>
  
<!-- comment -->
+
<pre>
  
==  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - ==
+
#!/bin/bash
 +
# Starts raspberry pi image in configuration mode
  
== [[#top|&uarr;]] [[#references|&darr;]] Yocto References ==
 
  
 +
##----------------------------------------------------------------------
 +
## - SECTION - script variables
 +
##----------------------------------------------------------------------
  
*  [https://github.com/toradex/meta-product Yocto meta-product project by Toradex]
+
EMULATOR=/home/veris/Downloads/qemu/qemu-2.10.0/bin/debug/native/arm-softmmu/qemu-system-arm
  
  
<!-- comment -->
 
  
==  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - ==
+
##----------------------------------------------------------------------
 +
## - SECTION - original emulator invocation, everything hard-coded
 +
##----------------------------------------------------------------------
  
 +
# qemu-system-arm -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw init=/bin/bash" -hda rpi.img
  
 +
# qemu-system-arm -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw" -hda rpi.img
  
<!-- comment -->
 
  
== [[#top|&uarr;]] [[#references|&darr;]] Mobile App Development On Linux ==
 
  
*  https://www.raywenderlich.com/122189/introduction-to-open-source-swift-on-linux
+
##----------------------------------------------------------------------
*  http://www.instructables.com/id/Creating-your-first-iOS-app/
+
## - SECTION - invocation, emulator as variable:
*  https://developer.apple.com/support/purchase-activation/ . . . required fees to Apple company
+
##----------------------------------------------------------------------
  
- 2018-10-12 FRI -
+
# ${EMULATOR} -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw init=/bin/bash" -hda rpi.img
*  https://developer.apple.com/documentation/corebluetooth
 
  
- 2018-01-15 MON -
+
# Start RaspberryPi in fully functional mode:
*  https://andrewmichaelsmith.com/2017/02/developing-an-ios-app-on-linux-in-2017/ . . . Developing an iOS app on Linux in 2017
+
${EMULATOR} -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw" -hda rpi.img
*  https://itsfoss.com/mount-iphone-ipad-ios-7-ubuntu-13-10/ . . . Ubuntu mount iPhone via libimobiledevice4 libimobiledevice-dev libimobiledevice-util and others
 
*  https://beebom.com/how-use-iphone-with-linux/
 
  
  
=== [[#top|&uarr;]] [[#references|&darr;]] Android programming ===
 
  
*  https://www.ntu.edu.sg/home/ehchua/programming/android/Android_3D.html
 
  
  
<!-- comment -->
 
  
==  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - ==
+
## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
 +
## 2017-09-08 FRI - this script copied from http://embedonix.com/articles/linux/emulating-raspberry-pi-on-linux/
 +
## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
  
 +
exit 0
  
 +
</pre>
  
<!-- comment -->
 
  
== [[#top|&uarr;]] [[#references|&darr;]] Toradex embedded ARM computers ==
+
The final token <code>rpi.img</code> points to <code>localhost:/home/user/Downloads/raspberrypi/2017-08-16-raspbian-stretch-lite.img</code> which we downloaded from https://www.raspberrypi.org/downloads/raspbian/.  The working qemu invocation doesn't open qemu's native window, but puts to standard out that is the same shell in which qemu invoked, a couple of lines of output from the booting kernel image.  Then using remmina we connect via "VNC server running on ::1:5900".
  
Search for Toradex asymmetric core 'system on a module' board:
+
In summary shell script in latest figure successfully invokes qemu-system-arm 2.10.0 built from sources about August 2017, and boots up Raspbian Stretch lite image and kernel named kernel-qemu-4.4.34-jessie.  Next figure is screenshot showing successful login, and last login message . . . though emulation was and is very slow on host system!
  
*  [https://docs.toradex.com/104446-colibri-arm-som-imx6ull-datasheet.pdf 104446-colibri-arm-som-imx6ull-datasheet.pdf] . . . looks like this may be only single core, not dual heterogeneous core
 
  
It looks like Colibri iMX7S and iMX7D are two-core and three-core processor based modules, with asymmetric cores to handle different kinds of data processing more efficiently,
+
<i>Figure x - emulated raspbian stretch lite screenshot, Remmina window</i>
  
*  Toradex PN: 00391100 - Colibri iMX7 Dual 1GB | V1.1A
+
[[media:z.png]]
*  Toradex PN: 01351101 - Iris carrier board
 
  
  
Looks like the Iris carrier board is a smaller form, less featured but more economical carrier board to support use of iMX7D/S systems on modules:
+
A shorter script to start raspberrypi kernel plus image, running in QEMU:
  
*  https://developer.toradex.com/products/iris-carrier-board
+
<pre>
 +
#!/bin/bash
  
Software to install on this module:
+
qemu-system-arm -kernel ./kernel-qemu-4.4.34-jessie -cpu arm1176 -m 256 -M versatilepb -serial stdio -append "root=/dev/sda2 rootfstype=ext4 rw" -hda ./2017-09-07-raspbian-stretch-lite.img -redir tcp:5022::22 -no-reboot
  
*  https://www.toradex.com/computer-on-modules/colibri-arm-family/nxp-freescale-imx7
+
exit 0
 +
</pre>
  
  
Software projects and stacks to run on asymmetric core systems:
 
  
*  https://community.nxp.com/docs/DOC-104422
+
- 2017-12-12 WED -
 +
 
 +
An excerpt from qemu.org/download#source, on how to download, configure and compile latest QEMU sources:
 +
 
 +
<pre>
 +
"
 +
Build instructions
  
 +
To download and build QEMU 2.11.0-rc5:
  
 +
wget https://download.qemu.org/qemu-2.11.0-rc5.tar.xz
 +
tar xvJf qemu-2.11.0-rc5.tar.xz
 +
cd qemu-2.11.0-rc5
 +
./configure
 +
make
  
<!-- comment -->
+
To download and build QEMU from git:
  
=== [[#top|&uarr;]] [[#references|&darr;]] Build U-boot and Linux kernel from source ===
+
git clone git://git.qemu.org/qemu.git
 +
cd qemu
 +
git submodule init
 +
git submodule update --recursive
 +
./configure
 +
make
  
*  https://developer.toradex.com/knowledge-base/build-u-boot-and-linux-kernel-from-source-code
+
The latest development happens on the master branch. The stable trees are located in branches named stable-X.YY branch, where X.YY is the release version.
 +
"
 +
</pre>
  
  
Line 1,514: Line 1,681:
 
<!-- comment -->
 
<!-- comment -->
  
<!-- SECTION - Arduino Development Kit and Documentation -->
+
<!-- SECTION - Embedded Linux Notes, focus on Rpi Linux Kernel Config -->
  
=== [[#top|&uarr;]] [[#references|&darr;]] Arduino Development Kit and Documentation ===
+
== [[#top|&uarr;]] [[#references|&darr;]] Embedded Linux Notes, focus on Rpi Linux Kernel Config ==
 +
 
 +
2018-11-09 - Ted to create [[nn_embedded_work|embedded work]] article on this wiki installation, so noting this Friday evening.  - TMH
 +
 
 +
Ted looking into a couple of areas of embedded Linux, including [[nn_embedded_linux_notes|custom kernel config for Rpi]], the open source Buildroot project, Tiny-Core Linux and FreeRTOS.  Ted also stashing some links to embedded studies notes on this wiki here:
 +
 
 +
*  [[system_partitions_to_hard_disk|Copying Rpi Linux partitions to hard disk]]
  
Looking into Arduino boards as a means to configure an I2C protocol programmer . . .
 
  
Arduino Uno development board datasheet:
 
*  https://www.farnell.com/datasheets/1682209.pdf
 
  
Arduino IDE software download:
+
<!-- comment -->
*  https://www.arduino.cc/en/Main/Software
 
  
Getting started:
+
== [[#top|&uarr;]] [[#references|&darr;]] FreeRTOS Notes (Separate Article) ==
*  https://www.arduino.cc/en/Guide/HomePage
 
**  https://www.arduino.cc/en/Guide/Linux
 
  
 +
<!-- 2017-12-08 FRI -->
  
A more specifically purposed interface and or programming board called 'Aardvark' . . .
 
  
*  https://www.totalphase.com/support/articles/200468316
+
[[FreeRTOS|FreeRTOS notes]]
  
 +
Ted to move this link to nn wiki article named 'FreeRTOS'.  For now however Ted noting an openssl library named Wolfssl:
  
FreeRTOS on Arduino development boards . . .
+
*  https://freertos.org/FreeRTOS-Plus/WolfSSL/WolfSSL.shtml
*  https://github.com/feilipu/Arduino_FreeRTOS_Library
+
*  https://www.wolfssl.com/
 +
*  https://www.wolfssl.com/license/
  
<!-- comment -->
 
  
==  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - - - - - - ==
+
NOTE 2017-12-10: this section 'embedded operating systems' to become a shorter list of major significant embedded OS's. As of 2017 winter Ted studying couple distributions of embedded Linux and FreeRTOS.
  
  
Line 1,547: Line 1,715:
 
<!-- comment -->
 
<!-- comment -->
  
== [[#top|&uarr;]] [[#references|&darr;]] Electronics ==
+
== [[#top|&uarr;]] [[#references|&darr;]] Bootloader U-Boot ==
  
Transistor, FETs, Op-amps . . .
+
Ted noting after several custom Linux-for-Rpi kernel build attempts that Raspberry Pi board uses a bootloader typically other than GRUB, commonly uses U-boot. A first tutorial . . . also running into U-boot sources makefile calling a project script which fails to find gcc-6, though /usr/bin/gcc is a symlink to that newer gcc . . .
<ul>
 
  <li> https://www.electronics-tutorials.ws/amplifier/transistor-biasing.html <br />
 
  
  <li> http://bg-electronics.de/shop/product_info.php/products_id/6409/language/en  . . . MPSA14 Darlington pair NPN transistor <br />
 
</ul>
 
  
Photovoltaics . . .
+
*  http://etutorials.org/Linux+systems/embedded+linux+systems/Chapter+9.+Setting+Up+the+Bootloader/9.5+U-Boot/
<ul>
+
https://blog.christophersmart.com/2016/10/27/building-and-booting-upstream-linux-and-u-boot-for-raspberry-pi-23-arm-boards/
  <li> https://www.digikey.com/en/articles/techzone/2018/sep/overcoming-power-system-design-challenges-in-1500-vdc-photovoltaic-systems?utm_medium=email&utm_source=tnl&utm_campaign=40284_TNL1811A&utm_content=article1learnmore_US&utm_cid=9726770&mkt_tok=eyJpIjoiWkRFeE1qQmxOMlF4T1dFeCIsInQiOiJLbDVRQkhIUmpGMThyK054VWhLZGFxWmJ5OUpyMHMrdGVKZVdxWnluM1wvRVgxdWcyTzNWQnJrd0wzTlk1SXpqZHZvMWxDNGd4blB3bGFWdWFOSWVsMTNmbWswU1M5aVZhck8wTm1ZK3FBZzFUQXJkK2NZdXlzZng1S2lqTGpob1UifQ%3D%3D <br />
 
</ul>
 
  
Analog computers
+
After installing manually some twenty or thirty gcc-6-arm-linux and gcc-6, gcc-7 files, and installing more modern version of build-essentials package from Ubuntu release codenamed 'bionic', can now build u-boot. Tail of messages from build process . . .
<ul>
 
  <li> http://www.analogmuseum.org/library/handbook_of_analog_computation.pdf
 
</ul>
 
  
 +
<pre>
 +
  CC      lib/strto.o
 +
  CC      lib/strmhz.o
 +
  LD      lib/built-in.o
 +
  CC      examples/standalone/stubs.o
 +
  CC      CC      lib/strto.o
 +
  CC      lib/strmhz.o
 +
  LD      lib/built-in.o
 +
  CC      examples/standalone/stubs.o
 +
  CC      examples/standalone/hello_world.o
 +
  LD      examples/standalone/libstubs.o
 +
  LD      examples/standalone/hello_world
 +
  OBJCOPY examples/standalone/hello_world.srec
 +
  OBJCOPY examples/standalone/hello_world.bin
 +
  LD      u-boot
 +
  OBJCOPY u-boot.srec
 +
  OBJCOPY u-boot-nodtb.bin
 +
  SYM    u-boot.sym
 +
  COPY    u-boot.bin
 +
  CFGCHK  u-boot.cfg
 +
ted@rangari:/var/local/ted/projects/u-boot$ examples/standalone/hello_world.o
 +
  LD      examples/standalone/libstubs.o
 +
  LD      examples/standalone/hello_world
 +
  OBJCOPY examples/standalone/hello_world.srec
 +
  OBJCOPY examples/standalone/hello_world.bin
 +
  LD      u-boot
 +
  OBJCOPY u-boot.srec
 +
  OBJCOPY u-boot-nodtb.bin
 +
  SYM    u-boot.sym
 +
  COPY    u-boot.bin
 +
  CFGCHK  u-boot.cfg
 +
ted@rangari:/var/local/ted/projects/u-boot$
 +
</pre>
  
<!-- comment -->
 
 
=== [[#top|&uarr;]] [[#references|&darr;]] tools and hardware ===
 
 
<ul>
 
*  https://www.amazon.com/Illuminated-Jewelers-Trichome-Formline-Supply/dp/B073HWZGP3/ref=sr_1_40?hvadid=241934704451&hvdev=c&hvlocphy=9033803&hvnetw=g&hvpos=1t1&hvqmt=e&hvrand=14352835026335723525
 
</ul>
 
 
<ul>
 
32-razradnii kontrolerya . . .
 
*  https://docplayer.ru/amp/27429677-32-razryadnyy-kontroller-dlya-aviacionnogo-primeneniya-1986ve1t-k1986ve1t-mdr32f1qi-k1986ve1n4.html
 
</ul>
 
  
  
 
<!-- comment -->
 
<!-- comment -->
  
=== [[#top|&uarr;]] [[#references|&darr;]] Modbus protocol ===
+
== [[#top|&uarr;]] [[#references|&darr;]] LPC11U6x Development Board ==
 
+
 
 +
*  https://community.nxp.com/thread/389139
 +
*  http://www.embeddedartists.com/products/lpcxpresso/lpclink2.php
 +
*  https://os.mbed.com/teams/Semtech/code/SX1276TxContinuousWave/
 +
 
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
== [[#top|&uarr;]] [[#references|&darr;]] avr-libc ==
 +
 
 +
<pre>
 +
./avr-libc-1.8.0/include/avr/iom8.h:634:#if !defined(__AVR_LIBC_DEPRECATED_ENABLE__)
 +
./avr-libc-1.8.0/include/avr/iom8.h:657:#endif  /* !defined(__AVR_LIBC_DEPRECATED_ENABLE__) */
 +
 
 +
.
 +
.
 +
.
 +
 
 +
633 /* Deprecated items */
 +
634 #if !defined(__AVR_LIBC_DEPRECATED_ENABLE__)
 +
635
 +
636 #pragma GCC system_header
 +
637
 +
638 #pragma GCC poison SIG_INTERRUPT0
 +
639 #pragma GCC poison SIG_INTERRUPT1
 +
640 #pragma GCC poison SIG_OUTPUT_COMPARE2
 +
641 #pragma GCC poison SIG_OVERFLOW2
 +
642 #pragma GCC poison SIG_INPUT_CAPTURE1
 +
643 #pragma GCC poison SIG_OUTPUT_COMPARE1A
 +
644 #pragma GCC poison SIG_OUTPUT_COMPARE1B
 +
645 #pragma GCC poison SIG_OVERFLOW1
 +
646 #pragma GCC poison SIG_OVERFLOW0
 +
647 #pragma GCC poison SIG_SPI
 +
648 #pragma GCC poison SIG_UART_RECV
 +
649 #pragma GCC poison SIG_UART_DATA
 +
650 #pragma GCC poison SIG_UART_TRANS
 +
651 #pragma GCC poison SIG_ADC
 +
652 #pragma GCC poison SIG_EEPROM_READY
 +
653 #pragma GCC poison SIG_COMPARATOR
 +
654 #pragma GCC poison SIG_2WIRE_SERIAL
 +
655 #pragma GCC poison SIG_SPM_READY
 +
656
 +
657 #endif  /* !defined(__AVR_LIBC_DEPRECATED_ENABLE__) */
 +
 
 +
</pre>
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
== [[#top|&uarr;]] [[#references|&darr;]] EWAVR, IAR Workbench, Keil compiler notes ==
 +
 
 +
2019-01-03 THU
 +
 
 +
*  http://www.keil.com/support/man/docs/c51/c51_le_sfr.htm
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
==  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - ==
 +
 
 +
== [[#top|&uarr;]] [[#references|&darr;]] Yocto References ==
 +
 
 +
 
 +
*  [https://github.com/toradex/meta-product Yocto meta-product project by Toradex]
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
==  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - ==
 +
 
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
== [[#top|&uarr;]] [[#references|&darr;]] Mobile App Development On Linux ==
 +
 
 +
*  https://www.raywenderlich.com/122189/introduction-to-open-source-swift-on-linux
 +
*  http://www.instructables.com/id/Creating-your-first-iOS-app/
 +
*  https://developer.apple.com/support/purchase-activation/ . . . required fees to Apple company
 +
 
 +
- 2018-10-12 FRI -
 +
*  https://developer.apple.com/documentation/corebluetooth
 +
 
 +
- 2018-01-15 MON -
 +
*  https://andrewmichaelsmith.com/2017/02/developing-an-ios-app-on-linux-in-2017/ . . . Developing an iOS app on Linux in 2017
 +
*  https://itsfoss.com/mount-iphone-ipad-ios-7-ubuntu-13-10/ . . . Ubuntu mount iPhone via libimobiledevice4 libimobiledevice-dev libimobiledevice-util and others
 +
*  https://beebom.com/how-use-iphone-with-linux/
 +
 
 +
 
 +
=== [[#top|&uarr;]] [[#references|&darr;]] Android programming ===
 +
 
 +
*  https://www.ntu.edu.sg/home/ehchua/programming/android/Android_3D.html
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
==  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - ==
 +
 
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
== [[#top|&uarr;]] [[#references|&darr;]] Toradex embedded ARM computers ==
 +
 
 +
Search for Toradex asymmetric core 'system on a module' board:
 +
 
 +
*  [https://docs.toradex.com/104446-colibri-arm-som-imx6ull-datasheet.pdf 104446-colibri-arm-som-imx6ull-datasheet.pdf] . . . looks like this may be only single core, not dual heterogeneous core
 +
 
 +
It looks like Colibri iMX7S and iMX7D are two-core and three-core processor based modules, with asymmetric cores to handle different kinds of data processing more efficiently,
 +
 
 +
*  Toradex PN: 00391100 - Colibri iMX7 Dual 1GB | V1.1A
 +
*  Toradex PN: 01351101 - Iris carrier board
 +
 
 +
 
 +
Looks like the Iris carrier board is a smaller form, less featured but more economical carrier board to support use of iMX7D/S systems on modules:
 +
 
 +
*  https://developer.toradex.com/products/iris-carrier-board
 +
 
 +
Software to install on this module:
 +
 
 +
*  https://www.toradex.com/computer-on-modules/colibri-arm-family/nxp-freescale-imx7
 +
 
 +
 
 +
Software projects and stacks to run on asymmetric core systems:
 +
 
 +
*  https://community.nxp.com/docs/DOC-104422
 +
 
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
=== [[#top|&uarr;]] [[#references|&darr;]] Build U-boot and Linux kernel from source ===
 +
 
 +
*  https://developer.toradex.com/knowledge-base/build-u-boot-and-linux-kernel-from-source-code
 +
 
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
<!-- SECTION - Arduino Development Kit and Documentation -->
 +
 
 +
=== [[#top|&uarr;]] [[#references|&darr;]] Arduino Development Kit and Documentation ===
 +
 
 +
Looking into Arduino boards as a means to configure an I2C protocol programmer . . .
 +
 
 +
Arduino Uno development board datasheet:
 +
*  https://www.farnell.com/datasheets/1682209.pdf
 +
 
 +
Arduino IDE software download:
 +
*  https://www.arduino.cc/en/Main/Software
 +
 
 +
Getting started:
 +
*  https://www.arduino.cc/en/Guide/HomePage
 +
**  https://www.arduino.cc/en/Guide/Linux
 +
 
 +
 
 +
A more specifically purposed interface and or programming board called 'Aardvark' . . .
 +
 
 +
*  https://www.totalphase.com/support/articles/200468316
 +
 
 +
 
 +
FreeRTOS on Arduino development boards . . .
 +
*  https://github.com/feilipu/Arduino_FreeRTOS_Library
 +
 
 +
<!-- comment -->
 +
 
 +
==  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - - ==
 +
 
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
== [[#top|&uarr;]] [[#references|&darr;]] Electronics ==
 +
 
 +
*  https://www.sparkfun.com/products/18572
 +
 
 +
Transistor, FETs, Op-amps . . .
 +
<ul>
 +
  <li> https://www.electronics-tutorials.ws/amplifier/transistor-biasing.html <br />
 +
 
 +
  <li> http://bg-electronics.de/shop/product_info.php/products_id/6409/language/en  . . . MPSA14 Darlington pair NPN transistor <br />
 +
</ul>
 +
 
 +
Photovoltaics . . .
 +
<ul>
 +
  <li> https://www.digikey.com/en/articles/techzone/2018/sep/overcoming-power-system-design-challenges-in-1500-vdc-photovoltaic-systems?utm_medium=email&utm_source=tnl&utm_campaign=40284_TNL1811A&utm_content=article1learnmore_US&utm_cid=9726770&mkt_tok=eyJpIjoiWkRFeE1qQmxOMlF4T1dFeCIsInQiOiJLbDVRQkhIUmpGMThyK054VWhLZGFxWmJ5OUpyMHMrdGVKZVdxWnluM1wvRVgxdWcyTzNWQnJrd0wzTlk1SXpqZHZvMWxDNGd4blB3bGFWdWFOSWVsMTNmbWswU1M5aVZhck8wTm1ZK3FBZzFUQXJkK2NZdXlzZng1S2lqTGpob1UifQ%3D%3D <br />
 +
</ul>
 +
 
 +
Analog computers
 +
<ul>
 +
  <li>  http://www.analogmuseum.org/library/handbook_of_analog_computation.pdf
 +
</ul>
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
=== [[#top|&uarr;]] [[#references|&darr;]] tools and hardware ===
 +
 
 +
<ul>
 +
*  https://www.amazon.com/Illuminated-Jewelers-Trichome-Formline-Supply/dp/B073HWZGP3/ref=sr_1_40?hvadid=241934704451&hvdev=c&hvlocphy=9033803&hvnetw=g&hvpos=1t1&hvqmt=e&hvrand=14352835026335723525
 +
</ul>
 +
 
 +
<ul>
 +
32-razradnii kontrolerya . . .
 +
*  https://docplayer.ru/amp/27429677-32-razryadnyy-kontroller-dlya-aviacionnogo-primeneniya-1986ve1t-k1986ve1t-mdr32f1qi-k1986ve1n4.html
 +
</ul>
 +
 
 +
 
 +
=== [[#top|&uarr;]] [[#references|&darr;]] measurement equipment ===
 +
 
 +
2020-10-27
 +
<ul>
 +
https://saving.em.keysight.com/en/used/oscilloscopes-digital-waveform-analyzers
 +
</ul>
 +
 
 +
Not used but I have this 4 channel 100mhz scope that i like a lot. $500 with built-in i2c/spi/uart/canbus decoding
 +
https://siglentna.com/product/sds1104x-e-100-mhz/
 +
https://www.youtube.com/watch?v=Kay4Jk2DHuE
 +
https://www.youtube.com/watch?v=Cwbwq-AKbPc
 +
SiglentSiglent
 +
SDS1104X-E (100 MHz) | Siglent
 +
Bandwidth: 100 MHz Channels: 4 Real time sampling rate: 1 GSa/s (Total of 2 A-to-D converters) Maximum capture rate: (100,000 in Normal mode, 400,000 in Sequence mode) Memory depth: 14 Mpts Bode Plot function (Requires SIGLENT SDG X or SAG1021 function generator) Search / Navigate functions Web-Based browser remote control Optional Wi-Fi dongle Optional MSO capability 
 +
YouTubeYouTube | EEVblog
 +
EEVblog #1042 - Siglent's $499 SDS1104X-E 4CH Oscilloscope Teardown
 +
 
 +
 
 +
<!-- comment -->
 +
 
 +
=== [[#top|&uarr;]] [[#references|&darr;]] Modbus protocol ===
 +
 
 +
<ul>
 +
[[modbus_notes|Modbus protocol notes]]
 +
</ul>
 +
 
 +
 
 +
<!-- SECTION - Other Things To Explore -->
 +
 
 +
== [[#top|&uarr;]] [[#references|&darr;]] <!-- [[#top|^]] --> Mathematica ==
 +
 
 +
Mathematical symbols:
 +
*  https://en.wikipedia.org/wiki/Glossary_of_mathematical_symbols
 +
*  https://en.wikipedia.org/wiki/List_of_mathematical_symbols_by_subject
 +
 
 +
 
 +
Important mathematical topics:
 +
*  https://en.wikipedia.org/wiki/Pure_mathematics
 +
*  ( applied mathematics link to go here )
 +
 
 +
<!-- comment -->
 +
 
 +
=== [[#top|^]] Books on mathematics ===
 +
Books on mathematics to explore:
 +
<ul>
 +
*  "Lectures and Problems: A Gift to Young Mathematicians (MSRI Mathematical Circles Library)
 +
by V. I. Arnold (Author)"
 +
 
 +
On-line lecture notes:
 +
*  https://tutorial.math.lamar.edu/classes/calci/IndefiniteIntegrals.aspx  Paul's On-line Notes
 +
 
 +
*  An excellent book on the FFT is: E. Oran Brigham, The Fast Fourier Transform, PrenticeHall, Englewood Cliffs, NJ, 1974.
 +
</ul>
 +
 
 +
 
 +
CRC, RSA and other mathematical areas . . .
 +
 
 +
<ul>
 +
*  https://en.wikipedia.org/wiki/Cyclic_redundancy_check
 +
*  [https://en.wikipedia.org/wiki/TWINKLE Integer factorization device TWINKLE by Adi Shamir, of RSA developer trio]
 +
*  [https://en.wikipedia.org/wiki/TWIRL TWIRL factorization device, short article at Wikipedia]
 +
*  [https://en.wikipedia.org/wiki/General_number_field_sieve General Number Field Sieve]
 +
*  [https://en.wikipedia.org/wiki/Heuristic Heuristic way explained]
 +
*  [https://en.wikipedia.org/wiki/L-notation L-notation, to express computational complexity of algorithms]
 +
*  [https://en.wikipedia.org/wiki/Discrete_logarithm discrete logarithms]
 +
</ul>
 +
 
 +
 
 +
Applied math . . .
 +
<ul>
 +
*  https://owlcation.com/stem/Everything-About-Triangles-and-More-Isosceles-Equilateral-Scalene-Pythagoras-Sine-and-Cosine
 +
</ul>
 +
Fractal geometry and math . . .
 +
 
 +
<ul>
 +
*  http://mathworld.wolfram.com/StrangeAttractor.html
 +
*  http://mathworld.wolfram.com/LorenzAttractor.html
 +
</ul>
 +
 
 +
 
 +
Quantum computing and Shor's algorithm . . .
 +
<ul>
 +
*  https://en.wikipedia.org/wiki/Shor%27s_algorithm  algoritmo de Shor
 +
*  https://en.wikipedia.org/wiki/Lenstra_elliptic-curve_factorization#Quantum_version_(GEECM) GEECM
 +
</ul>
 +
---
 +
<ul>
 +
*  https://en.wikipedia.org/wiki/Condensed_matter_physics
 +
*  https://en.wikipedia.org/wiki/Bose%E2%80%93Einstein_condensate
 +
</ul>
 +
---
 
<ul>
 
<ul>
[[modbus_notes|Modbus protocol notes]]
+
*  https://www.cnet.com/pictures/take-a-look-at-googles-quantum-computing-technology/17/
 
</ul>
 
</ul>
 +
<!-- comment -->
  
 +
=== [[#top|^]] Fast Fourier Transform FFT ===
  
<!-- SECTION - Other Things To Explore -->
+
*  https://en.wikipedia.org/wiki/Fast_Fourier_transform
 +
<ul>
 +
*  https://en.wikipedia.org/wiki/Big_O_notation
 +
*  https://en.wikipedia.org/wiki/Root_of_unity
 +
Other FFT algorithms:
 +
*  https://en.wikipedia.org/wiki/Hexagonal_fast_Fourier_transform
 +
</ul>
  
== [[#top|&uarr;]] [[#references|&darr;]] <!-- [[#top|^]] --> Mathematica ==
+
*  https://mathworld.wolfram.com/FastFourierTransform.html  Wolfram Math World, Fast Fourier Transform
 +
<!-- comment -->
  
Books on mathematics to explore:
+
Other mathematical topics:
 
<ul>
 
<ul>
"Lectures and Problems: A Gift to Young Mathematicians (MSRI Mathematical Circles Library)
+
https://en.wikipedia.org/wiki/Field_(mathematics)
by V. I. Arnold (Author)"
+
*  https://en.wikipedia.org/wiki/Riemann_zeta_function
 
</ul>
 
</ul>
  
 +
<!-- comment -->
 +
 +
== [[#top|&uarr;]] [[#references|&darr;]] <!-- [[#top|^]] --> Literature ==
  
CRC, RSA and other mathematical areas . . .
+
Liturature and Authors of the World . . .
  
 
<ul>
 
<ul>
*  https://en.wikipedia.org/wiki/Cyclic_redundancy_check
+
*  https://www.literarytraveler.com/articles/tolkien_lewis_england/
*  [https://en.wikipedia.org/wiki/TWINKLE Integer factorization device TWINKLE by Adi Shamir, of RSA developer trio]
 
*  [https://en.wikipedia.org/wiki/TWIRL TWIRL factorization device, short article at Wikipedia]
 
*  [https://en.wikipedia.org/wiki/General_number_field_sieve General Number Field Sieve]
 
*  [https://en.wikipedia.org/wiki/Heuristic Heuristic way explained]
 
*  [https://en.wikipedia.org/wiki/L-notation L-notation, to express computational complexity of algorithms]
 
*  [https://en.wikipedia.org/wiki/Discrete_logarithm discrete logarithms]
 
 
</ul>
 
</ul>
  
  
Applied math . . .
+
<!-- comment -->
<ul>
 
*  https://owlcation.com/stem/Everything-About-Triangles-and-More-Isosceles-Equilateral-Scalene-Pythagoras-Sine-and-Cosine
 
</ul>
 
Fractal geometry and math . . .
 
 
 
<ul>
 
*  http://mathworld.wolfram.com/StrangeAttractor.html
 
*  http://mathworld.wolfram.com/LorenzAttractor.html
 
</ul>
 
 
 
 
 
Quantum computing and Shor's algorithm . . .
 
<ul>
 
*  https://en.wikipedia.org/wiki/Shor%27s_algorithm  algoritmo de Shor
 
*  https://en.wikipedia.org/wiki/Lenstra_elliptic-curve_factorization#Quantum_version_(GEECM) GEECM
 
</ul>
 
---
 
<ul>
 
*  https://en.wikipedia.org/wiki/Condensed_matter_physics
 
*  https://en.wikipedia.org/wiki/Bose%E2%80%93Einstein_condensate
 
</ul>
 
---
 
<ul>
 
*  https://www.cnet.com/pictures/take-a-look-at-googles-quantum-computing-technology/17/
 
</ul>
 
 
 
 
 
<!-- comment -->
 
 
 
== [[#top|&uarr;]] [[#references|&darr;]] <!-- [[#top|^]] --> Literature ==
 
 
 
Liturature and Authors of the World . . .
 
 
 
<ul>
 
*  https://www.literarytraveler.com/articles/tolkien_lewis_england/
 
</ul>
 
 
 
 
 
<!-- comment -->
 
  
 
== [[#top|&uarr;]] [[#references|&darr;]] Other Things To Explore ==
 
== [[#top|&uarr;]] [[#references|&darr;]] Other Things To Explore ==
Line 1,969: Line 2,415:
 
*  https://www.indefenseofplants.com/blog/2015/7/23/an-orchid-invader-with-an-interesting-ecology  helleborine orchid
 
*  https://www.indefenseofplants.com/blog/2015/7/23/an-orchid-invader-with-an-interesting-ecology  helleborine orchid
  
 +
<!-- comment -->
 +
 +
==== [[#top|^]] plant pathology ====
 +
 +
https://www.apsnet.org/publications/phytopathology/backissues/Documents/1971Articles/Phyto61n08_926.PDF
  
 
<!-- comment -->
 
<!-- comment -->
  
 
<!-- SECTION - Food and Cooking -->
 
<!-- SECTION - Food and Cooking -->
 +
 +
== [[#top|^]] Technology History and Evolution ==
 +
Moore's Law and CMOS scaling ways:
 +
*  https://meroli.web.cern.ch/lecture_scaled_CMOS_Technology.html
 +
*  https://en.wikipedia.org/wiki/65_nm_process
 +
*  https://en.wikipedia.org/wiki/Low-%CE%BA_dielectric
 +
<!-- comment -->
  
 
== [[#top|^]] Astronomy ==
 
== [[#top|^]] Astronomy ==
Line 2,003: Line 2,461:
  
 
== [[#top|^]] Food and Cooking ==
 
== [[#top|^]] Food and Cooking ==
 +
 +
*  https://getpocket.com/explore/item/the-best-ever-eggplant-parmigiana?utm_source=pocket-newtab  Italian eggplant parmigiana
  
 
Turkish traditional dishes, borek . . .
 
Turkish traditional dishes, borek . . .
Line 2,020: Line 2,480:
 
== [[#top|^]] References ==
 
== [[#top|^]] References ==
  
[[Notes|notes]]
+
[[Notes|Neela Nurseries wiki notes]]
  
 
<br />
 
<br />
Line 2,086: Line 2,546:
 
*  https://www.nxp.com/docs/en/user-guide/UM10204.pdf
 
*  https://www.nxp.com/docs/en/user-guide/UM10204.pdf
  
 +
Access iPhone via Linux
 +
*  https://www.maketecheasier.com/easily-mount-your-iphone-as-an-external-drive-in-ubuntu/
  
 +
 +
<!-- comment -->
 +
 +
== [[#top|^]] End of page ==
  
  
<!-- comment -->
+
&nbsp;<br />
 +
&nbsp;<br />
  
 
<center>
 
<center>

Latest revision as of 17:46, 18 April 2024

-- 2017-07-21 शुक्रवार --
User Ted's wiki page at Neela Nurseries
musica, संगीत


OVERVIEW

This wiki document a starting point of Ted's notes on Linux use and configuration, Open Source Software and web development.

This local notes page on Neela Nurseries wiki not yet well organized, but here as a quick stash point for holding useful references and a starting point for more complete and formal documentation.

Music notes here  :::  NN keywords template  :::  Nordic Devzone posts  :::  CircuitDojo Forum  :::  Untangling complex C declarations

Keywords: Untangling Detangling Untangling C Declarations Nordic Devzone firmware goals


^ Technology and Tools

Quick links to local notes and references:

1 2 3 4
Technical groups Hardware references Operating systems Tools and Toolchains
5 6 7 8
Documentation Programming languages Programming languages Data Integrity
9 10 11 12
Technologies Local works Local works Code Libraries
13 14 15 16
Open software projects Comms protocols Encodings Hardware issues
17 18 19 20
Local stuff Academic Cloud based services Interesting projects

^ temporary section

Note: useful to add ratings of completeness and organization to above links that point to local wiki pages.

http://iotfactory.eu/lorawan-world-frequency-map-lora-sigfox-nbiot-telecom-operators-per-country/ LoRaWAN world frequency map (not exhaustive)

Always useful to review, wiki table syntax help:

 *  wiki table help

Wiki-driven table of contents here:

Contents



Countries and politics



Community, Culture, the World

Following sections on Community, Geography, Culture, Musica and the world may become a separate wiki page in the future.


Geography and Place



People

Cultural and envinrmental:



Encontrado 2019-12-30 lunes, commentario sobre Mahatma Gandhi:


Tech authors, astronomy, more Linux reference material:


Human languages

- 2017-12-15 FRI -


Science

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

- 2017-10-05 - Ted noting here that would be good to have a technical glossary to make easily accessible all the technical terms which arise in daily work and exploration of technologies . . .


- 2017-10-19 - TO-DO list:

  *  [✓] complete LFS 8.1 exercise
  *  [ ] configure xserver to run stand-along without window manager (seems to be working on 1604 spare LTS host . . .)
  *  [ ] set up two mysql servers on one host
  *  [ ] write "best photo contribution" practices page for ASI
  *  [ ] code "re-use or reference text block" module for MediaWiki  <-- this needs further explanation - TMH 
  *  [ ] in local Neela Nurseries PHP code base, amend hybrid building of nav menus to include highlighting parent page of given viewed page
  *  [ ] in OpenCart 2.x find way to customize top-of-page information and links
  *  [ ] in OpenCart 2.x find way to format product lists as compact lists, like Gmail inbox or Windows 'list view' of files


GNU Make and GCC Tools


2018-07-18 NOTE: this section to be moved to separate GCC and Make article . . . - TMH


Using macros with gcc:

Code libraries and shared objects, expressing paths to them:

gcc.gnu.org - 3.15 Specifying subprocesses and switches passed to them

gcc how to show macros and pre-processor defines:


OpenOCD and Eagle set up notes

Eagle fails to start due to symbols not resolve-able . . .

 *  https://forums.autodesk.com/t5/eagle-forum/can-t-run-eagle-on-debian-10-testing/td-p/8312348

Automake or autoconf or autoreconf -i fails for LIBTOOL undefined . . .

 *  https://stackoverflow.com/questions/18978252/error-libtool-library-used-but-libtool-is-undefined


 *  https://stackoverflow.com/questions/43565009/failing-to-enable-stlink-in-openocd


Mediawiki Issues and Notes

- 2018-01-22 - While editing sidebar of Mediawiki instance at Neela, Ted noticing a difference in Mediawiki's treatment of hyperlinks in the sidebar. Links to external sites don't appear, and links to internal pages require single square brace enclosure to appear with alternate text as a link label . . .

<!--
** [https://buildroot.org/downloads/manual/manual.html Buildroot manual]
<a href="https://buildroot.org/downloads/manual/manual.html">Buildroot manual</a>

- 2018-01-22 MON -
** https://wiki.neelanurseries.com/index.php/Nn_embedded_linux_notes#.E2.86.91_.E2.86.93_Buildroot|Buildroot notes . . . only 'notes' shows as non-link text - TMH
-->


^ File uploads

- 2018-06-29 FRI - Issue adding .txt type files to whitelist of Mediawiki installation uploadable files:

Action failed

Could not open lock file for "mwstore://local-backend/local-public/e/ec/Asi-officers-list-2018.txt".

Return to Main Page.

200px|thumb|left|png type image to test file uploads of allowed image type . . .
media:arrow-up-prelight.png


Following link may have helpful information:

- 2018-07-25 WED -


^ Images in wiki pages and image attributes


^ Mediawiki layout topics like multi column layout

- 2018-11-30 FRI -


^ Other Mediawiki topics


Web Site Building Blocks - Summer 2017 to 2020 Q1 Work

Must begin a new section on web site security issues. Here are a couple of articles as starting points to sleuth out how the "WARNING - Please read me XMG" ransomeware attack can reach MYSQL databases of on-line hosts:


2019-11-12


2020-01-27 htpasswd access files


Open Source License Types



Linux Packages (Separate Article)

Linux software package notes a separate wiki document on Neela wiki. - TMH


- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Bash Shell Scripting

Bash (Bourne shell) Quick Reference:

Shell Built-in Variables:

   $0    Name of given shell script itself
   $1    Value of first command line parameter (similarly $2, $3, ...)
   $#    In given shell script the number of command line parameters received
   $*    All of the command line parameters
   $-    Options given to the shell
   $?    Return (or holds) the exit status of the last command
   $$    Process id of given script (really the id of the shell running the script)


Shell test constructs:

SYNTAX      NAME OF SHELL TEST                                NOTES

[           built-in test                                     considers its arguments as comparison expressions or file tests

[[...]]     in Bash => 2.02 the extended test command

((...))     arithmetic tests                                  example:  (( 0 && 1 ))  # Logical AND


References:


Shell scripting and use of built-in shell commands is a practical knowledge to employ, when working in Unix-like environments. One common task is to find all the instances of a given file or program. The locate command can perform this kind of search, but it's results don't show whether the file instances differ. To check at the rough level of file size, we can use a one-line shell script technique involving shell piping, to "long list" the results of the locate command, like this . . .

  $ for file in `locate tavrasm | grep 'asm$'`; do ls -l ${file}; done

Hmm strange, the above command calls `grep` with a pattern that ends in the shell end-of-line anchoring character $, and appears to filter for results of `locate` which end in 'asm'. But on 2017-09-12 needed to add a "one or more wildcard" character pattern to limit search results for instances of `locate` results ending in 'qemu':

    $ locate qemu | grep '.*qemu$'

Why the apparent difference in command invocation? Need to test . . . - TMH


Command to break out first ten $PATH environment variable to individual paths each shown on a line of the shell:

    $ for path in `echo $PATH | cut -d':' -f1-10 --output-delimiter=' '`; do echo $path; done

2018-04-23 - Monday, command to obtain summary of directories containing 1GB or more data:

    $ du -h . | grep [0-9]G



edit point - shell variable quoting

- 2017-10-19 THU -

Running into issues when need to expand shell variable in single quotes pair . . .

Stack Exchange, Unix forum post 178411
TLPD Advanced Bash Scripting Guide, chapter 4.2 example 4-3 double quotes preserve white space


WIKI WISH LIST - While adding to wiki, Ted noting that would be useful to have relative-depth wiki section markers. The standard wiki section markers '== ==', '=== ===' and similar have fixed depth. That is, '== ==' is always a top-level or first-level section in a wiki document, '=== ===' is always a sub-subsection of wiki documents, and '==== ====' a sub-sub-section. When section gets re-factored into its own article, would be handy to have those section markers rise up to levels of top-most and successive section markers. - TMH



example shell script - back up several databases

 
Here is a simple shell script to call mysqldump utility and back up several databases. Couple of things Ted wants to add to this script include script variables to hold back-up filename prefix and infix patterns, and an option to compress the MYSQL dump files . . .

Figure x - shell script to back-up multiple MYSQL databases


#!/bin/bash


DATABASE_LIST="information_schema mysql drupal_8p0 phpmyadmin wiki_database"

user="root"
pass_phrase_for_mysql="mysql_user_password"
options_extra="--skip-lock-tables"

response="n"

mode_interactive="n"



echo "shell script starting,"



for database in ${DATABASE_LIST};
do echo "backing up alta-ubuntu database $database . . .";

#    command="mysqldump --databases $database -u$user -p$pass_phrase_for_mysql $options_extra >> au-database-back-up--${database}.sql"
    command="mysqldump --databases $database -u$user -p$pass_phrase_for_mysql $options_extra"
    redirect="au-database-back-up--${database}.sql"

    if [ $mode_interactive = 'y' ]; then

        echo "build command '$command' and database back-up filename'$redirect',"
        echo "full command will be '$command' > '$redirect',"
        echo "trying running this command and redirect? [y/N/q]  yes, no, 'q' to quit"

        read response
        if [ $response = 'Y' -o $response = 'y' ]; then
            ${command} > $redirect
        elif [ $response = 'N' -o $response = 'n' ]; then
            echo "skipping present command . . ."
        elif [ $response = 'Q' -o $response = 'q' ]; then
            echo "stopping script '$0' and exiting."
            break
        fi
        echo

    else

        echo "$0:  backing up database '$database' to file '$redirect' . . ."
        ${command} > $redirect
        ls -l $redirect

    fi

done


echo "done."

exit 0

show kernel version script

Following script 'showkversion' can be used in a Linux kernel source tree to determine the kernel's version number, based on the number elements defined in the kernel's top level makefile.

Figure x - simple bash script to show kernel version in root of kernel sources tree

#!/bin/bash

## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
## Started 2017-12-15 FRI - script to parse and show Linux kernel
##  version from top-level makefile in set of kernel sources.  Patterns
##  to `grep` chosen based on kernel version identifiers in first
##  three lines of typical kernel top-level makefile.  Example:
##
##  $ head -n 6 Makefile
##  VERSION = 4
##  PATCHLEVEL = 9
##  SUBLEVEL = 66
##  EXTRAVERSION =
##  NAME = Roaring Lionus
##
##
## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -


script_name="showkversion"


if [ ]; then
    head -n 5 Makefile | grep ^VERSION | cut -d " " -f 3
    head -n 5 Makefile | grep ^PATCH | cut -d " " -f 3
    head -n 5 Makefile | grep ^SUBLEVEL | cut -d " " -f 3
fi

MAJOR=$(head -n 5 Makefile | grep ^VERSION | cut -d " " -f 3)
MINOR1=$(head -n 5 Makefile | grep ^PATCH | cut -d " " -f 3)
MINOR2=$(head -n 5 Makefile | grep ^SUBLEVEL | cut -d " " -f 3)

KERNEL_REVISION="${MAJOR}.${MINOR1}.${MINOR2}"

echo
echo "Kernel version in present kernel sources tree, per makefile, is ${KERNEL_REVISION}"
echo


exit 0



Other useful shell tutorial references



Regex tutorials

2019-11-02 - An interesting blog post and replies, at, I think, Jamie Zawinski's home page. This one on the use and some limits of regular expressions:

  *  https://www.jwz.org/blog/2011/11/you-doom-us-all-to-inhuman-toil-for-the-one-whose-name-cannot-be-expressed-in-the-basic-multilingual-plane/


`sed` stream editor

Unix `sed` stream editor, examples and references:

Code snippet - rename multiple files where a substring need be changed:

   $ for file in `ls ./2109*.*`; do mv $file `ls -1 $file | sed s/2109/2019/` ; done

References on `sed`:

2021-08-26:


Other Computer Programming Languages

Python Scripting Language



Expect Utility by Don Libes

Installing 'expect' on Ubuntu 16.04.x LTS host, typical dependencies:

ted@localhost:~/projects/shell/expect-work$ sudo apt install expect

Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following additional packages will be installed:
  libfontenc1 libxaw7 libxmu6 libxmuu1 libxtst6 libxv1 libxxf86dga1 tcl-expect tcl8.6 tk8.6 x11-utils xbitmaps xterm
Suggested packages:
  tcl-tclreadline mesa-utils xfonts-cyrillic
The following NEW packages will be installed:
  expect libfontenc1 libxaw7 libxmu6 libxmuu1 libxtst6 libxv1 libxxf86dga1 tcl-expect tcl8.6 tk8.6 x11-utils xbitmaps xterm
0 upgraded, 14 newly installed, 0 to remove and 5 not upgraded.
Need to get 1,373 kB of archives.
After this operation, 4,110 kB of additional disk space will be used.
Do you want to continue? [Y/n] y
  .
  .
  .


Some 'expect' utility references:

Good short examples covering range of tasks here at Robert Elder blog page, noting md5sum expect script example . . .

How to capture specific results during an expect script's execution:


- 2018-01-30 - Tuesday, picking up from last week researching how to redirect expect output and its spawned processes' output with filtering to log file. The first reference here at Stackoverflow repeats the useful lindex syntax. There is also mention of the expect manual and a syntax $::env(action) which can be expressed in an expect script to access an environment variable that is part of the controlling shell . . .

How to use expect's log_file key word in an expect script:

From the manual page for expect version 5.45:

           log_file [args] [[-a] file]
                 If a filename is provided, log_file will record a transcript of the session (beginning at that point) in
                 the file.  log_file will stop recording if no argument is given.  Any previous log file is closed.
    
                 Instead  of  a  filename,  a Tcl file identifier may be provided by using the -open or -leaveopen flags.
                 This is similar to the spawn command.  (See spawn for more info.)
    
                 The -a flag forces output to be logged that was suppressed by the log_user command.
    
                 By default, the log_file command appends to old files rather than truncating them, for  the  convenience
                 of  being  able  to  turn  logging off and on multiple times in one session.  To truncate files, use the
                 -noappend flag.
    
                 The -info flag causes log_file to return a description of the most recent non-info arguments given.
    


Also from the expect manual page, Expect Hints section:

    EXPECT HINTS
           There are a couple of things about Expect that may be non-intuitive.  This section attempts to address some of
           these things with a couple of suggestions.
    
           A common expect problem is how to recognize shell prompts.  Since these are customized differently by  differ-
           ently  people and different shells, portably automating rlogin can be difficult without knowing the prompt.  A
           reasonable convention is to have users store a regular expression describing their prompt (in particular,  the
           end  of it) in the environment variable EXPECT_PROMPT.  Code like the following can be used.  If EXPECT_PROMPT
           doesn't exist, the code still has a good chance of functioning correctly.
    
               set prompt "(%|#|\\$) $"          ;# default prompt
               catch {set prompt $env(EXPECT_PROMPT)}
    
               expect -re $prompt
    
           I encourage you to write expect patterns that include the end of whatever you expect to see.  This avoids  the
           possibility  of  answering a question before seeing the entire thing.  In addition . . .
    


The expect program has some built-in string buffers, and one of these may hold the latest characters received from a spawned process. Here is a man page excerpt which shows use of one of these expect buffers:

           disconnect
                 disconnects a forked process from the terminal.  It continues running in the background.  The process is
                 given its own process group (if possible).  Standard I/O is redirected to /dev/null.
    
                 The following fragment uses disconnect to continue running the script in the background.
    
                     if {[fork]!=0} exit
                     disconnect
                     . . .
    
                 The following script reads a password, and then runs a program every hour that demands a  password  each
                 time  it is run.  The script supplies the password so that you only have to type it once.  (See the stty
                 command which demonstrates how to turn off password echoing.)
    
                     send_user "password?\ "
                     expect_user -re "(.*)\n"
                     for {} 1 {} {
                         if {[fork]!=0} {sleep 3600;continue}
                         disconnect
                         spawn priv_prog
                         expect Password:
                         send "$expect_out(1,string)\r"
                         . . .
                         exit
                     }
    


Further looking for expect's built-in string buffers and variables . . .

Pattern matching syntax in Don Libe's expect . . .


From another source, Tcl's string match command:

if [string match "f*b*" "foobar"] {
   puts "match"
else {
   puts "no match"
}



edit point - Tool command language Tcl

"Practical programming
in Tcl and Tk"
ISBN 0-13-038560-3


In using Don Libes' expect utility or program, looks like it will be important and helpful to understand Tool Command Language Tcl to at least some fluency. Here appears to be a good starting point tutorial for Tcl:


Tcl puts built-in command, channels and code to open log file,

Append a log message to a file:

set chan [open my.log a]
set timestamp [clock format [clock seconds]]
puts $chan "$timestamp - Hello, World!"
close $chan


Tcl regular expressions:


Tcl reserved words:

after		append		array		auto_execok
auto_import	auto_load	auto_load_index	auto_qualify
binary		Bgerror		break		catch
cd		Clock		close		concat
continue	Dde		default		else
elseif		Encoding	eof		error
eval		Exec		exit		expr
fblocked	Fconfigure	fcopy		file
fileevent	Flush		for		foreach
format		Gets		glob		global
history		If		info		interp
join		Lappend		lindex		linsert
list		Llength		load		lrange
lreplace	Lsearch		lsort		namespace
open		Package		pid		pkg_mkIndex
proc		Puts		pwd		read
regexp		Regsub		rename		resource
return		Scan		seek		set
socket		Source		split		string
subst		Switch		tclLog		tell
time		Trace		unknown		unset
update		Uplevel		upvar		variable
vwait		While



edit point - Tcl pattern matching and anchoring, symbols ^ and $ wrt data not lines

From the Tcl manual page on-line here is a clue about pattern matching in Tcl scripts, which may explain why we are struggling to obtain matched substrings from sequences of bytes from expect-spawned processes . . .

        Note that in many editors, the ^ and $ match the beginning and end of lines respectively. However, because expect is not line oriented, these characters match the beginning and end of the data (as opposed to lines) currently in the expect matching buffer. (Also, see the note below on "system indigestion.")
    


Tcl regular expression syntax:


Expect variables, using global and upvar keywords in Tcl scripts:


Excerpt on Tcl pattern matching from Inguza web site:

2   Expect
The expect suite actually consist just of a few commands: expect, send, spawn and interact and is an extension to TCL.
Before the expect command can be used a program must be spawned, see expect commands below.
expect \
  {match1} {action1} \
  {match2} {action2} \
  {match3} {action3} \
  {match4} {action4}
It is possible that no such output is encountered within the time period defined by the timeout (variable name "timeout" in seconds, default to 2). In this case expect stops waiting and continues with the next command in the script.
You can use '*' to match any characters. You can also match using [] syntax and similar.
expect "\[a-f0-9]"  ; # strongly preferred as \n and similar is not taken as litteral charactesr \ and n.
expect {a-f0-9}     ; # can also be used
A note on \ characters. The pattern matcher translate \x to x but this is done once before the pattern matcher. So you need to type \\n to match n. This is especially important for * and ? characters.
expect "*" ;# match anything (*)
expect "\n" ;# match linefeed
expect "\*" ;# match anything
expect "\\*" ;# match * character
expect "\\\*" ;# match * character
expect "\\\\*" ;# match \ followed by anything
expect "\\\\\*" ;# match \ followed by anything
expect "\\\\\\*" ;# match \ followed * character
The [ character is special to both tcl and the pattern matcher so it is especially messy.
proc xy {} { return "n*w" }
expect "[xy]" ;# match n followed by anything followed by w
expect "\[xy]" ;# match x or y
expect "\\[xy]" ;# match n followed by anything followed by w
expect "\\\[xy]" ;# match [xy]
expect "\\\\[xy]" ;# match \ followed by n followed ...
expect "\\\\\[xy]" ;# match sequence of \ and then x or y.
The expect command can also take flags. The default flag is -gl for glob pattern matching. It can also take the flag -re for regular expression matching.
expect {
  -re "a*" { action_when_a_followed_by_any_a }
  "b*" { action_when_b_followed_by_anything }
  -gl "-re" { action_when_real_dash_r_e }
  eof { action_on_end_of_file }
  timeout { action_on_command_timeout }
  default { action_on_command_timeout_or_eof }
  -re "(abc)*" { action_on_any_number_of_a_b_c }
  -re "-?(0|\[1-9]\[0-9]*)?\\.?\[0-9]*" { action_on_float_or_integer }
}
You can also pass the pattern as a variable.
set v2pats "pat2 act2"
set v3pats "pat3 act3"
expect pat1 act1 $v2pats $v3pats
Observe that the following expect string is wrong as $v2pats and $v3pats is considered as two different arguments. It will try to match $v2pats as a pattern and $v3pats as an action. Instead build up a string and use the -brace flag. You can not use double quotes for that though, unless you use eval and then the -brace flag is not necessary. You also need to protect the pattern and action inside a [list x] or an extra brace if they contain whitespaces.
2.1   Parentheses for feedback
In the previous section, parantheses were used to group subpatterns together. They can also play another role. When a regular expression successfully matches a string each part of the string that matches a paranthensized subpattern is stored in "expect_out(1,string)" the second in "expect_out(2,string)" etc up to "expect_out(9,string)". The entire pattern matched is stored in "expect_out(0,string)". Everthing before the pattern and the pattern matched is stored in "expect_out(buffer)". The last two assignments work in glob pattern too.
"a*((ab)*|b)"
How is this passed to expect_out? It is quite simple. The entire string withing the first parenthesis is stored in 1 (which means up to end of string). The second fount parenthesis is stored in 2. Look for the left parenthesis to determine where the data is put.
2.2   Flags
-re	
-gl	
-nocase	Ignore case. Do not use -nocase with uppercase characters in the pattern as it will never match.
-notransfer	Prevent expect from removing matching characters from the internal buffer. The characters can be matched repeatedly as long as this option is associated with the pattern. It can be abbreviated with "-n" when expect is running interactively.
-brace	Expect normally see the first argument as a pattern to match, but sometimes you want to give a list of patterns and actions to expect. You can then use -brace to expand the list before it is handled by expect.
expect -brace { pat1 act1 pat2 act2 }
This can be useful when building up lists of pattern to match with corresponding actions to do.
-i n	Use an alternative spawn_id. This applies to all patterns after the -i flag.
expect {
 -i $ftp
 "ftp>" "exit"
 eof "exit"
}
You can also expect values from multiple spawned processes at the same time. At most one action can be executed just as expect normally do.
expect {
 -i $ftp "ftp> " { ftp_action }
 -i $shell $prompt { shell_action }
}
There is an input buffer associated with each spawn id. So any output from ftp is kept separate from thta of the shell in the example above. When output appear on terminal it will be mixed, unless you expect one at a time or set log_user 0 and then wrote output explictly using send_user $expect_out(buffer). The process that did not match will keep its buffer until matched by next expect command.
When the expect command match something it record the spawn_id to expect_out(spawn_id) so you can know which process that it matched against.
You can also set the spawn_id definition to a list of spawn_ids.
expect {
  -i "$host1 $host2 $host3" $prompt {
    an_action $expect_out(spawn_id)
  }
  eof exit
  -i $host1 another_pattern {host1_action}
}
This example will do an_action if $prompt is matched agains any of the $hostnr, exit if end of file is matched against same list and do host1_action if matchina another_pattern from host1.
2.3   Special patterns
Note that these patcherns will only match if none of the '-gl', '-re' or '-ex' flags has been used.
eof	Match when end of file is reached.
timeout	Match when the timeout value has been reached.
default	Match when end of file or timeout is reached.
full_buffer	Match when no other pattern match and expect would otherwise throw away part of the input to make room fore more. When this matches, all of the unmatched input is moved to expect_out(buffer).
null	
By default null characters are removed from the buffer before expect matching is done. This can be disabled using the remove_nulls command below. If it is disabled null characters will be matched using this special keyword. Null characters can not be matched inside a pattern as expect first look for null characters and then do pattern matching. If a null character is found the characters before it is skilled. These caracters can be found in expect_out(buffer).
Since the null character is used internally to represent the end of a string unanchored patterns cannot be matched past a null. This is not a problem since null pattern can always be listed last.


Rust programming language

There are two editions of the Rust Programming book. The Rust home page recommends to start by reading the second edition:


^ C programming notes

This section really should be in a more prominent space of this wiki. - TMH

This section contains link to Brian Barto post about Untangling Complex C Declarations. Click here -> C programming notes <- for separate wiki article.

Typedef and type defining function pointers:

CRC types and implementations:

Floating point representation and conversions:


2021-11-03


^ C++ references

This section contains beginning level C++ issues and references. Section here created by need to note some Qt5 related project elements, as Qt is based on C++. First issue is to understand and document how to implement a QDialog object to act as a sensible dialog box, which can post run-time data to a larger Qt based application. The first reference below mentions QDialog built-in class functions exec(), accept() and reject(), which appear to be the means to start and show, and to close out a Qt based dialog box . . .

Per help index in QtCreator 3.2.1:

void QDialog::accept() [virtual slot]
Hides the modal dialog and sets the result code to Accepted.

See also reject() and done().


The Qt method done() performs more significant work and at least in cases of a dialog being shown with a call to exec() the done() method stops dialog event loop execution:

void QDialog::done(int r) [virtual slot]
Closes the dialog and sets its result code to r. If this dialog is shown with exec(), done() causes the local event loop to finish, and exec() to return r.

As with QWidget::close(), done() deletes the dialog if the Qt::WA_DeleteOnClose flag is set. If the dialog is the application's main widget, the application terminates. If the dialog is the last window closed, the QApplication::lastWindowClosed() signal is emitted.

See also accept(), reject(), QApplication::activeWindow(), and QApplication::quit().


So it looks like if we do not call done() then we want to assure that we call exec() only one time during a use session of GWN Unified Tester. - TMH


2019-10-28 Monday: G++ error, "template has C linkage":

2019-10-30 Wednesday: The purposes and use of extern "C" . . .



- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Aboriginal Linux - project now defunct, new project is 'makeroot'

Ok, looks like Robert Landley's Aboriginal Linux project has been superceded by mkroot. Ladnley's newer makeroot project sources are available at GitHub:



Having trouble carrying out the basic build of Aboriginal Linux with armv6l as target . . .


   .
   .
   .

Confirmed e2fsprogs-1.42.13.tar.gz
Confirmed zlib-1.2.7.tar.bz2
Confirmed squashfs-4.2.tar.gz
=== Got all source.

real    0m2.240s
user    0m1.188s
sys     0m0.176s
=== toybox (host host-tools)
Snapshot 'toybox'...
scripts/genconfig.sh
cc -o kconfig/conf kconfig/conf.c kconfig/zconf.tab.c -DKBUILD_NO_NLS=1 \
                -DPROJECT_NAME=\"ToyBox\"
kconfig/conf -D /dev/null Config.in > /dev/null
scripts/make.sh
Generate headers from toys/*/*.c...
generated/newtoys.h Library probe.......
Make generated/config.h from .config.
generated/flags.h generated/globals.h generated/help.h
Compile toybox................................................................................................................................................................generated/obj/nsenter.o: In function `unshare_main':
nsenter.c:(.text.unshare_main+0x152): undefined reference to `setns'
collect2: error: ld returned 1 exit status
make: *** [toybox] Error 1

Exiting due to errors (host host-tools toybox)


Robert Landley also has a presence on www.patreon.com/landley, where he talks about the over-arching goals in his programming and software systems level work.



Linux From Scratch (Separate Article)

Linux From Scratch Book 8.1 - Build and Notes



QEMU Emulator

Overview

Notes on QEMU, an emulator which can help with building and configuring Linux systems to run on embedded computers and development boards. Ted noting 2017-09-08 that to compile today's latest QEMU source, a 2.10.x release, needed to install Debian stretch packages pkg-config, libglib2.0-dev, dhautoreconf. Here are some links to downloading QEMU project sources, a manual for using QEMU, and an article about emulating a RaspberryPi system by using QEMU:


References:

QEMU to emulate Arm on Linux . . .

How to avoid "raw image format" warning . . .


So got QEMU 2.10.0 sources and dependencies installed, ran `configure` and `make` steps, and let the build process run for an hour or two. But in the end could not find any `qemu` executable. Why is the emulator itself apparently missing? Building latest QEMU under Linux . . .


So I'm following the above article author's typical build steps, and run into this message part-way down those steps, at the step of calling `make`:

user@host-6:~/Downloads/qemu/qemu-2.10.0/bin/debug/native$ make
Makefile:21: *** This is an out of tree build but your source tree (/home/veris/Downloads/qemu/qemu-2.10.0) seems to have been used for an in-tree build. You can fix this by running "make distclean && rm -rf *-linux-user *-softmmu" in your source tree.  Stop.
user@host-6:~/Downloads/qemu/qemu-2.10.0/bin/debug/native$


Ok interesting, I know that QEMU is a complicated project with a complex build process, but clearly I don't know what I'm doing. Following the above 'distclean' command given in the error message from QEMU's makefile, I'm now able to begin an "out of tree" build as described in the "Building QEMU" article at qemu.org just above. Tired already however of QEMU project builds taking more than an hour to complete. Here is one of many articles describing how to invoke `make` to build only limited parts of QEMU project, for example just the pieces needed to emulate ARM type systems:



Ted to test this type of build soon . . .

On a different note, QEMU build has completed and the stock RaspberryPi Debian "Stretch" image is coming up. Needed to install a VNC client to interact with the emulated RaspberryPi operating and software, stored in the downloaded .img file from Rpi's web site. Here's a link to a forum post which clued Ted into Remmina VNC client:



- 2017-11-21 Tuesday -

The version of qemu which installed from Debian's package list didn't seem to work. It's been some weeks now since trying that instance, but qemu 2.10.0 works to bring up a command line image built for RaspberryPi. Here are the versions of the two qemu instances:

Figure x - locating qemu instances, determining their versions


user@localhost:~$ which qemu
/usr/bin/qemu

user@localhost:~$ /usr/bin/qemu --version
QEMU emulator version 1.1.2 (Debian 1.1.2+dfsg-6+deb7u23), Copyright (c) 2003-2008 Fabrice Bellard

user@localhost:~$ ls /opt/qemu
qemu-system-arm

user@localhost:~$ ls -l /opt/qemu/qemu-system-arm
lrwxrwxrwx 1 root root 83 Sep 12 16:37 /opt/qemu/qemu-system-arm -> /home/user/Downloads/qemu/qemu-2.10.0/bin/debug/native/arm-softmmu/qemu-system-arm

user@localhost:~$ /opt/qemu/qemu-system-arm --version
QEMU emulator version 2.10.0
Copyright (c) 2003-2017 Fabrice Bellard and the QEMU Project developers

user@localhost:~


- 2017-11-22 Wednesday -

Yesterday could not bring up raspbian image in qemu, same image which booted and appeared, and permitted shell based login and shell use a month ago on the local host. Looking at a new on-line reference for running raspbian images in qemu:


  *  https://ownyourbits.com/2017/02/06/raspbian-on-qemu-with-network-access/


This above article looks really interesting, appears to go to a second installment of the article where the developers there are building some kind of cloud-based or cloud involved web, database, mail and PHP servers. But on my end having trouble with a kernel panic this morning when invoking qemu-system-arm with a large set of options . . . ok, just located a different invocation of qemu-system-arm version 2.10.0, noting here in following code figure:


Figure x - emulate-rpi shell script


#!/bin/bash
# Starts raspberry pi image in configuration mode


##----------------------------------------------------------------------
## - SECTION - script variables
##----------------------------------------------------------------------

EMULATOR=/home/veris/Downloads/qemu/qemu-2.10.0/bin/debug/native/arm-softmmu/qemu-system-arm



##----------------------------------------------------------------------
## - SECTION - original emulator invocation, everything hard-coded
##----------------------------------------------------------------------

# qemu-system-arm -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw init=/bin/bash" -hda rpi.img

# qemu-system-arm -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw" -hda rpi.img



##----------------------------------------------------------------------
## - SECTION - invocation, emulator as variable:
##----------------------------------------------------------------------

# ${EMULATOR} -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw init=/bin/bash" -hda rpi.img

# Start RaspberryPi in fully functional mode:
${EMULATOR} -kernel ./qemu-rpi-kernel/kernel-qemu -cpu arm1176 -m 256 -M versatilepb -no-reboot -serial stdio -append "root=/dev/sda2 panic=1 rootfstype=ext4 rw" -hda rpi.img






## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
## 2017-09-08 FRI - this script copied from http://embedonix.com/articles/linux/emulating-raspberry-pi-on-linux/
## - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

exit 0


The final token rpi.img points to localhost:/home/user/Downloads/raspberrypi/2017-08-16-raspbian-stretch-lite.img which we downloaded from https://www.raspberrypi.org/downloads/raspbian/. The working qemu invocation doesn't open qemu's native window, but puts to standard out that is the same shell in which qemu invoked, a couple of lines of output from the booting kernel image. Then using remmina we connect via "VNC server running on ::1:5900".

In summary shell script in latest figure successfully invokes qemu-system-arm 2.10.0 built from sources about August 2017, and boots up Raspbian Stretch lite image and kernel named kernel-qemu-4.4.34-jessie. Next figure is screenshot showing successful login, and last login message . . . though emulation was and is very slow on host system!


Figure x - emulated raspbian stretch lite screenshot, Remmina window

media:z.png


A shorter script to start raspberrypi kernel plus image, running in QEMU:

#!/bin/bash

qemu-system-arm -kernel ./kernel-qemu-4.4.34-jessie -cpu arm1176 -m 256 -M versatilepb -serial stdio -append "root=/dev/sda2 rootfstype=ext4 rw" -hda ./2017-09-07-raspbian-stretch-lite.img -redir tcp:5022::22 -no-reboot

exit 0


- 2017-12-12 WED -

An excerpt from qemu.org/download#source, on how to download, configure and compile latest QEMU sources:

"
Build instructions

To download and build QEMU 2.11.0-rc5:

wget https://download.qemu.org/qemu-2.11.0-rc5.tar.xz
tar xvJf qemu-2.11.0-rc5.tar.xz
cd qemu-2.11.0-rc5
./configure
make

To download and build QEMU from git:

git clone git://git.qemu.org/qemu.git
cd qemu
git submodule init
git submodule update --recursive
./configure
make

The latest development happens on the master branch. The stable trees are located in branches named stable-X.YY branch, where X.YY is the release version.
"



Embedded Linux Notes, focus on Rpi Linux Kernel Config

2018-11-09 - Ted to create embedded work article on this wiki installation, so noting this Friday evening. - TMH

Ted looking into a couple of areas of embedded Linux, including custom kernel config for Rpi, the open source Buildroot project, Tiny-Core Linux and FreeRTOS. Ted also stashing some links to embedded studies notes on this wiki here:



FreeRTOS Notes (Separate Article)

FreeRTOS notes

Ted to move this link to nn wiki article named 'FreeRTOS'. For now however Ted noting an openssl library named Wolfssl:


NOTE 2017-12-10: this section 'embedded operating systems' to become a shorter list of major significant embedded OS's. As of 2017 winter Ted studying couple distributions of embedded Linux and FreeRTOS.



Bootloader U-Boot

Ted noting after several custom Linux-for-Rpi kernel build attempts that Raspberry Pi board uses a bootloader typically other than GRUB, commonly uses U-boot. A first tutorial . . . also running into U-boot sources makefile calling a project script which fails to find gcc-6, though /usr/bin/gcc is a symlink to that newer gcc . . .


After installing manually some twenty or thirty gcc-6-arm-linux and gcc-6, gcc-7 files, and installing more modern version of build-essentials package from Ubuntu release codenamed 'bionic', can now build u-boot. Tail of messages from build process . . .

  CC      lib/strto.o
  CC      lib/strmhz.o
  LD      lib/built-in.o
  CC      examples/standalone/stubs.o
  CC       CC      lib/strto.o
  CC      lib/strmhz.o
  LD      lib/built-in.o
  CC      examples/standalone/stubs.o
  CC      examples/standalone/hello_world.o
  LD      examples/standalone/libstubs.o
  LD      examples/standalone/hello_world
  OBJCOPY examples/standalone/hello_world.srec
  OBJCOPY examples/standalone/hello_world.bin
  LD      u-boot
  OBJCOPY u-boot.srec
  OBJCOPY u-boot-nodtb.bin
  SYM     u-boot.sym
  COPY    u-boot.bin
  CFGCHK  u-boot.cfg
ted@rangari:/var/local/ted/projects/u-boot$ examples/standalone/hello_world.o
  LD      examples/standalone/libstubs.o
  LD      examples/standalone/hello_world
  OBJCOPY examples/standalone/hello_world.srec
  OBJCOPY examples/standalone/hello_world.bin
  LD      u-boot
  OBJCOPY u-boot.srec
  OBJCOPY u-boot-nodtb.bin
  SYM     u-boot.sym
  COPY    u-boot.bin
  CFGCHK  u-boot.cfg
ted@rangari:/var/local/ted/projects/u-boot$



LPC11U6x Development Board



avr-libc

./avr-libc-1.8.0/include/avr/iom8.h:634:#if !defined(__AVR_LIBC_DEPRECATED_ENABLE__)
./avr-libc-1.8.0/include/avr/iom8.h:657:#endif  /* !defined(__AVR_LIBC_DEPRECATED_ENABLE__) */

 .
 .
 .

633 /* Deprecated items */
634 #if !defined(__AVR_LIBC_DEPRECATED_ENABLE__)
635 
636 #pragma GCC system_header
637 
638 #pragma GCC poison SIG_INTERRUPT0
639 #pragma GCC poison SIG_INTERRUPT1
640 #pragma GCC poison SIG_OUTPUT_COMPARE2
641 #pragma GCC poison SIG_OVERFLOW2
642 #pragma GCC poison SIG_INPUT_CAPTURE1
643 #pragma GCC poison SIG_OUTPUT_COMPARE1A
644 #pragma GCC poison SIG_OUTPUT_COMPARE1B
645 #pragma GCC poison SIG_OVERFLOW1
646 #pragma GCC poison SIG_OVERFLOW0
647 #pragma GCC poison SIG_SPI
648 #pragma GCC poison SIG_UART_RECV
649 #pragma GCC poison SIG_UART_DATA
650 #pragma GCC poison SIG_UART_TRANS
651 #pragma GCC poison SIG_ADC
652 #pragma GCC poison SIG_EEPROM_READY
653 #pragma GCC poison SIG_COMPARATOR
654 #pragma GCC poison SIG_2WIRE_SERIAL
655 #pragma GCC poison SIG_SPM_READY
656 
657 #endif  /* !defined(__AVR_LIBC_DEPRECATED_ENABLE__) */


EWAVR, IAR Workbench, Keil compiler notes

2019-01-03 THU


- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Yocto References


- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Mobile App Development On Linux

- 2018-10-12 FRI -

- 2018-01-15 MON -


Android programming


- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Toradex embedded ARM computers

Search for Toradex asymmetric core 'system on a module' board:

It looks like Colibri iMX7S and iMX7D are two-core and three-core processor based modules, with asymmetric cores to handle different kinds of data processing more efficiently,

  • Toradex PN: 00391100 - Colibri iMX7 Dual 1GB | V1.1A
  • Toradex PN: 01351101 - Iris carrier board


Looks like the Iris carrier board is a smaller form, less featured but more economical carrier board to support use of iMX7D/S systems on modules:

Software to install on this module:


Software projects and stacks to run on asymmetric core systems:



Build U-boot and Linux kernel from source



Arduino Development Kit and Documentation

Looking into Arduino boards as a means to configure an I2C protocol programmer . . .

Arduino Uno development board datasheet:

Arduino IDE software download:

Getting started:


A more specifically purposed interface and or programming board called 'Aardvark' . . .


FreeRTOS on Arduino development boards . . .


- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Electronics

Transistor, FETs, Op-amps . . .

Photovoltaics . . .

Analog computers


tools and hardware


measurement equipment

2020-10-27

Not used but I have this 4 channel 100mhz scope that i like a lot. $500 with built-in i2c/spi/uart/canbus decoding https://siglentna.com/product/sds1104x-e-100-mhz/ https://www.youtube.com/watch?v=Kay4Jk2DHuE https://www.youtube.com/watch?v=Cwbwq-AKbPc SiglentSiglent SDS1104X-E (100 MHz) | Siglent Bandwidth: 100 MHz Channels: 4 Real time sampling rate: 1 GSa/s (Total of 2 A-to-D converters) Maximum capture rate: (100,000 in Normal mode, 400,000 in Sequence mode) Memory depth: 14 Mpts Bode Plot function (Requires SIGLENT SDG X or SAG1021 function generator) Search / Navigate functions Web-Based browser remote control Optional Wi-Fi dongle Optional MSO capability YouTubeYouTube | EEVblog EEVblog #1042 - Siglent's $499 SDS1104X-E 4CH Oscilloscope Teardown


Modbus protocol


Mathematica

Mathematical symbols:


Important mathematical topics:


^ Books on mathematics

Books on mathematics to explore:

    • "Lectures and Problems: A Gift to Young Mathematicians (MSRI Mathematical Circles Library)
    by V. I. Arnold (Author)" On-line lecture notes:
    • An excellent book on the FFT is: E. Oran Brigham, The Fast Fourier Transform, PrenticeHall, Englewood Cliffs, NJ, 1974.


CRC, RSA and other mathematical areas . . .


Applied math . . .

Fractal geometry and math . . .


Quantum computing and Shor's algorithm . . .

---

---

^ Fast Fourier Transform FFT

Other mathematical topics:


Literature

Liturature and Authors of the World . . .


Other Things To Explore

Human health:



Here are some technical and science topics to explore, perhaps on a rainy day . . .

Machine learning:


Containers and DevOps:


3D Graphics, mathematics behind and programming:


Creative Commons and other Open Source licensed materials:


Dublin Core:

Zdyes mnogo informatsia:


^ DYI laptop by Olimex


edit point

- - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  


Javascript and JSON:


PC Video, Bochs VBE Extensions:


Perl programming related:


Unix and Linux tools, software and building blocks:


GNU Make book on-line . . .


Webvanta:


Virtual server image creation:


Github Users Sharing Their Work:


edit point

- - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  - - - - -  

Cryptography Scientists and Articles:


ARM microcontroller related:


Operating system level programming:


Gputils PIC programming tools, W3C Jigsaw validator referenced at end of page




music and lyrics

---

https://www.wish.com/product/59b6c3c68f545e607c2adf30?hide_login_modal=true&from_ad=goog_shopping&_display_country_code=US&_force_currency_code=USD&pid=googleadwords_int&c=%7BcampaignId%7D&ad_cid=59b6c3c68f545e607c2adf30&ad_cc=US&ad_curr=USD&ad_price=48.00&campaign_id=7203534630&gclid=EAIaIQobChMIoZKHvqS06AIVEh-tBh2I6wv-EAQYASABEgKuAvD_BwE&share=web


plant and animal references

Searching Google and Amazon for bottom heat sources for seed germination:

" Seedfactor MET certified Seedling Heat Mat, Seedfactor Waterproof Durable Germination Station Heat Mat, Warm Hydroponic Heating Pad for Indoor Home Gardening Seed Starter(10" x 20") "

Aloe references . . .

2019-04-10 Cork trees . . .

Invasive plants . . .


^ Cacti


^ Agavacae


^ Nursurias

      Excerpt from this page: "Planting Instructions 1. Cacti, agaves, and tap-rooted succulents (Aloinopsis, Titanopsis, Nananthus) should be transplanted bare-root. Let the soil in the pot dry out for a few days. Then remove the pot and gently loosen the soil so it falls away from the roots. Trim off any broken roots. Bare root plants should then be planted into a shallow hole. Spread out the roots evenly and sprinkle the soil into the hole until full. The base of the plant should rest on top of the soil. Mulch with a 1⁄2”-1” thick layer of pea-sized gravel around the base of the plant to protect it from contact with soggy soil over the winter months. (See planting diagram on page 12 of our Planting Guide.)

    TERMINOLOGY: https://en.wikipedia.org/wiki/Cleistogamy


- 2018-08-06 Monday -

Wildflowers . . .

Iris and Bulbs . . .


Personal project notes . . .


2020-10-21


^ plant pathology

https://www.apsnet.org/publications/phytopathology/backissues/Documents/1971Articles/Phyto61n08_926.PDF


^ Technology History and Evolution

Moore's Law and CMOS scaling ways:

^ Astronomy

Physics topics relating to astronomy:

Black holes and some of their key features as we know them so far:

Black holes and General Relativity . . .



^ Food and Cooking

Turkish traditional dishes, borek . . .

Search also for simit, imam bayidi, kafta kabab



^ References

Neela Nurseries wiki notes


Reproducible builds, byte-wise reproducible software:


Server Side services . . .


Coding standards:


C and C++:


Couple of MediaWiki and publishing issues to look into, which came up during wiki configuration:


Some Hindi language and UTF-8 encoding references, to be factored to a dedicated wiki page later:


Linux programs and utilities:


Graphics Servers:


Computer hardware and firmware:


QEMU


I2C

Access iPhone via Linux


^ End of page

 
 

- - - top of page - - -