Nov 04 00:49:15 devstack cinder-volume[75588]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 04 00:49:15 devstack cinder-volume[75588]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 04 00:49:15 devstack cinder-volume[75588]: we strongly recommend against using it for new projects.
Nov 04 00:49:15 devstack cinder-volume[75588]: If you are already using Eventlet, we recommend migrating to a different
Nov 04 00:49:15 devstack cinder-volume[75588]: framework.  For more detail see
Nov 04 00:49:15 devstack cinder-volume[75588]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 04 00:49:15 devstack cinder-volume[75588]:   import eventlet  # noqa
Nov 04 00:49:17 devstack cinder-volume[75588]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75588) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 00:49:17 devstack cinder-volume[75588]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75588) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 00:49:17 devstack cinder-volume[75588]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75588) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 00:49:18 devstack cinder-volume[75588]: INFO dbcounter [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Registered counter for database cinder
Nov 04 00:49:19 devstack cinder-volume[75588]: DEBUG oslo_db.sqlalchemy.engines [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75588) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:49:19 devstack cinder-volume[75588]: DEBUG dbcounter [-] [75588] Writer thread running {{(pid=75588) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 00:49:19 devstack cinder-volume[75588]: INFO cinder.rpc [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 04 00:49:19 devstack cinder-volume[75588]: INFO cinder.rpc [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 04 00:49:19 devstack cinder-volume[75588]: DEBUG oslo_db.sqlalchemy.engines [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75588) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:49:19 devstack cinder-volume[75588]: INFO cinder.volume.manager [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Determined volume DB was empty at startup.
Nov 04 00:49:19 devstack cinder-volume[75588]: DEBUG cinder.volume.manager [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75588) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 04 00:49:19 devstack cinder-volume[75588]: INFO cinder.volume.manager [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 04 00:49:19 devstack cinder-volume[75588]: WARNING stevedore.named [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 04 00:49:19 devstack cinder-volume[75588]: WARNING castellan.key_manager [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 00:49:19 devstack cinder-volume[75588]: WARNING cinder.keymgr.conf_key_mgr [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 00:49:19 devstack cinder-volume[75588]: DEBUG cinder.volume.drivers.lvm [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75588) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 04 00:49:19 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:19 devstack cinder-volume[75588]: DEBUG oslo_concurrency.processutils [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] CMD "cinder-rtstool verify" returned: 0 in 0.404s {{(pid=75588) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_db.sqlalchemy.engines [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75588) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:49:20 devstack cinder-volume[75588]: INFO cinder.rpc [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 04 00:49:20 devstack cinder-volume[75588]: INFO cinder.rpc [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 04 00:49:20 devstack cinder-volume[75588]: WARNING stevedore.named [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 04 00:49:20 devstack cinder-volume[75588]: WARNING castellan.key_manager [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 00:49:20 devstack cinder-volume[75588]: INFO cinder.volume.manager [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_db.sqlalchemy.engines [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75588) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:49:20 devstack cinder-volume[75588]: INFO oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Starting 1 workers
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Started child 75744 {{(pid=75588) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Full set of CONF: {{(pid=75588) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] ******************************************************************************** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Configuration options gathered from: {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] ================================================================================ {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 04 00:49:20 devstack cinder-volume[75744]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] allow_availability_zone_fallback = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] allow_compression_on_image_upload = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] allowed_direct_url_schemes     = [] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] api_rate_limit                 = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] auth_strategy                  = keystone {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] az_cache_duration              = 3600 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_availability_zone      = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_host                   = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_name                   = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_stats_polling_interval = 60 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backup_api_class               = cinder.backup.api.API {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backup_name_template           = backup-%s {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backup_use_same_host           = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backup_use_temp_snapshot       = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] chap_password                  = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] chap_username                  =  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cinder_internal_tenant_project_id = 6f10f3a7c22240ecac226a5ba8ecdfc4 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cinder_internal_tenant_user_id = 6718abea83a34d8e891db9ec8b4e7c9b {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cloned_volume_same_az          = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cluster                        = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] compression_format             = gzip {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] compute_api_class              = cinder.compute.nova.API {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] config_dir                     = [] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] config_source                  = [] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] control_exchange               = openstack {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] debug                          = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] default_availability_zone      = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] default_group_type             = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] default_volume_type            = lvmdriver-1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] disk_geometry                  = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] driver_client_cert             = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] driver_client_cert_key         = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] driver_data_namespace          = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] driver_ssl_cert_path           = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] driver_ssl_cert_verify         = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] driver_use_ssl                 = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] enable_force_upload            = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] enable_new_services            = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] enable_unsupported_driver      = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75744]: INFO cinder.volume.manager [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 04 00:49:20 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] enforce_multipath_for_image_xfer = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] filter_function                = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance_api_insecure            = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance_api_servers             = ['http://192.168.122.73/image'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance_api_ssl_compression     = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance_ca_certificates_file    = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance_catalog_info            = image:glance:publicURL {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance_certfile                = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance_keyfile                 = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance_num_retries             = 3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:20 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance_request_timeout         = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] goodness_function              = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] graceful_shutdown_timeout      = 5 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] group_api_class                = cinder.group.api.API {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] host                           = devstack {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_compress_on_upload       = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_conversion_address_space_limit = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_conversion_cpu_limit     = 60 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_conversion_disable       = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_introspection_address_space_limit = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_introspection_cpu_limit  = 60 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_upload_use_cinder_backend = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_upload_use_internal_tenant = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_volume_cache_enabled     = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_volume_cache_max_count   = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] image_volume_cache_max_size_gb = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] init_host_max_objects_retrieval = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] instance_format                = [instance: %(uuid)s]  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] iscsi_target_flags             =  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] iscsi_write_cache              = on {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] iser_helper                    = tgtadm {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] iser_ip_address                = 192.168.122.73 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] iser_port                      = 3260 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:20 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] log_color                      = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] log_config_append              = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] log_dir                        = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] log_file                       = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] log_options                    = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] log_rotate_interval            = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] log_rotate_interval_type       = days {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] log_rotation_type              = none {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] max_age                        = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] max_logfile_count              = 30 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] max_logfile_size_mb            = 200 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] max_over_subscription_ratio    = 20.0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] message_reap_interval          = 86400 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] message_ttl                    = 2592000 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] migration_create_volume_timeout_secs = 300 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] monkey_patch                   = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] monkey_patch_modules           = [] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] my_ip                          = 192.168.122.73 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] no_snapshot_gb_quota           = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] num_iser_scan_tries            = 3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] num_shell_tries                = 3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] num_volume_device_scan_tries   = 3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] nvmeof_conn_info_version       = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] nvmet_ns_id                    = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] nvmet_port_id                  = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] osapi_max_limit                = 1000 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] osapi_volume_ext_list          = [] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] osapi_volume_listen_port       = 8776 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] osapi_volume_use_ssl           = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] osapi_volume_workers           = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] per_volume_size_limit          = -1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] periodic_fuzzy_delay           = 60 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] periodic_interval              = 60 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] public_endpoint                = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] publish_errors                 = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] quota_backup_gigabytes         = 1000 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] quota_backups                  = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] quota_gigabytes                = 1000 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] quota_groups                   = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] quota_snapshots                = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] quota_volumes                  = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] rate_limit_burst               = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] rate_limit_except_level        = CRITICAL {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] rate_limit_interval            = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] reinit_driver_count            = 3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] replication_device             = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] report_discard_supported       = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] report_interval                = 120 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] reservation_clean_interval     = 86400 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] reservation_expire             = 86400 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] reserved_image_namespaces      = [] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] reserved_percentage            = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack sudo[75748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 04 00:49:20 devstack sudo[75748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] rpc_response_timeout           = 120 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] run_external_periodic_tasks    = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] scst_target_driver             = iscsi {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] scst_target_iqn_name           = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_down_time              = 720 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] shell_completion               = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] snapshot_name_template         = snapshot-%s {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] snapshot_same_host             = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] split_loggers                  = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] state_path                     = /opt/stack/data/cinder {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] storage_availability_zone      = nova {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] storage_protocol               = iSCSI {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] syslog_log_facility            = LOG_USER {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] target_helper                  = lioadm {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] target_ip_address              = 192.168.122.73 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] target_port                    = 3260 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] target_protocol                = iscsi {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] target_secondary_ip_addresses  = [] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] trace_flags                    = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] transport_url                  = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] until_refresh                  = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] use_chap_auth                  = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] use_default_quota_class        = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] use_journal                    = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] use_json                       = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] use_multipath_for_image_xfer   = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] use_stderr                     = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] use_syslog                     = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] verify_glance_signatures       = enabled {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_api_class               = cinder.volume.api.API {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_backend_name            = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_clear                   = zero {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_clear_ionice            = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_clear_size              = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_copy_bps_limit          = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_dd_blocksize            = 1M {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_name_template           = volume-%s {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_service_inithost_offload = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volume_usage_audit_period      = month {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] zoning_mode                    = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_concurrency.disable_process_locking = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.auth_section = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.auth_type   = password {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.auth_version = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.cache       = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.certfile    = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.include_service_catalog = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.insecure    = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.interface   = public {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.keyfile     = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_password = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcache_username = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.region_name = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.service_type = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.73/identity {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.backend                  = dogpile.cache.null {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.backend_argument         = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.backend_expiration_time  = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.config_prefix            = cache.oslo {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.debug_cache_backend      = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.enable_retry_client      = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.enable_socket_keepalive  = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.enabled                  = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.expiration_time          = 600 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.hashclient_retry_attempts = 2 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.memcache_dead_retry      = 300 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.memcache_pool_maxsize    = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.memcache_sasl_enabled    = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.password                 = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.proxies                  = [] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.redis_db                 = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.redis_server             = localhost:6379 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.retry_attempts           = 2 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.retry_delay              = 0.0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.socket_keepalive_count   = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.socket_keepalive_idle    = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.socket_keepalive_interval = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.socket_timeout           = 1.0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.tls_allowed_ciphers      = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.tls_cafile               = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.tls_certfile             = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.tls_enabled              = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.tls_keyfile              = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cache.username                 = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] coordination.backend_url       = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.asyncio_connection    = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.asyncio_slave_connection = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.backend               = sqlalchemy {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.connection            = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.connection_debug      = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.connection_parameters =  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.connection_recycle_time = 3600 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.connection_trace      = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.db_inc_retry_interval = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.db_max_retries        = 20 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.db_max_retry_interval = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.db_retry_interval     = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.max_overflow          = 50 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.max_pool_size         = 5 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.max_retries           = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.mysql_wsrep_sync_wait = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.pool_timeout          = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.retry_interval        = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.slave_connection      = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.sqlite_synchronous    = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.synchronous_reader    = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] database.use_db_reconnect      = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_tracing.insecure = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler.connection_string     = messaging:// {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler.enabled               = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler.es_doc_type           = notification {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler.es_scroll_size        = 10000 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler.es_scroll_time        = 2m {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler.filter_error_trace    = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler.hmac_keys             = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler.sentinel_service_name = mymaster {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler.socket_timeout        = 0.1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler.trace_requests        = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler.trace_sqlalchemy      = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler_jaeger.process_tags   = {} {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler_jaeger.service_name_prefix = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] profiler_otlp.service_name_prefix = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_policy.enforce_new_defaults = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_policy.policy_default_rule = default {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_policy.policy_file        = policy.yaml {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] privsep_osbrick.group          = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] privsep_osbrick.helper_command = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] privsep_osbrick.user           = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cinder_sys_admin.group         = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cinder_sys_admin.helper_command = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] cinder_sys_admin.user          = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.auth_section      = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.auth_type         = password {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.cafile            = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.certfile          = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.collect_timing    = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.insecure          = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.keyfile           = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.send_service_user_token = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.split_loggers     = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.timeout           = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.tls_ciphers       = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] service_user.tls_min_version   = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.auth_section            = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.auth_type               = password {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.certfile                = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.collect_timing          = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.insecure                = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.keyfile                 = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.region_name             = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.split_loggers           = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.timeout                 = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.tls_ciphers             = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] glance.tls_min_version         = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.backend_availability_zone = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.chap_password = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.chap_username =  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.disk_geometry = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.driver_client_cert = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.driver_client_cert_key = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.driver_data_namespace = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.driver_use_ssl = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.extra_capabilities = {} {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.filter_function = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.goodness_function = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.iscsi_target_flags =  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.iscsi_write_cache = on {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.iser_helper   = tgtadm {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.iser_ip_address = 192.168.122.73 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.iser_port     = 3260 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.lvm_share_target = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.lvm_type      = auto {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.num_shell_tries = 3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.replication_device = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.report_discard_supported = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.reserved_percentage = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.target_helper = tgtadm {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.target_ip_address = 192.168.122.73 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.target_port   = 3260 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.target_protocol = iscsi {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.trace_flags   = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.unique_fqdn_network = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.use_chap_auth = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.volume_backend_name = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.volume_clear  = zero {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.volume_clear_ionice = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.volume_clear_size = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_reports.file_event_handler = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_reports.log_dir           = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.backend_host       = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.chap_password      = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.chap_username      = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.disk_geometry      = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.driver_client_cert = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.extra_capabilities = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.filter_function    = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.goodness_function  = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.iser_helper        = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.iser_ip_address    = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.iser_port          = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.lvm_share_target   = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.lvm_type           = auto {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.num_shell_tries    = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.replication_device = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.report_discard_supported = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.reserved_percentage = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.scst_target_driver = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.storage_protocol   = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.target_helper      = lioadm {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.target_ip_address  = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.target_port        = 3260 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.trace_flags        = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.use_chap_auth      = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.volume_clear       = zero {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.volume_clear_size  = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] lvmdriver-1.volumes_dir        = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.ssl      = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_notifications.driver = [] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_notifications.retry = -1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] key_manager.fixed_key          = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.barbican_api_version  = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.barbican_endpoint     = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.barbican_endpoint_type = public {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.barbican_region_name  = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.cafile                = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.certfile              = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.collect_timing        = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.insecure              = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.keyfile               = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.number_of_retries     = 60 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.retry_delay           = 1 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.send_service_user_token = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.split_loggers         = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.timeout               = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.tls_ciphers           = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.tls_min_version       = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.verify_ssl            = True {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican.verify_ssl_path       = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican_service_user.auth_section = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican_service_user.auth_type = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican_service_user.cafile   = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican_service_user.certfile = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican_service_user.collect_timing = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican_service_user.insecure = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican_service_user.keyfile  = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican_service_user.split_loggers = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican_service_user.timeout  = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican_service_user.tls_ciphers = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] barbican_service_user.tls_min_version = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.approle_role_id          = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.approle_secret_id        = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.auth_method              = approle {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.auth_path                = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.kv_mountpoint            = secret {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.kv_path                  = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.kv_version               = 2 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.namespace                = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.root_token_id            = **** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.ssl_ca_crt_file          = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.timeout                  = 60.0 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.token_file               = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.token_role               = None {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.use_ssl                  = False {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:49:20 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] ******************************************************************************** {{(pid=75588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 04 00:49:20 devstack sudo[75748]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:20 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.387s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:20 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:20 devstack sudo[75815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:49:20 devstack sudo[75815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:21 devstack sudo[75815]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.331s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 00:49:21 devstack cinder-volume[75744]: INFO cinder.brick.local_dev.lvm [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:21 devstack sudo[75951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 00:49:21 devstack sudo[75951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:21 devstack sudo[75951]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG cinder.brick.local_dev.lvm [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75744) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:21 devstack sudo[76041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:49:21 devstack sudo[76041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:21 devstack sudo[76041]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:21 devstack sudo[76239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:49:21 devstack sudo[76239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:22 devstack sudo[76239]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:22 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:22 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:22 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:22 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:22 devstack sudo[76353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 04 00:49:22 devstack sudo[76353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:22 devstack sudo[76353]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:22 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.263s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:22 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:22 devstack sudo[76364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 00:49:22 devstack sudo[76364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:22 devstack sudo[76364]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:22 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:22 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:22 devstack sudo[76421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 00:49:22 devstack sudo[76421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:23 devstack sudo[76421]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:23 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:23 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:23 devstack sudo[76452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:49:23 devstack sudo[76452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:23 devstack sudo[76452]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:23 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:23 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:23 devstack sudo[76461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:49:23 devstack sudo[76461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:23 devstack sudo[76461]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:23 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.337s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:23 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:23 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:23 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:23 devstack sudo[76545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:49:23 devstack sudo[76545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:23 devstack sudo[76545]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:23 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:24 devstack cinder-volume[75744]: INFO cinder.volume.drivers.lvm [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 04 00:49:24 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:24 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:24 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:24 devstack sudo[76549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:49:24 devstack sudo[76549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:24 devstack sudo[76549]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:24 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:24 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 00:49:24 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:24 devstack sudo[76552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 00:49:24 devstack sudo[76552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:24 devstack sudo[76552]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:24 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:24 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:24 devstack sudo[76561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:49:24 devstack sudo[76561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:24 devstack sudo[76561]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:24 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:24 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:24 devstack sudo[76564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:49:24 devstack sudo[76564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:25 devstack sudo[76564]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:25 devstack sudo[76567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:49:25 devstack sudo[76567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:25 devstack sudo[76567]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:25 devstack cinder-volume[75744]: INFO cinder.volume.driver [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Driver hasn't implemented _init_vendor_properties()
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG cinder.volume.driver [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75744) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG oslo_db.sqlalchemy.engines [None req-19476349-e747-4542-a876-f8790dcbd365 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG dbcounter [-] [75744] Writer thread running {{(pid=75744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG cinder.db.api [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Building query based on filter {{(pid=75744) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG cinder.image.image_utils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75744) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 04 00:49:25 devstack cinder-volume[75744]: INFO cinder.keymgr.migration [None req-e9fca3f1-4c82-46ec-8802-04c6379bcda2 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:25 devstack sudo[76570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 00:49:25 devstack sudo[76570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:25 devstack sudo[76570]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:25 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:25 devstack sudo[76575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:49:25 devstack sudo[76575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:26 devstack sudo[76575]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:26 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:26 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:26 devstack sudo[76578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:49:26 devstack sudo[76578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:26 devstack sudo[76578]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:26 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:26 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:26 devstack sudo[76582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:49:26 devstack sudo[76582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:26 devstack sudo[76582]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:26 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:26 devstack cinder-volume[75744]: DEBUG cinder.manager [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Notifying Schedulers of capabilities ... {{(pid=75744) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:49:26 devstack cinder-volume[75744]: INFO cinder.volume.manager [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Driver initialization completed successfully.
Nov 04 00:49:26 devstack cinder-volume[75744]: INFO cinder.manager [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Initiating service 2 cleanup
Nov 04 00:49:26 devstack cinder-volume[75744]: INFO cinder.manager [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Service 2 cleanup completed.
Nov 04 00:49:26 devstack cinder-volume[75744]: DEBUG cinder.service [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Creating RPC server for service cinder-volume {{(pid=75744) start /opt/stack/cinder/cinder/service.py:231}}
Nov 04 00:49:26 devstack cinder-volume[75744]: DEBUG cinder.service [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75744) start /opt/stack/cinder/cinder/service.py:237}}
Nov 04 00:49:26 devstack cinder-volume[75744]: INFO cinder.volume.manager [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 04 00:49:26 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 00:49:26 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:26 devstack sudo[76585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 00:49:26 devstack sudo[76585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:27 devstack sudo[76585]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:27 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:27 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:27 devstack sudo[76588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:49:27 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:27 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:27 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:27 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:27 devstack sudo[76593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:49:27 devstack sudo[76593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:27 devstack sudo[76593]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:27 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:27 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:49:27 devstack sudo[76596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:49:27 devstack sudo[76596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:49:27 devstack sudo[76596]: pam_unix(sudo:session): session closed for user root
Nov 04 00:49:27 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-19476349-e747-4542-a876-f8790dcbd365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:49:27 devstack cinder-volume[75744]: INFO cinder.volume.manager [None req-19476349-e747-4542-a876-f8790dcbd365 None None] Driver post RPC initialization completed successfully.
Nov 04 00:49:30 devstack cinder-volume[75588]: DEBUG dbcounter [-] [75588] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75588) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:49:37 devstack cinder-volume[75744]: DEBUG dbcounter [-] [75744] Writing DB stats cinder:SELECT=4 {{(pid=75744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:49:37 devstack cinder-volume[75744]: DEBUG dbcounter [-] [75744] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:50:05 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running periodic task VolumeManager._thread_info {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:50:05 devstack cinder-volume[75744]: DEBUG cinder.volume.manager [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] thread count: 6 {{(pid=75744) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 00:50:05 devstack cinder-volume[75744]: DEBUG cinder.volume.manager [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] thread info: [<_MainThread(MainThread, started 135916765384832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135916654703744)>, <Thread(Thread-3 (stat_writer), started daemon 135916650715456)>, <Thread(Rabbit-heartbeat, started daemon 135916661307136)>, <Thread(Thread-5 (_runner), started daemon 135916650267200)>, <Thread(Thread-7 (_runner), started daemon 135916650402816)>] {{(pid=75744) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 00:51:05 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:51:05 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 00:51:05 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:51:05 devstack sudo[81719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 00:51:05 devstack sudo[81719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:51:06 devstack sudo[81719]: pam_unix(sudo:session): session closed for user root
Nov 04 00:51:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:51:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:51:06 devstack sudo[81722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:51:06 devstack sudo[81722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:51:06 devstack sudo[81722]: pam_unix(sudo:session): session closed for user root
Nov 04 00:51:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:51:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:51:06 devstack sudo[81726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:51:06 devstack sudo[81726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:51:06 devstack sudo[81726]: pam_unix(sudo:session): session closed for user root
Nov 04 00:51:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:51:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:51:06 devstack sudo[81729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:51:06 devstack sudo[81729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:51:06 devstack sudo[81729]: pam_unix(sudo:session): session closed for user root
Nov 04 00:51:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:51:06 devstack cinder-volume[75744]: DEBUG cinder.manager [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Notifying Schedulers of capabilities ... {{(pid=75744) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:51:06 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running periodic task VolumeManager._thread_info {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:51:06 devstack cinder-volume[75744]: DEBUG cinder.volume.manager [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] thread count: 6 {{(pid=75744) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 00:51:06 devstack cinder-volume[75744]: DEBUG cinder.volume.manager [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] thread info: [<_MainThread(MainThread, started 135916765384832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135916654703744)>, <Thread(Thread-3 (stat_writer), started daemon 135916650715456)>, <Thread(Rabbit-heartbeat, started daemon 135916661307136)>, <Thread(Thread-5 (_runner), started daemon 135916650267200)>, <Thread(Thread-7 (_runner), started daemon 135916650402816)>] {{(pid=75744) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 00:51:37 devstack cinder-volume[75744]: DEBUG dbcounter [-] [75744] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:52:05 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:52:05 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 00:52:05 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:52:05 devstack sudo[83414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 00:52:05 devstack sudo[83414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:52:06 devstack sudo[83414]: pam_unix(sudo:session): session closed for user root
Nov 04 00:52:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:52:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:52:06 devstack sudo[83419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:52:06 devstack sudo[83419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:52:06 devstack sudo[83419]: pam_unix(sudo:session): session closed for user root
Nov 04 00:52:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:52:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:52:06 devstack sudo[83431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:52:06 devstack sudo[83431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:52:06 devstack sudo[83431]: pam_unix(sudo:session): session closed for user root
Nov 04 00:52:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:52:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:52:06 devstack sudo[83447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:52:06 devstack sudo[83447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:52:06 devstack sudo[83447]: pam_unix(sudo:session): session closed for user root
Nov 04 00:52:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:52:06 devstack cinder-volume[75744]: DEBUG cinder.manager [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Notifying Schedulers of capabilities ... {{(pid=75744) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:53:05 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:53:05 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 00:53:05 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:53:05 devstack sudo[84928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 00:53:05 devstack sudo[84928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:53:06 devstack sudo[84928]: pam_unix(sudo:session): session closed for user root
Nov 04 00:53:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:53:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:53:06 devstack sudo[84944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:53:06 devstack sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:53:06 devstack sudo[84944]: pam_unix(sudo:session): session closed for user root
Nov 04 00:53:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:53:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:53:06 devstack sudo[84951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 00:53:06 devstack sudo[84951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:53:06 devstack sudo[84951]: pam_unix(sudo:session): session closed for user root
Nov 04 00:53:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:53:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:53:06 devstack sudo[84956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 00:53:06 devstack sudo[84956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:53:06 devstack sudo[84956]: pam_unix(sudo:session): session closed for user root
Nov 04 00:53:06 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:53:06 devstack cinder-volume[75744]: DEBUG cinder.manager [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Notifying Schedulers of capabilities ... {{(pid=75744) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:53:06 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] Running periodic task VolumeManager._thread_info {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:53:06 devstack cinder-volume[75744]: DEBUG cinder.volume.manager [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] thread count: 6 {{(pid=75744) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 00:53:06 devstack cinder-volume[75744]: DEBUG cinder.volume.manager [None req-9fd07656-58e4-4d87-a74c-3144579c6f22 None None] thread info: [<_MainThread(MainThread, started 135916765384832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135916654703744)>, <Thread(Thread-3 (stat_writer), started daemon 135916650715456)>, <Thread(Rabbit-heartbeat, started daemon 135916661307136)>, <Thread(Thread-5 (_runner), started daemon 135916650267200)>, <Thread(Thread-7 (_runner), started daemon 135916650402816)>] {{(pid=75744) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 00:53:37 devstack cinder-volume[75744]: DEBUG dbcounter [-] [75744] Writing DB stats cinder:SELECT=1 {{(pid=75744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:53:37 devstack cinder-volume[75744]: DEBUG dbcounter [-] [75744] Writing DB stats cinder:UPDATE=1 {{(pid=75744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:53:47 devstack cinder-volume[75588]: INFO oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Caught SIGTERM, stopping children
Nov 04 00:53:47 devstack cinder-volume[75588]: DEBUG oslo_concurrency.lockutils [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Acquiring lock "singleton_lock" {{(pid=75588) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 00:53:47 devstack cinder-volume[75588]: DEBUG oslo_concurrency.lockutils [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Acquired lock "singleton_lock" {{(pid=75588) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 00:53:47 devstack cinder-volume[75588]: DEBUG oslo_concurrency.lockutils [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Releasing lock "singleton_lock" {{(pid=75588) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 00:53:47 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Stop services. {{(pid=75588) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 04 00:53:47 devstack cinder-volume[75588]: DEBUG oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Killing children. {{(pid=75588) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 04 00:53:47 devstack cinder-volume[75588]: INFO oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Waiting on 1 children to exit
Nov 04 00:53:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.lockutils [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Acquiring lock "singleton_lock" {{(pid=75744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 00:53:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.lockutils [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Acquired lock "singleton_lock" {{(pid=75744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 00:53:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.lockutils [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Releasing lock "singleton_lock" {{(pid=75744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 00:53:51 devstack cinder-volume[75744]: WARNING amqp [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 04 00:53:51 devstack cinder-volume[75744]: WARNING amqp [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 04 00:53:51 devstack cinder-volume[75588]: INFO oslo_service.backend._eventlet.service [None req-29c547c5-c977-47b2-9651-41cc4be6514b None None] Child 75744 exited with status 0
Nov 04 00:53:52 devstack cinder-volume[85796]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 04 00:53:52 devstack cinder-volume[85796]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 04 00:53:52 devstack cinder-volume[85796]: we strongly recommend against using it for new projects.
Nov 04 00:53:52 devstack cinder-volume[85796]: If you are already using Eventlet, we recommend migrating to a different
Nov 04 00:53:52 devstack cinder-volume[85796]: framework.  For more detail see
Nov 04 00:53:52 devstack cinder-volume[85796]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 04 00:53:52 devstack cinder-volume[85796]:   import eventlet  # noqa
Nov 04 00:53:54 devstack cinder-volume[85796]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85796) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 00:53:54 devstack cinder-volume[85796]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85796) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 00:53:54 devstack cinder-volume[85796]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85796) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 00:53:54 devstack cinder-volume[85796]: INFO dbcounter [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Registered counter for database cinder
Nov 04 00:53:54 devstack cinder-volume[85796]: DEBUG oslo_db.sqlalchemy.engines [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85796) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG dbcounter [-] [85796] Writer thread running {{(pid=85796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 00:53:55 devstack cinder-volume[85796]: INFO cinder.rpc [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 04 00:53:55 devstack cinder-volume[85796]: INFO cinder.rpc [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_db.sqlalchemy.engines [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85796) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:53:55 devstack cinder-volume[85796]: INFO cinder.volume.manager [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Determined volume DB was empty at startup.
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG cinder.volume.manager [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85796) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 04 00:53:55 devstack cinder-volume[85796]: INFO cinder.volume.manager [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 04 00:53:55 devstack cinder-volume[85796]: WARNING stevedore.named [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 04 00:53:55 devstack cinder-volume[85796]: WARNING castellan.key_manager [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 00:53:55 devstack cinder-volume[85796]: WARNING cinder.keymgr.conf_key_mgr [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 00:53:55 devstack cinder-volume[85796]: INFO cinder.volume.manager [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_db.sqlalchemy.engines [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85796) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:53:55 devstack cinder-volume[85796]: INFO oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Starting 1 workers
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Started child 86013 {{(pid=85796) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Full set of CONF: {{(pid=85796) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] ******************************************************************************** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Configuration options gathered from: {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] ================================================================================ {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] allow_availability_zone_fallback = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] allow_compression_on_image_upload = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] allowed_direct_url_schemes     = [] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] api_rate_limit                 = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] auth_strategy                  = keystone {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_availability_zone      = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_host                   = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_name                   = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_stats_polling_interval = 60 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backup_api_class               = cinder.backup.api.API {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backup_name_template           = backup-%s {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[86013]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backup_use_same_host           = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backup_use_temp_snapshot       = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] chap_password                  = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] chap_username                  =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cinder_internal_tenant_project_id = 6f10f3a7c22240ecac226a5ba8ecdfc4 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cinder_internal_tenant_user_id = 6718abea83a34d8e891db9ec8b4e7c9b {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cluster                        = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] compression_format             = gzip {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] compute_api_class              = cinder.compute.nova.API {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] config_dir                     = [] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] config_source                  = [] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] control_exchange               = openstack {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] debug                          = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] default_availability_zone      = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] default_group_type             = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] default_volume_type            = QuobyteHD {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] disk_geometry                  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] driver_client_cert             = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] driver_client_cert_key         = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] driver_data_namespace          = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] driver_ssl_cert_path           = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] driver_ssl_cert_verify         = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] driver_use_ssl                 = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] enable_new_services            = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] enable_unsupported_driver      = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] enabled_backends               = ['QuobyteHD'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] enforce_multipath_for_image_xfer = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] filter_function                = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance_api_insecure            = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance_api_servers             = ['http://192.168.122.73/image'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance_api_ssl_compression     = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance_ca_certificates_file    = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance_catalog_info            = image:glance:publicURL {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance_certfile                = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance_keyfile                 = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance_num_retries             = 3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance_request_timeout         = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] goodness_function              = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] graceful_shutdown_timeout      = 5 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] group_api_class                = cinder.group.api.API {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] host                           = devstack {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_compress_on_upload       = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_conversion_address_space_limit = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_conversion_cpu_limit     = 60 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_conversion_disable       = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_introspection_address_space_limit = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_introspection_cpu_limit  = 60 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_upload_use_cinder_backend = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_upload_use_internal_tenant = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_volume_cache_enabled     = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_volume_cache_max_count   = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] image_volume_cache_max_size_gb = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] init_host_max_objects_retrieval = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] instance_format                = [instance: %(uuid)s]  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] iscsi_target_flags             =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] iscsi_write_cache              = on {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] iser_helper                    = tgtadm {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] iser_ip_address                = 192.168.122.73 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] iser_port                      = 3260 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] log_color                      = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] log_config_append              = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] log_dir                        = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] log_file                       = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] log_options                    = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] log_rotate_interval            = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] log_rotate_interval_type       = days {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] log_rotation_type              = none {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] max_age                        = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] max_logfile_count              = 30 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] max_logfile_size_mb            = 200 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] max_over_subscription_ratio    = 20.0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] message_reap_interval          = 86400 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] message_ttl                    = 2592000 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] migration_create_volume_timeout_secs = 300 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] monkey_patch                   = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] monkey_patch_modules           = [] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] my_ip                          = 192.168.122.73 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] no_snapshot_gb_quota           = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] num_iser_scan_tries            = 3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] num_shell_tries                = 3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] num_volume_device_scan_tries   = 3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] nvmeof_conn_info_version       = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] nvmet_ns_id                    = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] nvmet_port_id                  = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] osapi_max_limit                = 1000 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] osapi_volume_ext_list          = [] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] osapi_volume_listen_port       = 8776 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] osapi_volume_use_ssl           = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] osapi_volume_workers           = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] per_volume_size_limit          = -1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] periodic_fuzzy_delay           = 60 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] periodic_interval              = 60 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] public_endpoint                = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] publish_errors                 = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] quota_backup_gigabytes         = 1000 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] quota_backups                  = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] quota_gigabytes                = 1000 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] quota_groups                   = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] quota_snapshots                = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] quota_volumes                  = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] rate_limit_burst               = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] rate_limit_except_level        = CRITICAL {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] rate_limit_interval            = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] reinit_driver_count            = 3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] replication_device             = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] report_discard_supported       = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] report_interval                = 120 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] reservation_clean_interval     = 86400 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] reservation_expire             = 86400 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] reserved_image_namespaces      = [] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] reserved_percentage            = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] rpc_response_timeout           = 120 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] run_external_periodic_tasks    = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] scst_target_driver             = iscsi {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] scst_target_iqn_name           = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_down_time              = 720 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] shell_completion               = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] snapshot_name_template         = snapshot-%s {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] split_loggers                  = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] state_path                     = /opt/stack/data/cinder {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] storage_availability_zone      = nova {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] storage_protocol               = iSCSI {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] syslog_log_facility            = LOG_USER {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] target_helper                  = lioadm {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] target_ip_address              = 192.168.122.73 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] target_port                    = 3260 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] target_protocol                = iscsi {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] target_secondary_ip_addresses  = [] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] trace_flags                    = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] transport_url                  = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] until_refresh                  = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] use_chap_auth                  = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] use_default_quota_class        = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] use_journal                    = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] use_json                       = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] use_multipath_for_image_xfer   = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] use_stderr                     = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] use_syslog                     = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] verify_glance_signatures       = enabled {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_api_class               = cinder.volume.api.API {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_backend_name            = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_clear                   = zero {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_clear_ionice            = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_clear_size              = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[86013]: INFO cinder.volume.manager [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[86013]: DEBUG cinder.volume.drivers.remotefs [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86013) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_copy_bps_limit          = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_dd_blocksize            = 1M {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_name_template           = volume-%s {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_service_inithost_offload = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volume_usage_audit_period      = month {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] zoning_mode                    = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_concurrency.disable_process_locking = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.auth_section = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.auth_type   = password {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.auth_version = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.cache       = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.certfile    = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.delay_auth_decision = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.http_connect_timeout = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.include_service_catalog = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.insecure    = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.interface   = public {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.keyfile     = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_password = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcache_username = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.region_name = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.service_token_roles_required = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.service_type = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.token_cache_time = 300 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.73/identity {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.backend                  = dogpile.cache.null {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.backend_argument         = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.backend_expiration_time  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.config_prefix            = cache.oslo {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.debug_cache_backend      = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.enable_retry_client      = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.enable_socket_keepalive  = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.enabled                  = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.expiration_time          = 600 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.hashclient_retry_attempts = 2 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.memcache_dead_retry      = 300 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.memcache_pool_maxsize    = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.memcache_sasl_enabled    = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.password                 = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.proxies                  = [] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.redis_db                 = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.redis_sentinel_service_name = mymaster {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.redis_server             = localhost:6379 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.retry_attempts           = 2 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.retry_delay              = 0.0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.socket_keepalive_count   = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.socket_keepalive_idle    = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.socket_keepalive_interval = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.socket_timeout           = 1.0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.tls_allowed_ciphers      = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.tls_cafile               = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.tls_certfile             = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.tls_enabled              = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.tls_keyfile              = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cache.username                 = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] coordination.backend_url       = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.asyncio_connection    = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.asyncio_slave_connection = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.backend               = sqlalchemy {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.connection            = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.connection_debug      = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.connection_parameters =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.connection_recycle_time = 3600 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.connection_trace      = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.db_inc_retry_interval = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.db_max_retries        = 20 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.db_max_retry_interval = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.db_retry_interval     = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.max_overflow          = 50 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.max_pool_size         = 5 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.max_retries           = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.mysql_wsrep_sync_wait = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.pool_timeout          = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.retry_interval        = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.slave_connection      = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.sqlite_synchronous    = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.synchronous_reader    = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] database.use_db_reconnect      = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_tracing.insecure = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler.connection_string     = messaging:// {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler.enabled               = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler.es_doc_type           = notification {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler.es_scroll_size        = 10000 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler.es_scroll_time        = 2m {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler.filter_error_trace    = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler.hmac_keys             = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler.sentinel_service_name = mymaster {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler.socket_timeout        = 0.1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler.trace_requests        = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler.trace_sqlalchemy      = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler_jaeger.process_tags   = {} {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler_jaeger.service_name_prefix = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] profiler_otlp.service_name_prefix = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_policy.enforce_new_defaults = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_policy.policy_default_rule = default {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_policy.policy_file        = policy.yaml {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] privsep_osbrick.group          = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] privsep_osbrick.helper_command = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] privsep_osbrick.user           = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cinder_sys_admin.group         = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cinder_sys_admin.helper_command = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] cinder_sys_admin.user          = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.auth_section      = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.auth_type         = password {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.cafile            = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.certfile          = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.collect_timing    = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.insecure          = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.keyfile           = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.send_service_user_token = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.split_loggers     = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.timeout           = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.tls_ciphers       = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] service_user.tls_min_version   = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.auth_section            = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.auth_type               = password {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.certfile                = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.collect_timing          = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.insecure                = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.keyfile                 = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.region_name             = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.split_loggers           = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.timeout                 = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.tls_ciphers             = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] glance.tls_min_version         = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.backend_availability_zone = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.chap_password = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.chap_username =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.disk_geometry = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.driver_client_cert = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.driver_client_cert_key = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.driver_data_namespace = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.driver_use_ssl = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.enable_unsupported_driver = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.extra_capabilities = {} {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.filter_function = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.goodness_function = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.iscsi_target_flags =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.iscsi_write_cache = on {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.iser_helper   = tgtadm {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.iser_ip_address = 192.168.122.73 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.iser_port     = 3260 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nas_host      =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nas_login     = admin {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nas_mount_options = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nas_password  = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nas_private_key =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nas_share_path =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.num_shell_tries = 3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.nvmet_port_id = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.quobyte_client_cfg = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.quobyte_volume_url = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.replication_device = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.report_discard_supported = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.reserved_percentage = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.scst_target_driver = iscsi {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.scst_target_iqn_name = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.storage_protocol = iSCSI {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.target_helper = tgtadm {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.target_ip_address = 192.168.122.73 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.target_port   = 3260 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.target_protocol = iscsi {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.trace_flags   = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.unique_fqdn_network = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.use_chap_auth = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.volume_backend_name = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.volume_clear  = zero {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.volume_clear_ionice = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.volume_clear_size = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_reports.file_event_handler = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_reports.log_dir           = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.backend_availability_zone = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.backend_host         = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.chap_password        = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.chap_username        = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.chiscsi_conf         = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.disk_geometry        = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.driver_client_cert   = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.driver_client_cert_key = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.driver_data_namespace = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.driver_use_ssl       = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.extra_capabilities   = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.filter_function      = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.goodness_function    = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.iser_helper          = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.iser_ip_address      = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.iser_port            = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.iser_target_prefix   = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nas_host             = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nas_login            = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nas_mount_options    = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nas_password         = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[86013]: DEBUG cinder.volume.drivers.quobyte [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86013) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nas_private_key      = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[86013]: WARNING cinder.volume.drivers.quobyte [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nas_share_path       = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nas_ssh_port         = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[86013]: WARNING cinder.volume.drivers.quobyte [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.num_shell_tries      = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Running cmd (subprocess): mount.quobyte {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.nvmet_port_id        = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.replication_device   = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.report_discard_supported = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.reserved_percentage  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.scst_target_driver   = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.storage_protocol     = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.target_helper        = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.target_ip_address    = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.target_port          = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.target_prefix        = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.target_protocol      = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.trace_flags          = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.use_chap_auth        = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.volume_clear         = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.volume_clear_size    = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] QuobyteHD.volumes_dir          = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.ssl      = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_notifications.driver = [] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_notifications.retry = -1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] oslo_messaging_notifications.transport_url = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] key_manager.fixed_key          = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.barbican_api_version  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.barbican_endpoint     = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.barbican_endpoint_type = public {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.barbican_region_name  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.cafile                = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.certfile              = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.collect_timing        = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.insecure              = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.keyfile               = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.number_of_retries     = 60 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.retry_delay           = 1 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.send_service_user_token = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.split_loggers         = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.timeout               = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.tls_ciphers           = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.tls_min_version       = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.verify_ssl            = True {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican.verify_ssl_path       = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican_service_user.auth_section = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican_service_user.auth_type = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican_service_user.cafile   = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican_service_user.certfile = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican_service_user.collect_timing = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican_service_user.insecure = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican_service_user.keyfile  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican_service_user.split_loggers = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican_service_user.timeout  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican_service_user.tls_ciphers = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] barbican_service_user.tls_min_version = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.approle_role_id          = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.approle_secret_id        = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.auth_method              = approle {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.auth_path                = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.kv_mountpoint            = secret {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.kv_path                  = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.kv_version               = 2 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.namespace                = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.root_token_id            = **** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.ssl_ca_crt_file          = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.timeout                  = 60.0 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.token_file               = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.token_role               = None {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.use_ssl                  = False {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:53:55 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] ******************************************************************************** {{(pid=85796) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 04 00:53:55 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] CMD "mount.quobyte" returned: 1 in 0.079s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:53:55 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:53:55 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:53:55 devstack cinder-volume[86013]: DEBUG cinder.volume.drivers.quobyte [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:53:55 devstack cinder-volume[86013]: INFO cinder.volume.drivers.quobyte [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 ...
Nov 04 00:53:55 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d -c /etc/quobyte/client-cinder.cfg {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:53:55 devstack sudo[86019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d -c /etc/quobyte/client-cinder.cfg
Nov 04 00:53:55 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:53:56 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.398s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:53:56 devstack cinder-volume[86013]: INFO cinder.volume.drivers.quobyte [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 succeeded
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG cinder.volume.drivers.quobyte [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.410s {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:53:56 devstack sudo[86121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:53:56 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:53:56 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.233s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:53:56 devstack cinder-volume[86013]: INFO cinder.volume.driver [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Driver hasn't implemented _init_vendor_properties()
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG cinder.volume.driver [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6460418701172, 'free_capacity_gb': 1773.6460418701172, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86013) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG oslo_db.sqlalchemy.engines [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG dbcounter [-] [86013] Writer thread running {{(pid=86013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG cinder.db.api [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Building query based on filter {{(pid=86013) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG cinder.image.image_utils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86013) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 04 00:53:56 devstack cinder-volume[86013]: INFO cinder.keymgr.migration [None req-cd614aa3-12d4-416f-95ef-de27d562588e None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG cinder.volume.drivers.quobyte [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG cinder.volume.drivers.quobyte [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:53:56 devstack sudo[86125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:53:56 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:53:56 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.237s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG cinder.manager [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Notifying Schedulers of capabilities ... {{(pid=86013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:53:56 devstack cinder-volume[86013]: INFO cinder.volume.manager [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Driver initialization completed successfully.
Nov 04 00:53:56 devstack cinder-volume[86013]: INFO cinder.manager [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Initiating service 3 cleanup
Nov 04 00:53:56 devstack cinder-volume[86013]: INFO cinder.manager [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Service 3 cleanup completed.
Nov 04 00:53:56 devstack cinder-volume[86013]: DEBUG cinder.service [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Creating RPC server for service cinder-volume {{(pid=86013) start /opt/stack/cinder/cinder/service.py:231}}
Nov 04 00:53:57 devstack cinder-volume[86013]: DEBUG cinder.service [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86013) start /opt/stack/cinder/cinder/service.py:237}}
Nov 04 00:53:57 devstack cinder-volume[86013]: INFO cinder.volume.manager [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 04 00:53:57 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:53:57 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:53:57 devstack cinder-volume[86013]: DEBUG cinder.volume.drivers.quobyte [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:53:57 devstack cinder-volume[86013]: DEBUG cinder.volume.drivers.quobyte [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:53:57 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:53:57 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:53:57 devstack sudo[86128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:53:57 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:53:57 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root
Nov 04 00:53:57 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.271s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:53:57 devstack cinder-volume[86013]: INFO cinder.volume.manager [None req-1448510c-9a9d-4dcc-b556-b224b9990805 None None] Driver post RPC initialization completed successfully.
Nov 04 00:54:01 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-94609bd2-1b8e-4c29-b98c-82dd4008f77e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:54:01 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-94609bd2-1b8e-4c29-b98c-82dd4008f77e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:54:01 devstack cinder-volume[86013]: DEBUG cinder.volume.drivers.quobyte [None req-94609bd2-1b8e-4c29-b98c-82dd4008f77e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86013) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:54:01 devstack cinder-volume[86013]: DEBUG cinder.volume.drivers.quobyte [None req-94609bd2-1b8e-4c29-b98c-82dd4008f77e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86013) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:54:01 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-94609bd2-1b8e-4c29-b98c-82dd4008f77e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86013) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:54:01 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-94609bd2-1b8e-4c29-b98c-82dd4008f77e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:54:01 devstack sudo[86314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:54:01 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:54:02 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root
Nov 04 00:54:02 devstack cinder-volume[86013]: DEBUG oslo_concurrency.processutils [None req-94609bd2-1b8e-4c29-b98c-82dd4008f77e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.230s {{(pid=86013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:54:02 devstack cinder-volume[86013]: DEBUG cinder.manager [None req-94609bd2-1b8e-4c29-b98c-82dd4008f77e None None] Notifying Schedulers of capabilities ... {{(pid=86013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:54:02 devstack cinder-volume[85796]: INFO oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Caught SIGTERM, stopping children
Nov 04 00:54:02 devstack cinder-volume[85796]: DEBUG oslo_concurrency.lockutils [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Acquiring lock "singleton_lock" {{(pid=85796) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 00:54:02 devstack cinder-volume[85796]: DEBUG oslo_concurrency.lockutils [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Acquired lock "singleton_lock" {{(pid=85796) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 00:54:02 devstack cinder-volume[85796]: DEBUG oslo_concurrency.lockutils [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Releasing lock "singleton_lock" {{(pid=85796) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 00:54:02 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Stop services. {{(pid=85796) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 04 00:54:02 devstack cinder-volume[85796]: DEBUG oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Killing children. {{(pid=85796) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 04 00:54:02 devstack cinder-volume[85796]: INFO oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Waiting on 1 children to exit
Nov 04 00:54:05 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Acquiring lock "singleton_lock" {{(pid=86013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 00:54:05 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Acquired lock "singleton_lock" {{(pid=86013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 00:54:05 devstack cinder-volume[86013]: DEBUG oslo_concurrency.lockutils [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Releasing lock "singleton_lock" {{(pid=86013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 00:54:05 devstack cinder-volume[86013]: WARNING amqp [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 04 00:54:05 devstack cinder-volume[86013]: WARNING amqp [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 04 00:54:05 devstack cinder-volume[85796]: INFO oslo_service.backend._eventlet.service [None req-5339e802-1a9e-4c74-b2a2-a4fdb9dbfbaa None None] Child 86013 exited with status 0
Nov 04 00:54:05 devstack cinder-volume[86369]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 04 00:54:05 devstack cinder-volume[86369]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 04 00:54:05 devstack cinder-volume[86369]: we strongly recommend against using it for new projects.
Nov 04 00:54:05 devstack cinder-volume[86369]: If you are already using Eventlet, we recommend migrating to a different
Nov 04 00:54:05 devstack cinder-volume[86369]: framework.  For more detail see
Nov 04 00:54:05 devstack cinder-volume[86369]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 04 00:54:05 devstack cinder-volume[86369]:   import eventlet  # noqa
Nov 04 00:54:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86369) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 00:54:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86369) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 00:54:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86369) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 00:54:09 devstack cinder-volume[86369]: INFO dbcounter [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Registered counter for database cinder
Nov 04 00:54:09 devstack cinder-volume[86369]: DEBUG oslo_db.sqlalchemy.engines [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86369) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writer thread running {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 00:54:10 devstack cinder-volume[86369]: INFO cinder.rpc [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 04 00:54:10 devstack cinder-volume[86369]: INFO cinder.rpc [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_db.sqlalchemy.engines [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86369) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:54:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Determined volume DB was empty at startup.
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86369) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 04 00:54:10 devstack cinder-volume[86369]: WARNING stevedore.named [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 04 00:54:10 devstack cinder-volume[86369]: WARNING castellan.key_manager [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 00:54:10 devstack cinder-volume[86369]: WARNING cinder.keymgr.conf_key_mgr [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 00:54:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_db.sqlalchemy.engines [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86369) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:54:10 devstack cinder-volume[86369]: INFO oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Starting 1 workers
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Started child 86660 {{(pid=86369) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Full set of CONF: {{(pid=86369) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] ******************************************************************************** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] Configuration options gathered from: {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 04 00:54:10 devstack cinder-volume[86660]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] ================================================================================ {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] allow_availability_zone_fallback = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] allow_compression_on_image_upload = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] allowed_direct_url_schemes     = [] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] api_rate_limit                 = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] auth_strategy                  = keystone {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_availability_zone      = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_host                   = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_name                   = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_stats_polling_interval = 60 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backup_api_class               = cinder.backup.api.API {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backup_name_template           = backup-%s {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backup_use_same_host           = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backup_use_temp_snapshot       = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] chap_password                  = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] chap_username                  =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cinder_internal_tenant_project_id = 6f10f3a7c22240ecac226a5ba8ecdfc4 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cinder_internal_tenant_user_id = 6718abea83a34d8e891db9ec8b4e7c9b {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cluster                        = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] compression_format             = gzip {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] config_dir                     = [] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] config_source                  = [] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] control_exchange               = openstack {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] debug                          = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] default_availability_zone      = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] default_group_type             = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] default_volume_type            = QuobyteHD {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] disk_geometry                  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] driver_client_cert             = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] driver_client_cert_key         = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] driver_data_namespace          = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] driver_ssl_cert_path           = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] driver_ssl_cert_verify         = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] driver_use_ssl                 = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] enable_new_services            = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] enable_unsupported_driver      = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] enforce_multipath_for_image_xfer = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] filter_function                = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance_api_insecure            = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance_api_servers             = ['http://192.168.122.73/image'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance_api_ssl_compression     = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance_ca_certificates_file    = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance_certfile                = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86660) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance_keyfile                 = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance_num_retries             = 3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance_request_timeout         = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] goodness_function              = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] graceful_shutdown_timeout      = 5 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] group_api_class                = cinder.group.api.API {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] host                           = devstack {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_compress_on_upload       = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_conversion_address_space_limit = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_conversion_cpu_limit     = 60 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_conversion_disable       = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_introspection_address_space_limit = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_introspection_cpu_limit  = 60 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_upload_use_cinder_backend = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_upload_use_internal_tenant = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_volume_cache_enabled     = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_volume_cache_max_count   = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] image_volume_cache_max_size_gb = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] init_host_max_objects_retrieval = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] iscsi_target_flags             =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] iscsi_write_cache              = on {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] iser_helper                    = tgtadm {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] iser_ip_address                = 192.168.122.73 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] iser_port                      = 3260 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] log_color                      = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] log_config_append              = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] log_dir                        = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] log_file                       = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] log_options                    = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] log_rotate_interval            = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] log_rotate_interval_type       = days {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] log_rotation_type              = none {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] max_age                        = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] max_logfile_count              = 30 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] max_logfile_size_mb            = 200 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] max_over_subscription_ratio    = 20.0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] message_reap_interval          = 86400 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] message_ttl                    = 2592000 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] migration_create_volume_timeout_secs = 300 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] monkey_patch                   = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] monkey_patch_modules           = [] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] my_ip                          = 192.168.122.73 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] no_snapshot_gb_quota           = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] num_iser_scan_tries            = 3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] num_shell_tries                = 3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] num_volume_device_scan_tries   = 3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] nvmeof_conn_info_version       = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] nvmet_ns_id                    = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] nvmet_port_id                  = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] osapi_max_limit                = 1000 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] osapi_volume_ext_list          = [] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] osapi_volume_listen_port       = 8776 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] osapi_volume_use_ssl           = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] osapi_volume_workers           = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] per_volume_size_limit          = -1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] periodic_fuzzy_delay           = 60 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] periodic_interval              = 60 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] public_endpoint                = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] publish_errors                 = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] quota_backup_gigabytes         = 1000 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] quota_backups                  = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] quota_gigabytes                = 1000 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] quota_groups                   = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] quota_snapshots                = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] quota_volumes                  = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] rate_limit_burst               = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] rate_limit_except_level        = CRITICAL {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] rate_limit_interval            = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] reinit_driver_count            = 3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] replication_device             = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] report_discard_supported       = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] report_interval                = 120 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] reservation_clean_interval     = 86400 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] reservation_expire             = 86400 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] reserved_image_namespaces      = [] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] reserved_percentage            = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] rpc_response_timeout           = 120 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] run_external_periodic_tasks    = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] scst_target_driver             = iscsi {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] scst_target_iqn_name           = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_down_time              = 720 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] shell_completion               = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] snapshot_name_template         = snapshot-%s {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] split_loggers                  = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] state_path                     = /opt/stack/data/cinder {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] storage_availability_zone      = nova {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] storage_protocol               = iSCSI {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] syslog_log_facility            = LOG_USER {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] target_helper                  = lioadm {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] target_ip_address              = 192.168.122.73 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] target_port                    = 3260 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] target_protocol                = iscsi {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] target_secondary_ip_addresses  = [] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] trace_flags                    = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] transport_url                  = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] until_refresh                  = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] use_chap_auth                  = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] use_default_quota_class        = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] use_journal                    = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] use_json                       = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] use_multipath_for_image_xfer   = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] use_stderr                     = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] use_syslog                     = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] verify_glance_signatures       = enabled {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_api_class               = cinder.volume.api.API {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_backend_name            = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_clear                   = zero {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_clear_ionice            = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_clear_size              = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_copy_bps_limit          = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_dd_blocksize            = 1M {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_name_template           = volume-%s {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_service_inithost_offload = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volume_usage_audit_period      = month {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] zoning_mode                    = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_concurrency.disable_process_locking = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.auth_section = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.auth_type   = password {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.auth_version = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.cache       = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.certfile    = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.include_service_catalog = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.insecure    = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.interface   = public {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.keyfile     = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_password = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcache_username = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.region_name = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.service_type = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.73/identity {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.backend                  = dogpile.cache.null {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.backend_argument         = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.backend_expiration_time  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.config_prefix            = cache.oslo {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.debug_cache_backend      = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.enable_retry_client      = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.enable_socket_keepalive  = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.enabled                  = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.expiration_time          = 600 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.hashclient_retry_attempts = 2 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.memcache_dead_retry      = 300 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.memcache_sasl_enabled    = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86660) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.password                 = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.proxies                  = [] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.redis_db                 = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.quobyte [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.redis_server             = localhost:6379 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.retry_attempts           = 2 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.retry_delay              = 0.0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.socket_keepalive_count   = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.quobyte [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.socket_keepalive_idle    = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.socket_keepalive_interval = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.socket_timeout           = 1.0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.tls_allowed_ciphers      = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.tls_cafile               = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.tls_certfile             = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.tls_enabled              = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.tls_keyfile              = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cache.username                 = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] coordination.backend_url       = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Running cmd (subprocess): mount.quobyte {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.asyncio_connection    = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.asyncio_slave_connection = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.backend               = sqlalchemy {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.connection            = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.connection_debug      = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.connection_parameters =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.connection_recycle_time = 3600 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.connection_trace      = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.db_inc_retry_interval = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.db_max_retries        = 20 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.db_max_retry_interval = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.db_retry_interval     = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.max_overflow          = 50 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.max_pool_size         = 5 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.max_retries           = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.mysql_wsrep_sync_wait = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.pool_timeout          = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.retry_interval        = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.slave_connection      = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.sqlite_synchronous    = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.synchronous_reader    = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] database.use_db_reconnect      = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_tracing.insecure = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler.connection_string     = messaging:// {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler.enabled               = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler.es_doc_type           = notification {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler.es_scroll_size        = 10000 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler.es_scroll_time        = 2m {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler.filter_error_trace    = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler.hmac_keys             = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler.sentinel_service_name = mymaster {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler.socket_timeout        = 0.1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler.trace_requests        = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler.trace_sqlalchemy      = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler_jaeger.process_tags   = {} {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler_jaeger.service_name_prefix = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] profiler_otlp.service_name_prefix = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_policy.enforce_new_defaults = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_policy.policy_default_rule = default {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] privsep_osbrick.group          = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] privsep_osbrick.helper_command = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] privsep_osbrick.user           = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cinder_sys_admin.group         = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cinder_sys_admin.helper_command = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] cinder_sys_admin.user          = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.auth_section      = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.auth_type         = password {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.cafile            = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.certfile          = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.collect_timing    = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.insecure          = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.keyfile           = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.send_service_user_token = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.split_loggers     = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.timeout           = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.tls_ciphers       = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] service_user.tls_min_version   = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.auth_section            = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.auth_type               = password {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.certfile                = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.collect_timing          = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.insecure                = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.keyfile                 = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.region_name             = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.split_loggers           = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.timeout                 = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.tls_ciphers             = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] glance.tls_min_version         = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.backend_availability_zone = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.chap_password = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.chap_username =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.disk_geometry = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.driver_client_cert = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.driver_client_cert_key = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.driver_data_namespace = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.driver_use_ssl = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.extra_capabilities = {} {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.filter_function = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.goodness_function = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.iscsi_target_flags =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.iscsi_write_cache = on {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.iser_ip_address = 192.168.122.73 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.iser_port     = 3260 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nas_host      =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nas_login     = admin {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nas_mount_options = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nas_password  = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nas_private_key =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nas_share_path =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.num_shell_tries = 3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.quobyte_volume_url = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.replication_device = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.report_discard_supported = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.reserved_percentage = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.target_helper = tgtadm {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.target_ip_address = 192.168.122.73 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.target_port   = 3260 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.target_protocol = iscsi {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.trace_flags   = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.unique_fqdn_network = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.use_chap_auth = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack quobyte-client[86665]: Reading configuration file: /etc/quobyte/client.cfg
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.volume_backend_name = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.volume_clear  = zero {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.volume_clear_ionice = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.volume_clear_size = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack quobyte-client[86665]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_reports.file_event_handler = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_reports.log_dir           = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.backend_availability_zone = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.backend_host         = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.chap_password        = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.chap_username        = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.disk_geometry        = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.driver_client_cert   = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.driver_data_namespace = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.extra_capabilities   = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.filter_function      = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.goodness_function    = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.iser_helper          = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.iser_ip_address      = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.iser_port            = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nas_host             = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nas_login            = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nas_mount_options    = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nas_password         = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nas_private_key      = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nas_share_path       = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.num_shell_tries      = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.replication_device   = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.report_discard_supported = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.reserved_percentage  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.scst_target_driver   = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.storage_protocol     = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.target_helper        = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.target_ip_address    = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.target_port          = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.target_prefix        = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.target_protocol      = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.trace_flags          = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.use_chap_auth        = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.volume_clear         = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.volume_clear_size    = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] QuobyteHD.volumes_dir          = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack sudo[86670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_notifications.driver = [] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_notifications.retry = -1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] key_manager.fixed_key          = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.barbican_api_version  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.barbican_endpoint     = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.barbican_endpoint_type = public {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.barbican_region_name  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.cafile                = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.certfile              = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.collect_timing        = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.insecure              = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.keyfile               = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.number_of_retries     = 60 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.retry_delay           = 1 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.send_service_user_token = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.split_loggers         = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.timeout               = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.tls_ciphers           = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.tls_min_version       = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.verify_ssl            = True {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican.verify_ssl_path       = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican_service_user.auth_section = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican_service_user.auth_type = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican_service_user.cafile   = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican_service_user.certfile = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican_service_user.collect_timing = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican_service_user.insecure = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican_service_user.keyfile  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican_service_user.split_loggers = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican_service_user.timeout  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican_service_user.tls_ciphers = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] barbican_service_user.tls_min_version = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.approle_role_id          = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.approle_secret_id        = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.auth_method              = approle {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.auth_path                = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.kv_mountpoint            = secret {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.kv_path                  = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.kv_version               = 2 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.namespace                = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.root_token_id            = **** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.ssl_ca_crt_file          = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.timeout                  = 60.0 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.token_file               = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.token_role               = None {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.use_ssl                  = False {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 00:54:10 devstack cinder-volume[86369]: DEBUG oslo_service.backend._eventlet.service [None req-3172b5bb-5b2b-4a0e-9855-f1b71bebc788 None None] ******************************************************************************** {{(pid=86369) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 04 00:54:10 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.246s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:54:10 devstack cinder-volume[86660]: INFO cinder.volume.driver [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Driver hasn't implemented _init_vendor_properties()
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG cinder.volume.driver [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6460418701172, 'free_capacity_gb': 1773.6460418701172, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86660) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG oslo_db.sqlalchemy.engines [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86660) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 00:54:10 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writer thread running {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG cinder.db.api [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Building query based on filter {{(pid=86660) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86660) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:54:11 devstack cinder-volume[86660]: INFO cinder.keymgr.migration [None req-35fc3c69-af24-444a-bb5b-047d5f8d240d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 04 00:54:11 devstack sudo[86679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:54:11 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:54:11 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.243s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:54:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Driver initialization completed successfully.
Nov 04 00:54:11 devstack cinder-volume[86660]: INFO cinder.manager [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Initiating service 3 cleanup
Nov 04 00:54:11 devstack cinder-volume[86660]: INFO cinder.manager [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Service 3 cleanup completed.
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG cinder.service [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Creating RPC server for service cinder-volume {{(pid=86660) start /opt/stack/cinder/cinder/service.py:231}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG cinder.service [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86660) start /opt/stack/cinder/cinder/service.py:237}}
Nov 04 00:54:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:54:11 devstack sudo[86691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:54:11 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:54:11 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root
Nov 04 00:54:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.249s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:54:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9035a30d-cbba-43f1-875d-c6ce5ae52620 None None] Driver post RPC initialization completed successfully.
Nov 04 00:54:20 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:54:21 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:54:21 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=3 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:54:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:54:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 6 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 00:54:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Flow 'volume_create_manager' (bba6f2aa-efbf-4a07-a6c4-1cc822252493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a605ff8-2e48-4648-a85a-0710d95a2bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a605ff8-2e48-4648-a85a-0710d95a2bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2032779815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69213386-1baa-43ab-89a8-c95503034ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc8f034f1c14ef8b9abe09af644f65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:55:10Z,use_quota=True,user_id='0d4fab328e7540a18923be313e5b0db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3a83c3-389e-4f69-9c2c-8bd077444af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3a83c3-389e-4f69-9c2c-8bd077444af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c43400-0587-404d-9c46-93e886d94c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c43400-0587-404d-9c46-93e886d94c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69213386-1baa-43ab-89a8-c95503034ec9', 'volume_name': 'volume-69213386-1baa-43ab-89a8-c95503034ec9', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c47e82-3113-4993-a9d7-dd53a3e7d7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c47e82-3113-4993-a9d7-dd53a3e7d7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cef7ace-b7ad-4428-b81b-4d223d1afc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:10 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Volume 69213386-1baa-43ab-89a8-c95503034ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69213386-1baa-43ab-89a8-c95503034ec9', 'volume_size': 1}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2032779815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69213386-1baa-43ab-89a8-c95503034ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc8f034f1c14ef8b9abe09af644f65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:55:10Z,use_quota=True,user_id='0d4fab328e7540a18923be313e5b0db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Creating volume 69213386-1baa-43ab-89a8-c95503034ec9 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:55:10 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:10 devstack sudo[87540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9 1073741824
Nov 04 00:55:10 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-203b8f6b-9af9-4569-a5a6-cd89d5a545dd tempest-GroupSnapshotsTest-405250553 None] Group tempest-GroupSnapshotsTest-Group-1485384709: creating
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Flow 'volume_create_manager' (cac44fa0-d1ec-4d7a-b181-f7c2b45fe173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba11f5f-c661-43a3-8313-c71c394f1bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-203b8f6b-9af9-4569-a5a6-cd89d5a545dd tempest-GroupSnapshotsTest-405250553 None] Group tempest-GroupSnapshotsTest-Group-1485384709: created successfully
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba11f5f-c661-43a3-8313-c71c394f1bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-888529326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9c51a2-e2ee-4851-832e-50aed7c11803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef1475eeba24d3c803f25a82227e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:55:11Z,use_quota=True,user_id='c24f7d23201f4b6d9b774c2789bfdd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce2e5b0-5af6-47f1-a3db-017ee33059a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce2e5b0-5af6-47f1-a3db-017ee33059a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99da3ae0-4644-492f-b741-3ef71d47076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99da3ae0-4644-492f-b741-3ef71d47076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9c51a2-e2ee-4851-832e-50aed7c11803', 'volume_name': 'volume-9b9c51a2-e2ee-4851-832e-50aed7c11803', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f73ff3a-d039-43ee-82e2-916d0512a232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f73ff3a-d039-43ee-82e2-916d0512a232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da7e5a4-46bf-407e-820b-a69016a17550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:11 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Volume 9b9c51a2-e2ee-4851-832e-50aed7c11803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9c51a2-e2ee-4851-832e-50aed7c11803', 'volume_size': 1}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-203b8f6b-9af9-4569-a5a6-cd89d5a545dd tempest-GroupSnapshotsTest-405250553 None] Create group completed successfully.
Nov 04 00:55:11 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9 1073741824" returned: 0 in 0.642s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:11 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9
Nov 04 00:55:11 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:11 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9" returned: 0 in 0.254s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-888529326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9c51a2-e2ee-4851-832e-50aed7c11803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef1475eeba24d3c803f25a82227e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:55:11Z,use_quota=True,user_id='c24f7d23201f4b6d9b774c2789bfdd5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Creating volume 9b9c51a2-e2ee-4851-832e-50aed7c11803 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:55:11 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cef7ace-b7ad-4428-b81b-4d223d1afc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69213386-1baa-43ab-89a8-c95503034ec9', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:11 devstack sudo[87868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803 1073741824
Nov 04 00:55:11 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da1fadb-2abb-472f-bce8-e6f98ed55be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:11 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Volume volume-69213386-1baa-43ab-89a8-c95503034ec9 (69213386-1baa-43ab-89a8-c95503034ec9): created successfully
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da1fadb-2abb-472f-bce8-e6f98ed55be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Flow 'volume_create_manager' (bba6f2aa-efbf-4a07-a6c4-1cc822252493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:55:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f66c55eb-17c8-40db-9015-c295a5b1638f tempest-DeleteServersTestJSON-239340000 None] Created volume successfully.
Nov 04 00:55:12 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803 1073741824" returned: 0 in 0.681s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:12 devstack sudo[87873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803
Nov 04 00:55:12 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Flow 'volume_create_manager' (d1dea7f6-751b-43ba-9f79-95e5b6d66007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43745d87-01b0-4d9e-a8b1-eb88568307f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:12 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803" returned: 0 in 0.529s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43745d87-01b0-4d9e-a8b1-eb88568307f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1391186990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92e1fc11-03c0-4ecf-bb33-9384aad4b914,host='devstack@QuobyteHD#QuobyteHD',id=afd35611-4eff-4e16-a092-bb7d0086d2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8569d3399de44cfb953ed5793e549e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:55:13Z,use_quota=True,user_id='0a015801646a4b39bb2e96ab7be89187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39b2a10c-c325-4882-ad26-6385642eb421),volume_type_id=39b2a10c-c325-4882-ad26-6385642eb421)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6787904b-d8a4-443b-ba5b-f926b802ecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6787904b-d8a4-443b-ba5b-f926b802ecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee475a3f-7bbd-4905-a85c-2387a926d9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee475a3f-7bbd-4905-a85c-2387a926d9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd35611-4eff-4e16-a092-bb7d0086d2e2', 'volume_name': 'volume-afd35611-4eff-4e16-a092-bb7d0086d2e2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d4b136-347f-418c-9b6d-f253d41dc919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d4b136-347f-418c-9b6d-f253d41dc919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d751c7c7-0440-4838-a549-c7dccf7d2185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:13 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Volume afd35611-4eff-4e16-a092-bb7d0086d2e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd35611-4eff-4e16-a092-bb7d0086d2e2', 'volume_size': 1}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=92e1fc11-03c0-4ecf-bb33-9384aad4b914,created_at=2026-11-03T23:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1391186990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92e1fc11-03c0-4ecf-bb33-9384aad4b914,host='devstack@QuobyteHD#QuobyteHD',id=afd35611-4eff-4e16-a092-bb7d0086d2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8569d3399de44cfb953ed5793e549e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:55:13Z,use_quota=True,user_id='0a015801646a4b39bb2e96ab7be89187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39b2a10c-c325-4882-ad26-6385642eb421),volume_type_id=39b2a10c-c325-4882-ad26-6385642eb421)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Creating volume afd35611-4eff-4e16-a092-bb7d0086d2e2 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:55:13 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da7e5a4-46bf-407e-820b-a69016a17550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9c51a2-e2ee-4851-832e-50aed7c11803', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455892ab-1b7f-458b-a19e-4afa067f7e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:13 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 1073741824
Nov 04 00:55:13 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:13 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Volume volume-9b9c51a2-e2ee-4851-832e-50aed7c11803 (9b9c51a2-e2ee-4851-832e-50aed7c11803): created successfully
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455892ab-1b7f-458b-a19e-4afa067f7e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Flow 'volume_create_manager' (cac44fa0-d1ec-4d7a-b181-f7c2b45fe173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:55:13 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5b17af6e-b7bb-4b5e-9174-fd42e64e34e4 tempest-TaggedAttachmentsTest-2065937831 None] Created volume successfully.
Nov 04 00:55:13 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 1073741824" returned: 0 in 0.662s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:13 devstack sudo[87902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2
Nov 04 00:55:13 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:14 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2" returned: 0 in 0.406s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:55:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d751c7c7-0440-4838-a549-c7dccf7d2185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd35611-4eff-4e16-a092-bb7d0086d2e2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45ebcf7-7581-40fc-81d7-089fd6b5e02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:14 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Volume volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 (afd35611-4eff-4e16-a092-bb7d0086d2e2): created successfully
Nov 04 00:55:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45ebcf7-7581-40fc-81d7-089fd6b5e02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Flow 'volume_create_manager' (d1dea7f6-751b-43ba-9f79-95e5b6d66007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:55:14 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-46e3bc50-afce-4752-b6cb-6c82a3738bf2 tempest-GroupSnapshotsTest-405250553 None] Created volume successfully.
Nov 04 00:55:16 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] GroupSnapshot 7672ace7-be7e-4ff5-9b2c-ba1508f0b3a6: creating.
Nov 04 00:55:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Group snapshot 7672ace7-be7e-4ff5-9b2c-ba1508f0b3a6: creating. {{(pid=86660) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 04 00:55:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Creating offline snapshot 49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f of volume afd35611-4eff-4e16-a092-bb7d0086d2e2 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 00:55:16 devstack cinder-volume[86660]: INFO oslo.privsep.daemon [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpk2q_07cw/privsep.sock']
Nov 04 00:55:16 devstack sudo[87953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpk2q_07cw/privsep.sock
Nov 04 00:55:16 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:16 devstack cinder-volume[86660]: WARNING py.warnings [req-03f7be14-5abc-4fdb-8a45-9f5b5a774290 req-20918896-9c41-4798-b99b-5a65b9f0615b tempest-DeleteServersTestJSON-239340000 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Nov 04 00:55:16 devstack cinder-volume[86660]:   .first()
Nov 04 00:55:16 devstack cinder-volume[86660]: 
Nov 04 00:55:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-03f7be14-5abc-4fdb-8a45-9f5b5a774290 req-20918896-9c41-4798-b99b-5a65b9f0615b tempest-DeleteServersTestJSON-239340000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:17 devstack cinder-volume[86660]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 04 00:55:17 devstack cinder-volume[86660]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 04 00:55:17 devstack cinder-volume[86660]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 04 00:55:17 devstack cinder-volume[86660]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 04 00:55:17 devstack cinder-volume[86660]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 04 00:55:17 devstack cinder-volume[86660]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 04 00:55:17 devstack cinder-volume[86660]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 04 00:55:17 devstack cinder-volume[86660]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 04 00:55:17 devstack cinder-volume[86660]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 04 00:55:17 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:17 devstack cinder-volume[86660]: INFO oslo.privsep.daemon [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Spawned new privsep daemon via rootwrap
Nov 04 00:55:17 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Accepted privsep connection to /tmp/tmpk2q_07cw/privsep.sock {{(pid=86660) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 04 00:55:17 devstack cinder-volume[86660]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 04 00:55:17 devstack cinder-volume[86660]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 04 00:55:17 devstack cinder-volume[86660]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 04 00:55:17 devstack cinder-volume[86660]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87968
Nov 04 00:55:17 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e77726-ad8a-4ca0-98f7-288115159d31]: (2,) {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:55:17 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffdbb89-93c7-463d-b16b-a1ade34c1b97]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:55:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:17 devstack sudo[87970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2
Nov 04 00:55:17 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:17 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2" returned: 0 in 0.349s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:17 devstack sudo[87975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f 1G
Nov 04 00:55:17 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:18 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f 1G" returned: 0 in 0.487s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:18 devstack sudo[87993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f
Nov 04 00:55:18 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:18 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f" returned: 0 in 0.408s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:18 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 00:55:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:18 devstack sudo[88000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f
Nov 04 00:55:18 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:19 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f" returned: 0 in 0.343s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:19 devstack sudo[88009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.info
Nov 04 00:55:19 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:19 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.info" returned: 0 in 0.291s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:19 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 00:55:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:19 devstack sudo[88014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.info
Nov 04 00:55:19 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:19 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.info" returned: 0 in 0.272s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.711s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-03f7be14-5abc-4fdb-8a45-9f5b5a774290 req-20918896-9c41-4798-b99b-5a65b9f0615b tempest-DeleteServersTestJSON-239340000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.889s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-03f7be14-5abc-4fdb-8a45-9f5b5a774290 req-20918896-9c41-4798-b99b-5a65b9f0615b tempest-DeleteServersTestJSON-239340000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-03f7be14-5abc-4fdb-8a45-9f5b5a774290 req-20918896-9c41-4798-b99b-5a65b9f0615b tempest-DeleteServersTestJSON-239340000 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-69213386-1baa-43ab-89a8-c95503034ec9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7290cfa0-1752-4110-8b10-863ccc0b3c9d', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 00:55:20 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e796f987-607d-455d-9183-fdc753bfa04f tempest-GroupSnapshotsTest-405250553 None] group_snapshot 7672ace7-be7e-4ff5-9b2c-ba1508f0b3a6: created successfully
Nov 04 00:55:20 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-03f7be14-5abc-4fdb-8a45-9f5b5a774290 req-20918896-9c41-4798-b99b-5a65b9f0615b tempest-DeleteServersTestJSON-239340000 None] attachment_update completed successfully.
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f-3b5de489-22bf-41ae-ba1c-b1a846119045" by "_create_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f-3b5de489-22bf-41ae-ba1c-b1a846119045" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Creating volume 3b5de489-22bf-41ae-ba1c-b1a846119045 from snapshot 49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f {{(pid=86660) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-3b5de489-22bf-41ae-ba1c-b1a846119045" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-3b5de489-22bf-41ae-ba1c-b1a846119045" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] snapshot: 49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f, volume: 3b5de489-22bf-41ae-ba1c-b1a846119045,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6682c5ea-a782-4b1b-afc9-b67b2fdc40ba]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:55:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:22 devstack sudo[88562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f
Nov 04 00:55:22 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:23 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f" returned: 0 in 0.670s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afd35611-4eff-4e16-a092-bb7d0086d2e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 00:55:23 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b2d69f-769c-4e7a-83c5-90fb02a765dd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:55:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:23 devstack sudo[88614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2
Nov 04 00:55:23 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:23 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2" returned: 0 in 0.556s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 00:55:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 00:55:23 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045 not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 00:55:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:23 devstack sudo[88622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045
Nov 04 00:55:23 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:25 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-6a81c6ce-89a5-4947-891c-b387d7c848a6 req-06854054-7471-461d-8d20-ac32ee265811 tempest-DeleteServersTestJSON-239340000 None] Terminate volume connection completed successfully.
Nov 04 00:55:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-6a81c6ce-89a5-4947-891c-b387d7c848a6 req-06854054-7471-461d-8d20-ac32ee265811 tempest-DeleteServersTestJSON-239340000 None] Deleting attachment 7290cfa0-1752-4110-8b10-863ccc0b3c9d. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 00:55:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Acquiring lock "cinder-69213386-1baa-43ab-89a8-c95503034ec9-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:55:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Lock "cinder-69213386-1baa-43ab-89a8-c95503034ec9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:55:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Acquiring lock "cinder-quobyte-69213386-1baa-43ab-89a8-c95503034ec9" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:55:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Lock "cinder-quobyte-69213386-1baa-43ab-89a8-c95503034ec9" acquired by "delete_volume" :: waited 0.034s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:55:29 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7fafee-60c8-425d-8a81-e56e863d4d51]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:55:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:29 devstack sudo[88730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9
Nov 04 00:55:29 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:29 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9" returned: 0 in 0.588s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:30 devstack sudo[88736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9
Nov 04 00:55:30 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:30 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69213386-1baa-43ab-89a8-c95503034ec9" returned: 0 in 0.633s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Lock "cinder-quobyte-69213386-1baa-43ab-89a8-c95503034ec9" released by "delete_volume" :: held 1.369s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:55:30 devstack cinder-volume[86660]: WARNING cinder.quota [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:55:30 devstack cinder-volume[86660]: WARNING cinder.quota [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:55:30 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Created reservations ['35ffed0f-c139-42a7-90e7-7427f2d58005', '367d63d2-6139-4729-a4c1-e653e840dfbb', '8cc55bd3-232e-47d7-80f1-d2da59012669', '88e9ff23-5aaf-49b9-895a-d98d25b672dd'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:55:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:55:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:55:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:31 devstack sudo[88743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:55:31 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:31 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.375s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:31 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:55:31 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Deleted volume successfully.
Nov 04 00:55:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-272609b1-e695-42f8-b4ea-f87a281037e0 tempest-DeleteServersTestJSON-239340000 None] Lock "cinder-69213386-1baa-43ab-89a8-c95503034ec9-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:55:34 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045" returned: 0 in 11.024s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:34 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2, size 1024.00 MB, duration 11.03 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 00:55:34 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Converted 1024.00 MB image at 92.88 MB/s
Nov 04 00:55:34 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045 is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 00:55:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:34 devstack sudo[88747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045
Nov 04 00:55:34 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:35 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045" returned: 0 in 0.338s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-3b5de489-22bf-41ae-ba1c-b1a846119045" released by "_copy_volume_from_snapshot" :: held 12.755s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:55:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f-3b5de489-22bf-41ae-ba1c-b1a846119045" released by "_create_volume_from_snapshot" :: held 12.858s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:55:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.881s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:35 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3dcf42d4-5764-4891-8d08-080565a611e3 tempest-GroupSnapshotsTest-405250553 None] Create group from source-snapshot-7672ace7-be7e-4ff5-9b2c-ba1508f0b3a6 completed successfully.
Nov 04 00:55:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-3b5de489-22bf-41ae-ba1c-b1a846119045" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:55:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-3b5de489-22bf-41ae-ba1c-b1a846119045" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:55:36 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[be08295d-957e-451c-a4af-ab647b07dbc4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:55:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:37 devstack sudo[88751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045
Nov 04 00:55:37 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:37 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045" returned: 0 in 0.463s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:37 devstack sudo[88756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045
Nov 04 00:55:37 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:37 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3b5de489-22bf-41ae-ba1c-b1a846119045" returned: 0 in 0.462s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:37 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-3b5de489-22bf-41ae-ba1c-b1a846119045" released by "delete_volume" :: held 1.005s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Created reservations ['6c74d45b-ebdf-4ab5-8789-3ce9eff340bb'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:55:38 devstack cinder-volume[86660]: WARNING cinder.quota [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1098273835 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1098273835, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:55:38 devstack cinder-volume[86660]: WARNING cinder.quota [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1098273835 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1098273835, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Created reservations ['5419b979-fef2-4cd1-980b-29ef7116eae8', '2cd59086-342e-4a7f-b3aa-10c5f8819a76', '5fb1603b-9610-4271-b995-6d41afb0a6e6', 'f91c8986-e27e-4d49-9516-35596d261cea'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:38 devstack sudo[88760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:55:38 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:38 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:38 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] group_snapshot 7672ace7-be7e-4ff5-9b2c-ba1508f0b3a6: deleting
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.403s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:55:38 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e3b6a5e9-c532-4717-afdf-82349d4e6f45 tempest-GroupSnapshotsTest-405250553 None] Delete group completed successfully.
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] group_snapshot 7672ace7-be7e-4ff5-9b2c-ba1508f0b3a6: deleting {{(pid=86660) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-afd35611-4eff-4e16-a092-bb7d0086d2e2" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-afd35611-4eff-4e16-a092-bb7d0086d2e2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Deleting offline snapshot 49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f of volume afd35611-4eff-4e16-a092-bb7d0086d2e2 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] snapshot_file for this snap is: volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc91762c-23e7-4483-ab3a-ce8fcac6e762]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:55:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:39 devstack sudo[88764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f
Nov 04 00:55:39 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:39 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f" returned: 0 in 0.535s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afd35611-4eff-4e16-a092-bb7d0086d2e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 00:55:39 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeeb98e-cdbe-484a-b920-b00b5f29c672]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:55:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:39 devstack sudo[88769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2
Nov 04 00:55:39 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:40 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2" returned: 0 in 0.877s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:40 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f
Nov 04 00:55:40 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:40 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f" returned: 0 in 0.601s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:40 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f
Nov 04 00:55:40 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:41 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2.49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f" returned: 0 in 0.369s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-49ba1723-4d0f-44f3-a353-fc1b5c8e7e6f" released by "_delete_snapshot" :: held 2.507s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:55:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-afd35611-4eff-4e16-a092-bb7d0086d2e2" released by "delete_snapshot" :: held 2.549s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:55:41 devstack cinder-volume[86660]: WARNING cinder.quota [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1098273835 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1098273835, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:55:41 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] Created reservations ['2ad8ef27-ef99-4a75-9bc3-1416595cf079', 'e1164e47-f42d-44c8-ab1f-7a187ecf94f5', '026bac0c-9694-47f9-a691-39be5a83d285', '721519b2-5d6a-4abc-93c3-28b2f915b24c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:55:41 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-511713fa-8c7d-46ce-9860-90c50538687a tempest-GroupSnapshotsTest-405250553 None] group_snapshot 7672ace7-be7e-4ff5-9b2c-ba1508f0b3a6: deleted successfully
Nov 04 00:55:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-afd35611-4eff-4e16-a092-bb7d0086d2e2" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:55:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-afd35611-4eff-4e16-a092-bb7d0086d2e2" acquired by "delete_volume" :: waited 0.042s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:55:42 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[042a71fd-9ab9-42c0-b6b6-6f8899902981]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:55:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:42 devstack sudo[88787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2
Nov 04 00:55:42 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:43 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2" returned: 0 in 0.590s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:43 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2
Nov 04 00:55:43 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:43 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-afd35611-4eff-4e16-a092-bb7d0086d2e2" returned: 0 in 0.387s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-afd35611-4eff-4e16-a092-bb7d0086d2e2" released by "delete_volume" :: held 1.164s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:55:43 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Created reservations ['0a5d5f97-dc1e-4166-aaaa-e0f666a88636'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:55:43 devstack cinder-volume[86660]: WARNING cinder.db.api [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1098273835']
Nov 04 00:55:44 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Created reservations ['0e6eb734-0c4a-4b70-9e49-0f85f6e0432a', '7bfb47fc-3b61-4a22-86e6-30c9c01d2eaf', '933d58a9-f40e-45cc-9b49-cfd552b7a4b3', '077eb510-e159-4381-87b4-48769490f517'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:55:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:55:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:55:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:44 devstack sudo[88811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:55:44 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:44 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.376s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:44 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:55:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c1093aa9-93cd-4a8d-9d2b-6ffe1407f39d tempest-GroupSnapshotsTest-405250553 None] Delete group completed successfully.
Nov 04 00:55:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a7a3e279-52dc-476b-9c3f-b5607957dee4 tempest-GroupSnapshotsTest-405250553 None] Group tempest-GroupSnapshotsTest-Group-232110291: creating
Nov 04 00:55:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a7a3e279-52dc-476b-9c3f-b5607957dee4 tempest-GroupSnapshotsTest-405250553 None] Group tempest-GroupSnapshotsTest-Group-232110291: created successfully
Nov 04 00:55:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a7a3e279-52dc-476b-9c3f-b5607957dee4 tempest-GroupSnapshotsTest-405250553 None] Create group completed successfully.
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Flow 'volume_create_manager' (d6958f42-0bc1-4936-b195-9c40d1d4a8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d1f09e-a9d9-4be0-bd3d-a0e94c7ffcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d1f09e-a9d9-4be0-bd3d-a0e94c7ffcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-403191481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bd947783-d8d2-48ee-9189-4ba488a18e6e,host='devstack@QuobyteHD#QuobyteHD',id=fb719aad-931f-45c2-a3d5-59c1cabb83df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8569d3399de44cfb953ed5793e549e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:55:47Z,use_quota=True,user_id='0a015801646a4b39bb2e96ab7be89187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e122eb63-6267-41b2-98f8-cfa2e7b02b61),volume_type_id=e122eb63-6267-41b2-98f8-cfa2e7b02b61)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02dca03e-fb3a-443e-b4ed-7556701de103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02dca03e-fb3a-443e-b4ed-7556701de103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8d7cf6-d13c-45c4-9d7d-9c0909c96219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8d7cf6-d13c-45c4-9d7d-9c0909c96219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb719aad-931f-45c2-a3d5-59c1cabb83df', 'volume_name': 'volume-fb719aad-931f-45c2-a3d5-59c1cabb83df', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34eaad5-2c3d-41df-8c9e-57861ec99806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34eaad5-2c3d-41df-8c9e-57861ec99806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5828844c-f5a5-46ea-bd73-efd181abdf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:46 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Volume fb719aad-931f-45c2-a3d5-59c1cabb83df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb719aad-931f-45c2-a3d5-59c1cabb83df', 'volume_size': 1}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bd947783-d8d2-48ee-9189-4ba488a18e6e,created_at=2026-11-03T23:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-403191481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bd947783-d8d2-48ee-9189-4ba488a18e6e,host='devstack@QuobyteHD#QuobyteHD',id=fb719aad-931f-45c2-a3d5-59c1cabb83df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8569d3399de44cfb953ed5793e549e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:55:47Z,use_quota=True,user_id='0a015801646a4b39bb2e96ab7be89187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e122eb63-6267-41b2-98f8-cfa2e7b02b61),volume_type_id=e122eb63-6267-41b2-98f8-cfa2e7b02b61)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Creating volume fb719aad-931f-45c2-a3d5-59c1cabb83df {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:55:46 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:55:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:46 devstack sudo[88814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df 1073741824
Nov 04 00:55:46 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:47 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df 1073741824" returned: 0 in 0.635s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:47 devstack sudo[88820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df
Nov 04 00:55:47 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:47 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df" returned: 0 in 0.298s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:55:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5828844c-f5a5-46ea-bd73-efd181abdf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb719aad-931f-45c2-a3d5-59c1cabb83df', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a3694c-80c3-43ff-ab19-3cf420f99ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:47 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Volume volume-fb719aad-931f-45c2-a3d5-59c1cabb83df (fb719aad-931f-45c2-a3d5-59c1cabb83df): created successfully
Nov 04 00:55:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a3694c-80c3-43ff-ab19-3cf420f99ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Flow 'volume_create_manager' (d6958f42-0bc1-4936-b195-9c40d1d4a8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:55:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-aecfedd9-eff3-4113-bd04-f8d628517390 tempest-GroupSnapshotsTest-405250553 None] Created volume successfully.
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Flow 'volume_create_manager' (0e3d389c-bd33-4035-8154-83ab19062ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1f7260-dbdd-4521-a533-202352c28656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1f7260-dbdd-4521-a533-202352c28656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-405655853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bd947783-d8d2-48ee-9189-4ba488a18e6e,host='devstack@QuobyteHD#QuobyteHD',id=74d69233-02bd-4793-8b5d-157f46b26dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8569d3399de44cfb953ed5793e549e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:55:50Z,use_quota=True,user_id='0a015801646a4b39bb2e96ab7be89187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e122eb63-6267-41b2-98f8-cfa2e7b02b61),volume_type_id=e122eb63-6267-41b2-98f8-cfa2e7b02b61)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fda2729-c702-4c24-89b8-37105aa20527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fda2729-c702-4c24-89b8-37105aa20527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015e2f81-b469-425e-ab0b-5d17fdd80cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015e2f81-b469-425e-ab0b-5d17fdd80cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d69233-02bd-4793-8b5d-157f46b26dbf', 'volume_name': 'volume-74d69233-02bd-4793-8b5d-157f46b26dbf', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0697d1-2d4e-447e-8147-e862f9de94a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0697d1-2d4e-447e-8147-e862f9de94a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bafab57e-6383-4daa-a161-960e4c5a370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:50 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Volume 74d69233-02bd-4793-8b5d-157f46b26dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d69233-02bd-4793-8b5d-157f46b26dbf', 'volume_size': 1}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bd947783-d8d2-48ee-9189-4ba488a18e6e,created_at=2026-11-03T23:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-405655853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bd947783-d8d2-48ee-9189-4ba488a18e6e,host='devstack@QuobyteHD#QuobyteHD',id=74d69233-02bd-4793-8b5d-157f46b26dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8569d3399de44cfb953ed5793e549e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:55:50Z,use_quota=True,user_id='0a015801646a4b39bb2e96ab7be89187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e122eb63-6267-41b2-98f8-cfa2e7b02b61),volume_type_id=e122eb63-6267-41b2-98f8-cfa2e7b02b61)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Creating volume 74d69233-02bd-4793-8b5d-157f46b26dbf {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:55:50 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:50 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf 1073741824
Nov 04 00:55:50 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:50 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf 1073741824" returned: 0 in 0.501s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:50 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf
Nov 04 00:55:50 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:50 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf" returned: 0 in 0.247s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bafab57e-6383-4daa-a161-960e4c5a370f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d69233-02bd-4793-8b5d-157f46b26dbf', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ee68fd-6e7f-4a87-92aa-522604f414a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:55:50 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Volume volume-74d69233-02bd-4793-8b5d-157f46b26dbf (74d69233-02bd-4793-8b5d-157f46b26dbf): created successfully
Nov 04 00:55:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ee68fd-6e7f-4a87-92aa-522604f414a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:55:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Flow 'volume_create_manager' (0e3d389c-bd33-4035-8154-83ab19062ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:55:51 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-93ef479d-1b69-41de-ba94-4595a99d9228 tempest-GroupSnapshotsTest-405250553 None] Created volume successfully.
Nov 04 00:55:51 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-89a13ac4-2f30-46f6-85f6-42c8cad1b77f tempest-GroupSnapshotsTest-405250553 None] Update group completed successfully.
Nov 04 00:55:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:55:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:55:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:55:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:51 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:55:51 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:52 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.323s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:55:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:55:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 8 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 00:55:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 00:55:52 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e88957e4-7f64-4017-ae67-4e7a16954bc8 tempest-GroupSnapshotsTest-405250553 None] Update group completed successfully.
Nov 04 00:55:54 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ae88ed6c-0528-45bf-8fb5-07a20dca8b17 tempest-GroupSnapshotsTest-405250553 None] Update group completed successfully.
Nov 04 00:55:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c0baffc0-f861-4bca-94a8-bd8e5fcbcd92 tempest-GroupSnapshotsTest-405250553 None] Update group completed successfully.
Nov 04 00:55:56 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] GroupSnapshot b557d8ad-66d2-4852-bdba-e964c2c47a7a: creating.
Nov 04 00:55:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Group snapshot b557d8ad-66d2-4852-bdba-e964c2c47a7a: creating. {{(pid=86660) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 04 00:55:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Creating offline snapshot 395fe8f1-f0ba-4a8b-9296-f26bbf091870 of volume 74d69233-02bd-4793-8b5d-157f46b26dbf {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 00:55:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb41b072-5408-4688-9eb1-ee24b28bfd9f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:55:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:57 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf
Nov 04 00:55:57 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:57 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf" returned: 0 in 0.382s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:57 devstack sudo[88847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870 1G
Nov 04 00:55:57 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:57 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870 1G" returned: 0 in 0.554s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d69233-02bd-4793-8b5d-157f46b26dbf -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:57 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d69233-02bd-4793-8b5d-157f46b26dbf -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870
Nov 04 00:55:57 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:58 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74d69233-02bd-4793-8b5d-157f46b26dbf -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870" returned: 0 in 0.461s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:58 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870 is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 00:55:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:58 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870
Nov 04 00:55:58 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:58 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870" returned: 0 in 0.315s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:58 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.info
Nov 04 00:55:58 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:59 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.info" returned: 0 in 0.343s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:59 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 00:55:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:59 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.info
Nov 04 00:55:59 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:55:59 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Nov 04 00:55:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.info" returned: 0 in 0.423s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:55:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.622s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:55:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:55:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:55:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Creating offline snapshot eecd182a-8733-45ba-a431-9be586023027 of volume fb719aad-931f-45c2-a3d5-59c1cabb83df {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 00:55:59 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c77298-730d-4076-bac0-b82669bb947c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:55:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:55:59 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df
Nov 04 00:55:59 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:00 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df" returned: 0 in 0.665s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:00 devstack sudo[88910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027 1G
Nov 04 00:56:00 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:00 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027 1G" returned: 0 in 0.642s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb719aad-931f-45c2-a3d5-59c1cabb83df -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:00 devstack sudo[88922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb719aad-931f-45c2-a3d5-59c1cabb83df -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027
Nov 04 00:56:00 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:01 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb719aad-931f-45c2-a3d5-59c1cabb83df -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027" returned: 0 in 0.420s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:01 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027 is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 00:56:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:01 devstack sudo[88927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027
Nov 04 00:56:01 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:01 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027" returned: 0 in 0.403s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:01 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=70,cinder:UPDATE=60,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:56:01 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=66,cinder:SELECT=75,cinder:DELETE=2,cinder:INSERT=11 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:56:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:01 devstack sudo[88933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.info
Nov 04 00:56:01 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:02 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.info" returned: 0 in 0.403s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:02 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 00:56:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:02 devstack sudo[88938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.info
Nov 04 00:56:02 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:02 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.info" returned: 0 in 0.377s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.178s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:02 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c6cfbbdf-d176-4aaf-a470-170037d13810 tempest-GroupSnapshotsTest-405250553 None] group_snapshot b557d8ad-66d2-4852-bdba-e964c2c47a7a: created successfully
Nov 04 00:56:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] group_snapshot b557d8ad-66d2-4852-bdba-e964c2c47a7a: deleting
Nov 04 00:56:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] group_snapshot b557d8ad-66d2-4852-bdba-e964c2c47a7a: deleting {{(pid=86660) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 04 00:56:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-74d69233-02bd-4793-8b5d-157f46b26dbf" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-74d69233-02bd-4793-8b5d-157f46b26dbf" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-395fe8f1-f0ba-4a8b-9296-f26bbf091870" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-395fe8f1-f0ba-4a8b-9296-f26bbf091870" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Deleting offline snapshot 395fe8f1-f0ba-4a8b-9296-f26bbf091870 of volume 74d69233-02bd-4793-8b5d-157f46b26dbf {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 00:56:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] snapshot_file for this snap is: volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 00:56:03 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[df82c5ab-235b-485a-ad23-04246ae44935]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:03 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870
Nov 04 00:56:03 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:04 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870" returned: 0 in 0.531s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74d69233-02bd-4793-8b5d-157f46b26dbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 00:56:04 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc43c46-0d6f-4ae8-a695-20385bfdc9bf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:04 devstack sudo[88967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf
Nov 04 00:56:04 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:04 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf" returned: 0 in 0.404s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:04 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870
Nov 04 00:56:04 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:05 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870" returned: 0 in 0.447s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:05 devstack sudo[88979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870
Nov 04 00:56:05 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:05 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf.395fe8f1-f0ba-4a8b-9296-f26bbf091870" returned: 0 in 0.273s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-395fe8f1-f0ba-4a8b-9296-f26bbf091870" released by "_delete_snapshot" :: held 1.851s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-74d69233-02bd-4793-8b5d-157f46b26dbf" released by "delete_snapshot" :: held 1.898s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-fb719aad-931f-45c2-a3d5-59c1cabb83df" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-fb719aad-931f-45c2-a3d5-59c1cabb83df" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-eecd182a-8733-45ba-a431-9be586023027" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-eecd182a-8733-45ba-a431-9be586023027" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Deleting offline snapshot eecd182a-8733-45ba-a431-9be586023027 of volume fb719aad-931f-45c2-a3d5-59c1cabb83df {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] snapshot_file for this snap is: volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd39eef1-c7d9-4144-980d-86a14d2b8813]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:05 devstack sudo[88983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027
Nov 04 00:56:05 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:06 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027" returned: 0 in 0.417s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb719aad-931f-45c2-a3d5-59c1cabb83df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 00:56:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fb6f11-e350-4e4b-ab48-128020b86304]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:06 devstack sudo[88988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df
Nov 04 00:56:06 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:06 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df" returned: 0 in 0.494s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:06 devstack sudo[88993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027
Nov 04 00:56:06 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:07 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027" returned: 0 in 0.403s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:07 devstack sudo[88998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027
Nov 04 00:56:07 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:07 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df.eecd182a-8733-45ba-a431-9be586023027" returned: 0 in 0.305s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-eecd182a-8733-45ba-a431-9be586023027" released by "_delete_snapshot" :: held 1.792s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-fb719aad-931f-45c2-a3d5-59c1cabb83df" released by "delete_snapshot" :: held 1.825s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:07 devstack cinder-volume[86660]: WARNING cinder.quota [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1411350328 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1411350328, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:56:07 devstack cinder-volume[86660]: WARNING cinder.quota [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1411350328 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1411350328, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:56:07 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Created reservations ['17ee105a-4cf7-4307-9eb8-ab438082367b', '2bac9e56-cfd0-47c9-a389-1429cda630a3', '476377b6-96b1-4922-8f12-6381f744fcff', 'b3924c06-fd09-40a4-8cfc-946ddb6e392d'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:07 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] Created reservations ['83c71f25-381d-44c7-92dd-3e11cca456d7', '470c8fca-9037-4821-b163-de18db2360ef', '4ab6e693-a644-4766-8c28-e46099bee7d7', '2ad5ebf5-513a-4512-9a03-29726de0e082'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:07 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9c9fa733-79c7-487f-9833-a1fbdec216eb tempest-GroupSnapshotsTest-405250553 None] group_snapshot b557d8ad-66d2-4852-bdba-e964c2c47a7a: deleted successfully
Nov 04 00:56:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-74d69233-02bd-4793-8b5d-157f46b26dbf" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-74d69233-02bd-4793-8b5d-157f46b26dbf" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:09 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de43389-2acd-427f-b910-ffa062fbea9a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:09 devstack sudo[89077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf
Nov 04 00:56:09 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:10 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf" returned: 0 in 0.746s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:10 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf
Nov 04 00:56:10 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:10 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-74d69233-02bd-4793-8b5d-157f46b26dbf" returned: 0 in 0.579s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-74d69233-02bd-4793-8b5d-157f46b26dbf" released by "delete_volume" :: held 1.546s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-fb719aad-931f-45c2-a3d5-59c1cabb83df" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-fb719aad-931f-45c2-a3d5-59c1cabb83df" acquired by "delete_volume" :: waited 0.043s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:11 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33d3bcb-2f35-4c61-81e0-685dea587250]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:11 devstack sudo[89132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df
Nov 04 00:56:11 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:12 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df" returned: 0 in 0.987s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:12 devstack sudo[89148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df
Nov 04 00:56:12 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:12 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fb719aad-931f-45c2-a3d5-59c1cabb83df" returned: 0 in 0.574s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-fb719aad-931f-45c2-a3d5-59c1cabb83df" released by "delete_volume" :: held 1.763s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:12 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Created reservations ['0b8759e2-fd71-42a4-b0ae-6ebfe9d22cb5'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:12 devstack cinder-volume[86660]: WARNING cinder.quota [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1411350328 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1411350328, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:56:12 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Created reservations ['a1b5053f-935b-4d5a-b35c-905d276ee7a0', '6efb1bd7-dd8e-48cc-ac27-037f52c48185', 'a670f07b-1e13-43af-814c-b4bf90219ce0', '6c3a8108-f424-4149-8899-b29bebca5ab7'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Created reservations ['5a2a04cf-d643-4712-ab29-b192b3d0b933', '2e9482a1-fab7-4285-bbb6-4c005f3e1194', 'd63315f1-34dc-44d9-87f8-b17e2e01562d', '27b68c98-9425-4c70-bb63-91d444e3190c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:13 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:56:13 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:13 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.581s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:56:13 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4f4ee164-9136-4941-9a7e-df39757220fd tempest-GroupSnapshotsTest-405250553 None] Delete group completed successfully.
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-2d2de8a8-8391-4acc-b528-eeba397752f1 req-5459cc7e-7cda-4bf3-a1f5-a56aca634b67 tempest-TaggedAttachmentsTest-2065937831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-2d2de8a8-8391-4acc-b528-eeba397752f1 req-5459cc7e-7cda-4bf3-a1f5-a56aca634b67 tempest-TaggedAttachmentsTest-2065937831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-2d2de8a8-8391-4acc-b528-eeba397752f1 req-5459cc7e-7cda-4bf3-a1f5-a56aca634b67 tempest-TaggedAttachmentsTest-2065937831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-2d2de8a8-8391-4acc-b528-eeba397752f1 req-5459cc7e-7cda-4bf3-a1f5-a56aca634b67 tempest-TaggedAttachmentsTest-2065937831 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-9b9c51a2-e2ee-4851-832e-50aed7c11803', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a06601a0-fd0d-4970-9fc7-5583a9b684fd', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 00:56:14 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-2d2de8a8-8391-4acc-b528-eeba397752f1 req-5459cc7e-7cda-4bf3-a1f5-a56aca634b67 tempest-TaggedAttachmentsTest-2065937831 None] attachment_update completed successfully.
Nov 04 00:56:14 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4d8a5c17-8d27-4f13-a3b4-46adfb3151a0 tempest-GroupSnapshotsTest-405250553 None] Group tempest-GroupSnapshotsTest-Group-1817007201: creating
Nov 04 00:56:14 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4d8a5c17-8d27-4f13-a3b4-46adfb3151a0 tempest-GroupSnapshotsTest-405250553 None] Group tempest-GroupSnapshotsTest-Group-1817007201: created successfully
Nov 04 00:56:14 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4d8a5c17-8d27-4f13-a3b4-46adfb3151a0 tempest-GroupSnapshotsTest-405250553 None] Create group completed successfully.
Nov 04 00:56:16 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:56:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Flow 'volume_create_manager' (7cf4dd71-0ee7-4141-9634-e14fae4388ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:56:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ce1ffc-a42a-460f-a67d-5f6edf86479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ce1ffc-a42a-460f-a67d-5f6edf86479c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325595907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f90c7728-5b3d-4c12-aae7-b36f52b4afe2,host='devstack@QuobyteHD#QuobyteHD',id=ad7b836d-0624-4d40-924f-e6ae5855659f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8569d3399de44cfb953ed5793e549e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:56:17Z,use_quota=True,user_id='0a015801646a4b39bb2e96ab7be89187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddc95107-6fd7-4eba-88ba-8a409e7cf602),volume_type_id=ddc95107-6fd7-4eba-88ba-8a409e7cf602)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd724ff9-16ed-48f9-a2f4-a87149fa1d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd724ff9-16ed-48f9-a2f4-a87149fa1d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86cbaba-5ec1-4619-b3d6-2e3a5fd41823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86cbaba-5ec1-4619-b3d6-2e3a5fd41823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7b836d-0624-4d40-924f-e6ae5855659f', 'volume_name': 'volume-ad7b836d-0624-4d40-924f-e6ae5855659f', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7f0e7a-4468-4206-8d32-35c6c7d75e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7f0e7a-4468-4206-8d32-35c6c7d75e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d3115d-d74e-465f-93fc-20100dcf1d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:17 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Volume ad7b836d-0624-4d40-924f-e6ae5855659f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7b836d-0624-4d40-924f-e6ae5855659f', 'volume_size': 1}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f90c7728-5b3d-4c12-aae7-b36f52b4afe2,created_at=2026-11-03T23:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325595907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f90c7728-5b3d-4c12-aae7-b36f52b4afe2,host='devstack@QuobyteHD#QuobyteHD',id=ad7b836d-0624-4d40-924f-e6ae5855659f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8569d3399de44cfb953ed5793e549e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:56:17Z,use_quota=True,user_id='0a015801646a4b39bb2e96ab7be89187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddc95107-6fd7-4eba-88ba-8a409e7cf602),volume_type_id=ddc95107-6fd7-4eba-88ba-8a409e7cf602)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Creating volume ad7b836d-0624-4d40-924f-e6ae5855659f {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:56:17 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:17 devstack sudo[89594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f 1073741824
Nov 04 00:56:17 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:17 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f 1073741824" returned: 0 in 0.697s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:17 devstack sudo[89604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f
Nov 04 00:56:17 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:18 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f" returned: 0 in 0.550s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:56:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d3115d-d74e-465f-93fc-20100dcf1d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7b836d-0624-4d40-924f-e6ae5855659f', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f75043-b37c-4eeb-8445-c97c945c6383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:18 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Volume volume-ad7b836d-0624-4d40-924f-e6ae5855659f (ad7b836d-0624-4d40-924f-e6ae5855659f): created successfully
Nov 04 00:56:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f75043-b37c-4eeb-8445-c97c945c6383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Flow 'volume_create_manager' (7cf4dd71-0ee7-4141-9634-e14fae4388ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:56:18 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-38b7fc44-62f7-4dc5-b75a-002232ed42df tempest-GroupSnapshotsTest-405250553 None] Created volume successfully.
Nov 04 00:56:20 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] GroupSnapshot befe5643-f7a8-4f04-817f-5ac1220ede1d: creating.
Nov 04 00:56:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] Group snapshot befe5643-f7a8-4f04-817f-5ac1220ede1d: creating. {{(pid=86660) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 04 00:56:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] Creating offline snapshot f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d of volume ad7b836d-0624-4d40-924f-e6ae5855659f {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 00:56:20 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06ed019-fd09-4911-95b3-0ad2ce0f873c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:20 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f
Nov 04 00:56:20 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:21 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f" returned: 0 in 0.718s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:21 devstack sudo[89630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d 1G
Nov 04 00:56:21 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:21 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d 1G" returned: 0 in 0.787s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7b836d-0624-4d40-924f-e6ae5855659f -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:22 devstack sudo[89638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7b836d-0624-4d40-924f-e6ae5855659f -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d
Nov 04 00:56:22 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:22 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-346db6a5-2520-49da-9400-bbb7991378ce req-233860a9-ce5f-446e-8c9e-430b267d647c tempest-TaggedAttachmentsTest-2065937831 None] Terminate volume connection completed successfully.
Nov 04 00:56:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-346db6a5-2520-49da-9400-bbb7991378ce req-233860a9-ce5f-446e-8c9e-430b267d647c tempest-TaggedAttachmentsTest-2065937831 None] Deleting attachment a06601a0-fd0d-4970-9fc7-5583a9b684fd. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 00:56:22 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad7b836d-0624-4d40-924f-e6ae5855659f -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d" returned: 0 in 0.776s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:22 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 00:56:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:22 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d
Nov 04 00:56:22 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:23 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d" returned: 0 in 0.623s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:23 devstack sudo[89709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.info
Nov 04 00:56:23 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:24 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.info" returned: 0 in 0.580s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:24 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 00:56:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:24 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.info
Nov 04 00:56:24 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:24 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.info" returned: 0 in 0.397s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.089s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:24 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ed9d14ad-0926-4966-b99c-845b5bfc241d tempest-GroupSnapshotsTest-405250553 None] group_snapshot befe5643-f7a8-4f04-817f-5ac1220ede1d: created successfully
Nov 04 00:56:25 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] group_snapshot befe5643-f7a8-4f04-817f-5ac1220ede1d: deleting
Nov 04 00:56:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] group_snapshot befe5643-f7a8-4f04-817f-5ac1220ede1d: deleting {{(pid=86660) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 04 00:56:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-ad7b836d-0624-4d40-924f-e6ae5855659f" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-ad7b836d-0624-4d40-924f-e6ae5855659f" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Deleting offline snapshot f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d of volume ad7b836d-0624-4d40-924f-e6ae5855659f {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 00:56:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] snapshot_file for this snap is: volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 00:56:25 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfd88e5-f771-4cd3-b48f-719630d95f74]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:26 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d
Nov 04 00:56:26 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:26 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d" returned: 0 in 0.805s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad7b836d-0624-4d40-924f-e6ae5855659f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 00:56:26 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4637a575-0d38-4b48-9ee2-ffc07cce466a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:26 devstack sudo[89788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f
Nov 04 00:56:26 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:27 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f" returned: 0 in 0.515s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:27 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d
Nov 04 00:56:27 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:27 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d" returned: 0 in 0.454s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:27 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d
Nov 04 00:56:27 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:28 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f.f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d" returned: 0 in 0.394s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-f7b01c71-9e73-4a1e-9335-2a37e9d7ba2d" released by "_delete_snapshot" :: held 2.394s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-ad7b836d-0624-4d40-924f-e6ae5855659f" released by "delete_snapshot" :: held 2.452s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:28 devstack cinder-volume[86660]: WARNING cinder.quota [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1851070167 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1851070167, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:56:28 devstack cinder-volume[86660]: WARNING cinder.quota [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1851070167 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1851070167, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:56:28 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] Created reservations ['6bbe53bd-86da-4c8e-a012-958ff8c8f64f', 'b769f2be-a1f7-4444-8768-ab9ddd0dd151', 'fd037503-52bd-468a-86f0-16d77098ad25', '1129c455-36ac-467c-b501-723bb4dd8c31'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fbf2410d-a942-4f22-abed-4bb075e6cd11 tempest-GroupSnapshotsTest-405250553 None] group_snapshot befe5643-f7a8-4f04-817f-5ac1220ede1d: deleted successfully
Nov 04 00:56:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "cinder-quobyte-ad7b836d-0624-4d40-924f-e6ae5855659f" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-ad7b836d-0624-4d40-924f-e6ae5855659f" acquired by "delete_volume" :: waited 0.062s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:30 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bf8347-4ad2-46d6-9716-e5488a270920]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:30 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f
Nov 04 00:56:30 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:31 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f" returned: 0 in 0.753s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:31 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f
Nov 04 00:56:31 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:31 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ad7b836d-0624-4d40-924f-e6ae5855659f" returned: 0 in 0.415s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Lock "cinder-quobyte-ad7b836d-0624-4d40-924f-e6ae5855659f" released by "delete_volume" :: held 1.433s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:32 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Created reservations ['4ebbd464-f868-4e9a-ab78-a54598712797'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:32 devstack cinder-volume[86660]: WARNING cinder.quota [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1851070167 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1851070167, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:56:32 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Created reservations ['9fafa1fd-3b18-47e4-9d94-cb3b8bd4418a', '70015aea-ce55-44b0-bdd0-7d53fcc8ba40', '281cf9ec-df34-4172-8083-d0e338e427e3', 'fd662af1-f643-4d16-93f6-2aa81f8abc63'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:32 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:56:32 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:33 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.823s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:33 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:56:33 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-473bbad1-2cc0-4226-a288-bacbacdaff07 tempest-GroupSnapshotsTest-405250553 None] Delete group completed successfully.
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Flow 'volume_create_manager' (d15ff023-76f9-4dd3-9255-6921f924f452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a1aa00-f9da-4566-a601-64a43ac015b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a1aa00-f9da-4566-a601-64a43ac015b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1570116171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89621a2b-8cd2-483f-8774-410b0e9c4e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67ab0a74e334b75ae14855c4e7f0313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:56:36Z,use_quota=True,user_id='6ba71c98998749e186a2b124db9f7c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818ca4ba-26da-416c-9a74-a2aa0e66e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818ca4ba-26da-416c-9a74-a2aa0e66e263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8263f4-0011-4e07-8ee9-d7613be0c219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8263f4-0011-4e07-8ee9-d7613be0c219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89621a2b-8cd2-483f-8774-410b0e9c4e2a', 'volume_name': 'volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ded48d-9e12-472d-8889-389bd08c18c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ded48d-9e12-472d-8889-389bd08c18c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737a70af-2b78-488f-9e0d-62e217200fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:36 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Volume 89621a2b-8cd2-483f-8774-410b0e9c4e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a', 'volume_size': 1}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1570116171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89621a2b-8cd2-483f-8774-410b0e9c4e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b67ab0a74e334b75ae14855c4e7f0313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:56:36Z,use_quota=True,user_id='6ba71c98998749e186a2b124db9f7c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Creating volume 89621a2b-8cd2-483f-8774-410b0e9c4e2a {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:56:36 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:56:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:36 devstack sudo[89955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a 1073741824
Nov 04 00:56:36 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:37 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a 1073741824" returned: 0 in 0.896s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:37 devstack sudo[89963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a
Nov 04 00:56:37 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:37 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a" returned: 0 in 0.493s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:56:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737a70af-2b78-488f-9e0d-62e217200fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b086c24f-2795-4fc3-a84c-157c7c5da716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:37 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Volume volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a (89621a2b-8cd2-483f-8774-410b0e9c4e2a): created successfully
Nov 04 00:56:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b086c24f-2795-4fc3-a84c-157c7c5da716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Flow 'volume_create_manager' (d15ff023-76f9-4dd3-9255-6921f924f452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:56:37 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cba2380a-7501-45f7-9b3a-d6a86b1ebb40 tempest-VolumesAdminNegativeTest-610947154 None] Created volume successfully.
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Flow 'volume_create_manager' (dcc9f255-f375-464f-85da-85ffcbfa2435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc99503-6cda-4923-bcb0-882d6e8671f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc99503-6cda-4923-bcb0-882d6e8671f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1316487138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c72cce1-b0e8-4ae5-a7e5-64611f78657b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd2ff47417b465bb27bddb7278fe1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:56:38Z,use_quota=True,user_id='4948640f1c5c4ebdbb5e2883c13a1c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653fe24b-96c6-47b2-b367-9a1eba00cb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653fe24b-96c6-47b2-b367-9a1eba00cb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c7599c-6452-4d07-bab4-592979736f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c7599c-6452-4d07-bab4-592979736f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c72cce1-b0e8-4ae5-a7e5-64611f78657b', 'volume_name': 'volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339e5336-fd96-4a10-beb4-bd572cd32ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339e5336-fd96-4a10-beb4-bd572cd32ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7cc430-3aac-45b8-b94d-c575e6e1f69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:38 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Volume 0c72cce1-b0e8-4ae5-a7e5-64611f78657b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b', 'volume_size': 1}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1316487138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c72cce1-b0e8-4ae5-a7e5-64611f78657b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd2ff47417b465bb27bddb7278fe1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:56:38Z,use_quota=True,user_id='4948640f1c5c4ebdbb5e2883c13a1c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Creating volume 0c72cce1-b0e8-4ae5-a7e5-64611f78657b {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:56:38 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:56:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:38 devstack sudo[89966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b 1073741824
Nov 04 00:56:38 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:39 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b 1073741824" returned: 0 in 0.802s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:39 devstack sudo[89972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b
Nov 04 00:56:39 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:39 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b" returned: 0 in 0.409s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7cc430-3aac-45b8-b94d-c575e6e1f69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ab202c-f60c-42b4-a4a8-17a4f76671e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:39 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Volume volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b (0c72cce1-b0e8-4ae5-a7e5-64611f78657b): created successfully
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ab202c-f60c-42b4-a4a8-17a4f76671e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Flow 'volume_create_manager' (dcc9f255-f375-464f-85da-85ffcbfa2435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:56:39 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-6fb33d06-c096-40f3-beda-978e6d8a6167 tempest-ServersNegativeTestJSON-1249454793 None] Created volume successfully.
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Acquiring lock "cinder-89621a2b-8cd2-483f-8774-410b0e9c4e2a-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Lock "cinder-89621a2b-8cd2-483f-8774-410b0e9c4e2a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Acquiring lock "cinder-quobyte-89621a2b-8cd2-483f-8774-410b0e9c4e2a" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Lock "cinder-quobyte-89621a2b-8cd2-483f-8774-410b0e9c4e2a" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[958c2353-340b-4ca1-b7b6-5355e008ee09]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:40 devstack sudo[89976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a
Nov 04 00:56:40 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:40 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a" returned: 0 in 0.767s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:40 devstack sudo[89981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a
Nov 04 00:56:40 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:41 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89621a2b-8cd2-483f-8774-410b0e9c4e2a" returned: 0 in 0.462s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Lock "cinder-quobyte-89621a2b-8cd2-483f-8774-410b0e9c4e2a" released by "delete_volume" :: held 1.349s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Created reservations ['b26e7bbe-c9a6-4c93-a737-df3663b7b3ad', '1404267f-a8d0-4502-9026-7377cbd150cb', 'da75d80a-f6a1-4e3c-9a99-e4b3cb599b12', 'bfc4e9c0-7dea-44a6-b63e-c827244c5e29'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Acquiring lock "cinder-9b9c51a2-e2ee-4851-832e-50aed7c11803-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Lock "cinder-9b9c51a2-e2ee-4851-832e-50aed7c11803-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:41 devstack sudo[89985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:56:41 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Acquiring lock "cinder-quobyte-9b9c51a2-e2ee-4851-832e-50aed7c11803" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Lock "cinder-quobyte-9b9c51a2-e2ee-4851-832e-50aed7c11803" acquired by "delete_volume" :: waited 0.042s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e1563e-7f7d-4469-a1e0-1c5a04d8aa35]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:42 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803
Nov 04 00:56:42 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:42 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.517s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:56:42 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Deleted volume successfully.
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd610ddc-313b-4df4-bda5-9930f628cf75 tempest-VolumesAdminNegativeTest-610947154 None] Lock "cinder-89621a2b-8cd2-483f-8774-410b0e9c4e2a-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:42 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803" returned: 0 in 0.808s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:42 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803
Nov 04 00:56:42 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Flow 'volume_create_manager' (de238f28-2b1e-45aa-9284-d2ec7bd9c9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687f6b31-01bd-44bb-a907-0d6485213a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687f6b31-01bd-44bb-a907-0d6485213a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-13912143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee629c1b-8055-49a8-8927-06e817dce9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd2ff47417b465bb27bddb7278fe1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:56:43Z,use_quota=True,user_id='4948640f1c5c4ebdbb5e2883c13a1c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04d2397-96cc-4a94-bd9d-f0c062fbebcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04d2397-96cc-4a94-bd9d-f0c062fbebcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cfe891-1736-4100-bab5-8570f7ca3b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cfe891-1736-4100-bab5-8570f7ca3b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee629c1b-8055-49a8-8927-06e817dce9d8', 'volume_name': 'volume-ee629c1b-8055-49a8-8927-06e817dce9d8', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ce013a-a9cd-4d85-af9d-a1ea142bd0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ce013a-a9cd-4d85-af9d-a1ea142bd0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60db795b-11af-480b-bf26-014950ca581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:43 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Volume ee629c1b-8055-49a8-8927-06e817dce9d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee629c1b-8055-49a8-8927-06e817dce9d8', 'volume_size': 1}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-13912143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee629c1b-8055-49a8-8927-06e817dce9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd2ff47417b465bb27bddb7278fe1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:56:43Z,use_quota=True,user_id='4948640f1c5c4ebdbb5e2883c13a1c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Creating volume ee629c1b-8055-49a8-8927-06e817dce9d8 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:56:43 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:43 devstack sudo[90008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8 1073741824
Nov 04 00:56:43 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:43 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b9c51a2-e2ee-4851-832e-50aed7c11803" returned: 0 in 0.560s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Lock "cinder-quobyte-9b9c51a2-e2ee-4851-832e-50aed7c11803" released by "delete_volume" :: held 1.466s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Created reservations ['44dc584a-e210-45cf-9768-9c22bfea1610', '425e870e-342a-4f6e-8f58-f9143213b94e', 'd48d5832-f3f0-4527-9a05-e6d4e5b647df', 'fe8a6c5c-7c88-4d88-a927-ed26ef7855f3'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:43 devstack sudo[90024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:56:43 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:43 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.360s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:56:43 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8 1073741824" returned: 0 in 0.865s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:43 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Deleted volume successfully.
Nov 04 00:56:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cb6b7ce5-c45d-4758-a5c8-a65cb2f956d0 tempest-TaggedAttachmentsTest-2065937831 None] Lock "cinder-9b9c51a2-e2ee-4851-832e-50aed7c11803-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:44 devstack sudo[90028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8
Nov 04 00:56:44 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:44 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8" returned: 0 in 0.404s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:56:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60db795b-11af-480b-bf26-014950ca581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee629c1b-8055-49a8-8927-06e817dce9d8', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd15356-a886-4d1f-ac2c-81c5e725e9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:44 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Volume volume-ee629c1b-8055-49a8-8927-06e817dce9d8 (ee629c1b-8055-49a8-8927-06e817dce9d8): created successfully
Nov 04 00:56:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd15356-a886-4d1f-ac2c-81c5e725e9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Flow 'volume_create_manager' (de238f28-2b1e-45aa-9284-d2ec7bd9c9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:56:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a43e9426-96f4-411f-a0ef-098254419a92 tempest-ServersNegativeTestJSON-1249454793 None] Created volume successfully.
Nov 04 00:56:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ddded0f8-dbec-46a0-b5d0-6cb7b0259dee tempest-GroupSnapshotsV319Test-1577815176 None] Group tempest-GroupSnapshotsV319Test-Group-951846780: creating
Nov 04 00:56:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ddded0f8-dbec-46a0-b5d0-6cb7b0259dee tempest-GroupSnapshotsV319Test-1577815176 None] Group tempest-GroupSnapshotsV319Test-Group-951846780: created successfully
Nov 04 00:56:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ddded0f8-dbec-46a0-b5d0-6cb7b0259dee tempest-GroupSnapshotsV319Test-1577815176 None] Create group completed successfully.
Nov 04 00:56:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Acquiring lock "cinder-ee629c1b-8055-49a8-8927-06e817dce9d8-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Lock "cinder-ee629c1b-8055-49a8-8927-06e817dce9d8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Acquiring lock "cinder-quobyte-ee629c1b-8055-49a8-8927-06e817dce9d8" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Lock "cinder-quobyte-ee629c1b-8055-49a8-8927-06e817dce9d8" acquired by "delete_volume" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:45 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9e7815-f1ab-4415-a8c4-839da50a156b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:45 devstack sudo[90036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8
Nov 04 00:56:45 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:46 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8" returned: 0 in 0.405s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:46 devstack sudo[90042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8
Nov 04 00:56:46 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:46 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee629c1b-8055-49a8-8927-06e817dce9d8" returned: 0 in 0.368s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Lock "cinder-quobyte-ee629c1b-8055-49a8-8927-06e817dce9d8" released by "delete_volume" :: held 0.839s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Created reservations ['86ce7059-0292-40e6-af5d-4d9433ece23f', '581ee9b6-e585-4ab4-91f3-6ef9e7d898df', '94a2fba0-6806-4416-9101-41ccea732597', '9d68ed74-22db-4a53-8b77-ca1a8e858d83'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:46 devstack sudo[90045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:56:46 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Acquiring lock "cinder-0c72cce1-b0e8-4ae5-a7e5-64611f78657b-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Lock "cinder-0c72cce1-b0e8-4ae5-a7e5-64611f78657b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Acquiring lock "cinder-quobyte-0c72cce1-b0e8-4ae5-a7e5-64611f78657b" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Lock "cinder-quobyte-0c72cce1-b0e8-4ae5-a7e5-64611f78657b" acquired by "delete_volume" :: waited 0.041s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a159fc-635d-4073-a358-daa9190353bb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Flow 'volume_create_manager' (9896d97c-1023-4e28-ad19-b1dc67b60bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3b7a4d-a467-43f9-b39a-1f0239e93420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3b7a4d-a467-43f9-b39a-1f0239e93420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1169090483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4f688894-9176-4e59-8c7f-3ae89cf93e3c,host='devstack@QuobyteHD#QuobyteHD',id=7f922061-fc85-4f02-a345-35bd7fa34a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235a84b5a31b4590ac4f4fadffd48d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:56:47Z,use_quota=True,user_id='33eda2c722f7487686a7ac362f8a1606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6c3149e-8b17-4445-9e47-20f62c1ce2c2),volume_type_id=e6c3149e-8b17-4445-9e47-20f62c1ce2c2)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:47 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b4a103-3f8c-41db-85d1-b136f6f6352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b4a103-3f8c-41db-85d1-b136f6f6352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b87939f-bf7f-4ad7-b23b-a71a771d007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b87939f-bf7f-4ad7-b23b-a71a771d007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f922061-fc85-4f02-a345-35bd7fa34a44', 'volume_name': 'volume-7f922061-fc85-4f02-a345-35bd7fa34a44', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed8fbb0-08cb-48be-a49f-667c5ec25546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed8fbb0-08cb-48be-a49f-667c5ec25546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24b71fa-f2e7-4265-84d0-ee62027a4b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:47 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Volume 7f922061-fc85-4f02-a345-35bd7fa34a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f922061-fc85-4f02-a345-35bd7fa34a44', 'volume_size': 1}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4f688894-9176-4e59-8c7f-3ae89cf93e3c,created_at=2026-11-03T23:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1169090483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4f688894-9176-4e59-8c7f-3ae89cf93e3c,host='devstack@QuobyteHD#QuobyteHD',id=7f922061-fc85-4f02-a345-35bd7fa34a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235a84b5a31b4590ac4f4fadffd48d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:56:47Z,use_quota=True,user_id='33eda2c722f7487686a7ac362f8a1606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6c3149e-8b17-4445-9e47-20f62c1ce2c2),volume_type_id=e6c3149e-8b17-4445-9e47-20f62c1ce2c2)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Creating volume 7f922061-fc85-4f02-a345-35bd7fa34a44 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:56:47 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:47 devstack sudo[90047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b
Nov 04 00:56:47 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.502s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:56:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Deleted volume successfully.
Nov 04 00:56:47 devstack sudo[90049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44 1073741824
Nov 04 00:56:47 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-af16394c-91b4-492c-9cbf-92e4745cba83 tempest-ServersNegativeTestJSON-1249454793 None] Lock "cinder-ee629c1b-8055-49a8-8927-06e817dce9d8-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:47 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b" returned: 0 in 0.506s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:47 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b
Nov 04 00:56:47 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:47 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c72cce1-b0e8-4ae5-a7e5-64611f78657b" returned: 0 in 0.308s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:47 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44 1073741824" returned: 0 in 0.655s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Lock "cinder-quobyte-0c72cce1-b0e8-4ae5-a7e5-64611f78657b" released by "delete_volume" :: held 0.896s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:48 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44
Nov 04 00:56:48 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Created reservations ['dfa1e450-3b42-4b74-841e-0f33edb22dbf', '85930514-4a0f-4992-85fb-f4c6b6734250', '339c7baf-35e0-4e18-bdc4-c7da60fb0144', 'a7fe99c4-bb0b-455c-ae9c-b88f60b9cd94'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:48 devstack sudo[90065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:56:48 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:48 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44" returned: 0 in 0.298s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24b71fa-f2e7-4265-84d0-ee62027a4b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f922061-fc85-4f02-a345-35bd7fa34a44', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba7c642-98f2-4e5b-876d-08de1621ee2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:56:48 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Volume volume-7f922061-fc85-4f02-a345-35bd7fa34a44 (7f922061-fc85-4f02-a345-35bd7fa34a44): created successfully
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba7c642-98f2-4e5b-876d-08de1621ee2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Flow 'volume_create_manager' (9896d97c-1023-4e28-ad19-b1dc67b60bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:56:48 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7aa442af-ced8-4a14-875f-01cf44d07a9b tempest-GroupSnapshotsV319Test-1577815176 None] Created volume successfully.
Nov 04 00:56:48 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.311s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:56:48 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Deleted volume successfully.
Nov 04 00:56:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b9cbadf9-b797-47b1-90c5-8ce738fe3cd8 tempest-ServersNegativeTestJSON-1249454793 None] Lock "cinder-0c72cce1-b0e8-4ae5-a7e5-64611f78657b-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:50 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] GroupSnapshot bb3fa011-ce4d-4504-ada6-157b9476d94b: creating.
Nov 04 00:56:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] Group snapshot bb3fa011-ce4d-4504-ada6-157b9476d94b: creating. {{(pid=86660) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 04 00:56:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] Creating offline snapshot 57d0e99e-c6db-4d24-9b1f-bc2af03e26fd of volume 7f922061-fc85-4f02-a345-35bd7fa34a44 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 00:56:50 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa4351e-55dd-407a-817e-c3aa90796837]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:50 devstack sudo[90092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44
Nov 04 00:56:50 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:50 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44" returned: 0 in 0.396s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:50 devstack sudo[90099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd 1G
Nov 04 00:56:50 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:51 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd 1G" returned: 0 in 0.540s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f922061-fc85-4f02-a345-35bd7fa34a44 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:51 devstack sudo[90105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f922061-fc85-4f02-a345-35bd7fa34a44 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd
Nov 04 00:56:51 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:51 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f922061-fc85-4f02-a345-35bd7fa34a44 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd" returned: 0 in 0.317s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:51 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:51 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd
Nov 04 00:56:51 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:51 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:56:51 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:51 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd" returned: 0 in 0.314s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:51 devstack sudo[90118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.info
Nov 04 00:56:51 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:52 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.420s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:56:52 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:56:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 8 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 00:56:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 00:56:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.info" returned: 0 in 0.348s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:52 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 00:56:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:52 devstack sudo[90122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.info
Nov 04 00:56:52 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:52 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.info" returned: 0 in 0.406s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:52 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-447208de-f370-4bb4-862b-c1fbb93ee9f3 tempest-GroupSnapshotsV319Test-1577815176 None] group_snapshot bb3fa011-ce4d-4504-ada6-157b9476d94b: created successfully
Nov 04 00:56:53 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] group_snapshot bb3fa011-ce4d-4504-ada6-157b9476d94b: deleting
Nov 04 00:56:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] group_snapshot bb3fa011-ce4d-4504-ada6-157b9476d94b: deleting {{(pid=86660) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 04 00:56:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Acquiring lock "cinder-quobyte-7f922061-fc85-4f02-a345-35bd7fa34a44" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Lock "cinder-quobyte-7f922061-fc85-4f02-a345-35bd7fa34a44" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Acquiring lock "cinder-quobyte-57d0e99e-c6db-4d24-9b1f-bc2af03e26fd" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Lock "cinder-quobyte-57d0e99e-c6db-4d24-9b1f-bc2af03e26fd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Deleting offline snapshot 57d0e99e-c6db-4d24-9b1f-bc2af03e26fd of volume 7f922061-fc85-4f02-a345-35bd7fa34a44 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 00:56:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] snapshot_file for this snap is: volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 00:56:53 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05e82fb-96ad-4195-8855-1df9454f8892]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:53 devstack sudo[90127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd
Nov 04 00:56:53 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:54 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd" returned: 0 in 0.422s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f922061-fc85-4f02-a345-35bd7fa34a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 00:56:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[796eff6e-ec9c-4f0e-9f1e-7ebb4e512362]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:54 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44
Nov 04 00:56:54 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:54 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44" returned: 0 in 0.384s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:54 devstack sudo[90139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd
Nov 04 00:56:54 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:55 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd" returned: 0 in 0.460s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:55 devstack sudo[90144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd
Nov 04 00:56:55 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:55 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44.57d0e99e-c6db-4d24-9b1f-bc2af03e26fd" returned: 0 in 0.272s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Lock "cinder-quobyte-57d0e99e-c6db-4d24-9b1f-bc2af03e26fd" released by "_delete_snapshot" :: held 1.654s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Lock "cinder-quobyte-7f922061-fc85-4f02-a345-35bd7fa34a44" released by "delete_snapshot" :: held 1.679s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:55 devstack cinder-volume[86660]: WARNING cinder.quota [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-816859083 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-816859083, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:56:55 devstack cinder-volume[86660]: WARNING cinder.quota [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-816859083 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-816859083, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:56:55 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] Created reservations ['b672f482-a389-44c8-86e0-ae50a34f93b0', '561c973c-fa04-4f1a-bc54-b34a2124cd81', '62bd13be-edd5-4401-895c-8f6496d59599', 'c50f48a5-a9f6-4e09-b19f-faa8af8c03ff'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c5bb5897-00ee-4d58-a56f-f01666acc1c0 tempest-GroupSnapshotsV319Test-1577815176 None] group_snapshot bb3fa011-ce4d-4504-ada6-157b9476d94b: deleted successfully
Nov 04 00:56:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Acquiring lock "cinder-quobyte-7f922061-fc85-4f02-a345-35bd7fa34a44" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:56:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Lock "cinder-quobyte-7f922061-fc85-4f02-a345-35bd7fa34a44" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:56:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbd2e0b-88bc-4c08-9101-4c8369832a17]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:56:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:56 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44
Nov 04 00:56:56 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:56 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44" returned: 0 in 0.419s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:56 devstack sudo[90153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44
Nov 04 00:56:56 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:57 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7f922061-fc85-4f02-a345-35bd7fa34a44" returned: 0 in 0.315s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Lock "cinder-quobyte-7f922061-fc85-4f02-a345-35bd7fa34a44" released by "delete_volume" :: held 0.821s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Created reservations ['2e45b2cd-29b0-45f1-9fbb-3be30a5b8a7d'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:57 devstack cinder-volume[86660]: WARNING cinder.quota [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-816859083 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-816859083, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Created reservations ['a7a00577-1db5-4f08-9e86-395acb123116', 'ae024e66-1200-4a38-a94f-9f23e875cc4b', 'fc307ceb-f503-4738-8bb9-8acc59351412', 'b0754cb6-e619-483c-8b40-1366f096c36c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:56:57 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:56:57 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:56:57 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.454s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:56:57 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:56:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-b6a2f164-e970-4d56-b9df-6131afc81a87 tempest-GroupSnapshotsV319Test-1577815176 None] Delete group completed successfully.
Nov 04 00:57:07 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=108,cinder:INSERT=31,cinder:UPDATE=118,cinder:DELETE=6 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:57:07 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=116,cinder:UPDATE=127,cinder:INSERT=28,cinder:DELETE=3 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:57:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:57:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:57:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:57:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:57:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:57:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:57:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:57:51 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:57:51 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:57:52 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.377s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Flow 'volume_create_manager' (4e1a20f7-3851-4a5e-b273-36b02d141de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe773d9-1f81-45c4-b0e4-8cf9a9f28f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe773d9-1f81-45c4-b0e4-8cf9a9f28f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2027432267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a33a8f-34aa-4a75-9c88-88221f0f0737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd2427637f9413daac336a37c193ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:57:52Z,use_quota=True,user_id='3b2c38bc6cc14690b74d8d8a653b4d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde983e5-0de1-4f4e-8920-f0754c724349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde983e5-0de1-4f4e-8920-f0754c724349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb62430-2ed5-49c6-83d7-54e2a41140b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb62430-2ed5-49c6-83d7-54e2a41140b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a33a8f-34aa-4a75-9c88-88221f0f0737', 'volume_name': 'volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45382ae0-87b0-450e-8fb0-fc2378ba0d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45382ae0-87b0-450e-8fb0-fc2378ba0d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5222b5b1-d2cb-48ee-adb5-d72dc9b1753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:52 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Volume a2a33a8f-34aa-4a75-9c88-88221f0f0737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737', 'volume_size': 1}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2027432267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a33a8f-34aa-4a75-9c88-88221f0f0737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd2427637f9413daac336a37c193ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:57:52Z,use_quota=True,user_id='3b2c38bc6cc14690b74d8d8a653b4d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Creating volume a2a33a8f-34aa-4a75-9c88-88221f0f0737 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:57:52 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:57:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:57:52 devstack sudo[90537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737 1073741824
Nov 04 00:57:52 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:57:53 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root
Nov 04 00:57:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737 1073741824" returned: 0 in 0.876s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:57:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:57:53 devstack sudo[90545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737
Nov 04 00:57:53 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:57:53 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root
Nov 04 00:57:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737" returned: 0 in 0.360s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:57:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:57:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:57:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5222b5b1-d2cb-48ee-adb5-d72dc9b1753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a7eaa1-3b2c-4677-9503-d1bd1e99ff38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:53 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Volume volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737 (a2a33a8f-34aa-4a75-9c88-88221f0f0737): created successfully
Nov 04 00:57:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a7eaa1-3b2c-4677-9503-d1bd1e99ff38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Flow 'volume_create_manager' (4e1a20f7-3851-4a5e-b273-36b02d141de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:57:53 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3571d010-7836-478d-ab95-b9379ba6e796 tempest-VolumeQuotasAdminTestJSON-214292524 None] Created volume successfully.
Nov 04 00:57:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Acquiring lock "cinder-a2a33a8f-34aa-4a75-9c88-88221f0f0737-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:57:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "cinder-a2a33a8f-34aa-4a75-9c88-88221f0f0737-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:57:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Acquiring lock "cinder-quobyte-a2a33a8f-34aa-4a75-9c88-88221f0f0737" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:57:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "cinder-quobyte-a2a33a8f-34aa-4a75-9c88-88221f0f0737" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:57:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae5c734-993d-47c2-8533-9e5f092c812e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:57:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:57:54 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737
Nov 04 00:57:54 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:57:54 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Nov 04 00:57:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737" returned: 0 in 0.359s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:57:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:57:54 devstack sudo[90581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737
Nov 04 00:57:54 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:57:55 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2a33a8f-34aa-4a75-9c88-88221f0f0737" returned: 0 in 0.261s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "cinder-quobyte-a2a33a8f-34aa-4a75-9c88-88221f0f0737" released by "delete_volume" :: held 0.661s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Created reservations ['7cba0461-ae91-49c0-b454-10bdf88b9997', 'b587a3c7-a5c3-4368-9f31-dde2e7685cf3', '9e93c0cb-e780-450d-a7ae-517bc0d888fe', 'bd74213c-6ba1-409f-a12f-599e2a490e78'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:57:55 devstack sudo[90584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:57:55 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:57:55 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.268s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:57:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Deleted volume successfully.
Nov 04 00:57:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c47fa714-46d6-4bb4-93cc-1f4a1c3af52c tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "cinder-a2a33a8f-34aa-4a75-9c88-88221f0f0737-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Flow 'volume_create_manager' (5ec73816-cb43-455a-8604-bf4d53b6cf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696d7120-7bdf-4001-996f-42cd48a69c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696d7120-7bdf-4001-996f-42cd48a69c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2118704799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d588ffd0-6357-4fa6-b4dc-114773d54542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd2427637f9413daac336a37c193ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:57:56Z,use_quota=True,user_id='3b2c38bc6cc14690b74d8d8a653b4d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afa6852-9644-4297-a0bd-1f1ae887da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afa6852-9644-4297-a0bd-1f1ae887da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0522c8-a3f9-4b92-a3fa-7a433365c6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0522c8-a3f9-4b92-a3fa-7a433365c6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd588ffd0-6357-4fa6-b4dc-114773d54542', 'volume_name': 'volume-d588ffd0-6357-4fa6-b4dc-114773d54542', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807f299-70af-490c-98ee-5b91b99bc305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807f299-70af-490c-98ee-5b91b99bc305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb378ae7-d918-4866-b51d-858c566d1336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:56 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Volume d588ffd0-6357-4fa6-b4dc-114773d54542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d588ffd0-6357-4fa6-b4dc-114773d54542', 'volume_size': 1}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2118704799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d588ffd0-6357-4fa6-b4dc-114773d54542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd2427637f9413daac336a37c193ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:57:56Z,use_quota=True,user_id='3b2c38bc6cc14690b74d8d8a653b4d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Creating volume d588ffd0-6357-4fa6-b4dc-114773d54542 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:57:56 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:57:56 devstack sudo[90587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542 1073741824
Nov 04 00:57:56 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:57:56 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542 1073741824" returned: 0 in 0.494s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:57:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:57:56 devstack sudo[90595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542
Nov 04 00:57:56 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:57:56 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542" returned: 0 in 0.276s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb378ae7-d918-4866-b51d-858c566d1336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d588ffd0-6357-4fa6-b4dc-114773d54542', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3974d61e-59cf-4398-aaed-1bc9295306cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:57 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Volume volume-d588ffd0-6357-4fa6-b4dc-114773d54542 (d588ffd0-6357-4fa6-b4dc-114773d54542): created successfully
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3974d61e-59cf-4398-aaed-1bc9295306cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Flow 'volume_create_manager' (5ec73816-cb43-455a-8604-bf4d53b6cf3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:57:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-91dee76b-4e68-42bf-855e-9c5b2ab36fce tempest-VolumeQuotasAdminTestJSON-214292524 None] Created volume successfully.
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Flow 'volume_create_manager' (0ca99a75-b8a2-45c5-94db-241c2c76aba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e35e5d-2421-4327-829f-9a68743ea541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e35e5d-2421-4327-829f-9a68743ea541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1716635631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78a78c8-ce3e-4528-aed0-187ac55c7e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9354472cc82c477690df9a33b5229c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:57:57Z,use_quota=True,user_id='b8806ffb7c8c4b1bb5c9c6cc8b8982a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb04763-cf25-4935-9124-5ce5c8866085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb04763-cf25-4935-9124-5ce5c8866085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca91e6b-3d24-4dd7-a9e8-6e2d846b9c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca91e6b-3d24-4dd7-a9e8-6e2d846b9c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b78a78c8-ce3e-4528-aed0-187ac55c7e25', 'volume_name': 'volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffaf6316-2354-4200-8ec3-a03451c44a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffaf6316-2354-4200-8ec3-a03451c44a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaf1569-8b4a-420e-a0ee-0e49b89a5b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:57 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Volume b78a78c8-ce3e-4528-aed0-187ac55c7e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25', 'volume_size': 1}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1716635631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78a78c8-ce3e-4528-aed0-187ac55c7e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9354472cc82c477690df9a33b5229c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:57:57Z,use_quota=True,user_id='b8806ffb7c8c4b1bb5c9c6cc8b8982a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Creating volume b78a78c8-ce3e-4528-aed0-187ac55c7e25 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:57:57 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:57:57 devstack sudo[90598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25 1073741824
Nov 04 00:57:57 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:57:57 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25 1073741824" returned: 0 in 0.388s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:57:57 devstack sudo[90603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25
Nov 04 00:57:57 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:57:57 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25" returned: 0 in 0.226s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] <== create_volume: return (654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.657s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaf1569-8b4a-420e-a0ee-0e49b89a5b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebab1c3f-d7e8-4788-a7b4-049f9dd15929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:57:57 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Volume volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25 (b78a78c8-ce3e-4528-aed0-187ac55c7e25): created successfully
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebab1c3f-d7e8-4788-a7b4-049f9dd15929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:57:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Flow 'volume_create_manager' (0ca99a75-b8a2-45c5-94db-241c2c76aba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:57:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c9b6f156-9340-4ae2-b13c-4b15de4c4554 tempest-AttachVolumeShelveTestJSON-1184414305 None] Created volume successfully.
Nov 04 00:57:58 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-728ff471-20ad-4962-8753-8b4fc89e6d9f tempest-VolumeQuotasAdminTestJSON-992055422 None] Transfer volume completed successfully.
Nov 04 00:57:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Acquiring lock "cinder-d588ffd0-6357-4fa6-b4dc-114773d54542-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:57:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Lock "cinder-d588ffd0-6357-4fa6-b4dc-114773d54542-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:57:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Acquiring lock "cinder-quobyte-d588ffd0-6357-4fa6-b4dc-114773d54542" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:57:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Lock "cinder-quobyte-d588ffd0-6357-4fa6-b4dc-114773d54542" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:57:59 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c425be9-ddab-42d1-b824-25e055b189ad]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:57:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:57:59 devstack sudo[90612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542
Nov 04 00:57:59 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:00 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542" returned: 0 in 0.477s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:00 devstack sudo[90624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542
Nov 04 00:58:00 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:00 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d588ffd0-6357-4fa6-b4dc-114773d54542" returned: 0 in 0.260s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Lock "cinder-quobyte-d588ffd0-6357-4fa6-b4dc-114773d54542" released by "delete_volume" :: held 0.819s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:58:00 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Created reservations ['7269b25b-d5d2-4b09-a2b8-ec9ee2787bbd', '8b1d59db-746c-4561-a7b0-a5ce42bba791', '141bf613-4dd9-4254-a271-f1a9ac084b0b', '466daf71-faa8-4e70-a152-5981e36f387d'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:58:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:00 devstack sudo[90650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:58:00 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:01 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.511s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:01 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:58:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Deleted volume successfully.
Nov 04 00:58:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-792682d3-56ef-4c63-9bc1-e55da3fc8d1a tempest-VolumeQuotasAdminTestJSON-248362496 None] Lock "cinder-d588ffd0-6357-4fa6-b4dc-114773d54542-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:58:05 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:58:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Flow 'volume_create_manager' (1fa377f1-7649-42f5-957a-e88ac0068c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2379111-8037-464c-9a26-c5a9b4ce1479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2379111-8037-464c-9a26-c5a9b4ce1479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-929367124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d72c8d3-0d74-427e-a58e-5738ac25e789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b887ed0d42ad4f2e9c00fceee7aa7d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:06Z,use_quota=True,user_id='c51931e0be204e8ca34de983e2b86288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895ab151-9c42-48b6-8fb9-eb41ea77a8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895ab151-9c42-48b6-8fb9-eb41ea77a8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108cb690-d1a3-4a5a-a082-a550799dfd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108cb690-d1a3-4a5a-a082-a550799dfd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d72c8d3-0d74-427e-a58e-5738ac25e789', 'volume_name': 'volume-0d72c8d3-0d74-427e-a58e-5738ac25e789', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01b0fe9-9e11-4098-84b2-1490fd45ac1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01b0fe9-9e11-4098-84b2-1490fd45ac1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8fdc06-6050-4954-9298-f01873ef5adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:06 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Volume 0d72c8d3-0d74-427e-a58e-5738ac25e789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d72c8d3-0d74-427e-a58e-5738ac25e789', 'volume_size': 1}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-929367124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d72c8d3-0d74-427e-a58e-5738ac25e789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b887ed0d42ad4f2e9c00fceee7aa7d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:06Z,use_quota=True,user_id='c51931e0be204e8ca34de983e2b86288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Creating volume 0d72c8d3-0d74-427e-a58e-5738ac25e789 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:58:06 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:06 devstack sudo[90703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789 1073741824
Nov 04 00:58:06 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:06 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789 1073741824" returned: 0 in 0.735s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:06 devstack sudo[90727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789
Nov 04 00:58:06 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:07 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789" returned: 0 in 0.291s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:58:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8fdc06-6050-4954-9298-f01873ef5adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d72c8d3-0d74-427e-a58e-5738ac25e789', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41aac612-fc44-4a2b-9ccd-56dc70be021d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:07 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Volume volume-0d72c8d3-0d74-427e-a58e-5738ac25e789 (0d72c8d3-0d74-427e-a58e-5738ac25e789): created successfully
Nov 04 00:58:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41aac612-fc44-4a2b-9ccd-56dc70be021d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Flow 'volume_create_manager' (1fa377f1-7649-42f5-957a-e88ac0068c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:07 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c4b55961-0102-4648-92e3-168589024625 tempest-AttachVolumeTestJSON-488239250 None] Created volume successfully.
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-d2eadf6a-c3b8-4e35-b7d2-6d0f774543b7 req-4e196e04-7bb9-4862-8f46-7ea2b4fdec58 tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-d2eadf6a-c3b8-4e35-b7d2-6d0f774543b7 req-4e196e04-7bb9-4862-8f46-7ea2b4fdec58 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-d2eadf6a-c3b8-4e35-b7d2-6d0f774543b7 req-4e196e04-7bb9-4862-8f46-7ea2b4fdec58 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-d2eadf6a-c3b8-4e35-b7d2-6d0f774543b7 req-4e196e04-7bb9-4862-8f46-7ea2b4fdec58 tempest-AttachVolumeTestJSON-488239250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-0d72c8d3-0d74-427e-a58e-5738ac25e789', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11bc4442-78f7-4615-89ab-5ed49230cdad', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 00:58:09 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-d2eadf6a-c3b8-4e35-b7d2-6d0f774543b7 req-4e196e04-7bb9-4862-8f46-7ea2b4fdec58 tempest-AttachVolumeTestJSON-488239250 None] attachment_update completed successfully.
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-147e94d1-0f59-4f39-8d6b-44fcf735c3ca req-7e55f4e0-af72-4a4d-a5e9-f296c0e62a06 tempest-AttachVolumeShelveTestJSON-1184414305 None] No connector for attachment b0f64073-8040-4574-97ae-3e80520aa62e; skipping storage backend terminate_connection call. {{(pid=86660) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-147e94d1-0f59-4f39-8d6b-44fcf735c3ca req-7e55f4e0-af72-4a4d-a5e9-f296c0e62a06 tempest-AttachVolumeShelveTestJSON-1184414305 None] Deleting attachment b0f64073-8040-4574-97ae-3e80520aa62e. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Flow 'volume_create_manager' (523ff024-d861-4d42-859a-b28acc46e2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9208f54e-7a92-4dce-a02f-01345053abd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9208f54e-7a92-4dce-a02f-01345053abd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-797304070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95de641-d1e6-423b-8dbf-bf476d741b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e64de3d7d2e4bcbbf7980fdc3168bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:10Z,use_quota=True,user_id='e64932866208439fa5ef0ec83727228f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41869e99-2f4f-4113-908d-af277b48e3f9),volume_type_id=41869e99-2f4f-4113-908d-af277b48e3f9)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e41072-6f81-47e2-bbad-165b1dabaefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e41072-6f81-47e2-bbad-165b1dabaefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e747a93e-aff9-43f3-9724-8b1f7956f918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e747a93e-aff9-43f3-9724-8b1f7956f918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b95de641-d1e6-423b-8dbf-bf476d741b3b', 'volume_name': 'volume-b95de641-d1e6-423b-8dbf-bf476d741b3b', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1820c09a-2c6e-4595-8771-a76eeceb01a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1820c09a-2c6e-4595-8771-a76eeceb01a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ab3125-f6aa-4bae-9bac-f2638a0be79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:09 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Volume b95de641-d1e6-423b-8dbf-bf476d741b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b95de641-d1e6-423b-8dbf-bf476d741b3b', 'volume_size': 1}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-797304070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95de641-d1e6-423b-8dbf-bf476d741b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e64de3d7d2e4bcbbf7980fdc3168bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:10Z,use_quota=True,user_id='e64932866208439fa5ef0ec83727228f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41869e99-2f4f-4113-908d-af277b48e3f9),volume_type_id=41869e99-2f4f-4113-908d-af277b48e3f9)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Creating volume b95de641-d1e6-423b-8dbf-bf476d741b3b {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:58:09 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:58:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:09 devstack sudo[91158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b 1073741824
Nov 04 00:58:09 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:10 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b 1073741824" returned: 0 in 0.644s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:10 devstack sudo[91169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b
Nov 04 00:58:10 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:10 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b" returned: 0 in 0.413s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:58:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ab3125-f6aa-4bae-9bac-f2638a0be79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b95de641-d1e6-423b-8dbf-bf476d741b3b', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d8e2da-2827-4d82-8b30-5211b1470e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:10 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Volume volume-b95de641-d1e6-423b-8dbf-bf476d741b3b (b95de641-d1e6-423b-8dbf-bf476d741b3b): created successfully
Nov 04 00:58:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d8e2da-2827-4d82-8b30-5211b1470e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Flow 'volume_create_manager' (523ff024-d861-4d42-859a-b28acc46e2bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8b463d33-36fd-4f8b-b675-50afb5a660e2 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Created volume successfully.
Nov 04 00:58:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f7c21924-4bdd-48a3-b53b-447e9e4eddf7 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f7c21924-4bdd-48a3-b53b-447e9e4eddf7 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f7c21924-4bdd-48a3-b53b-447e9e4eddf7 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f7c21924-4bdd-48a3-b53b-447e9e4eddf7 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f7c21924-4bdd-48a3-b53b-447e9e4eddf7 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f7c21924-4bdd-48a3-b53b-447e9e4eddf7 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:12 devstack sudo[91201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:58:12 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:12 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f7c21924-4bdd-48a3-b53b-447e9e4eddf7 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.302s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:12 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-f7c21924-4bdd-48a3-b53b-447e9e4eddf7 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:58:12 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f7c21924-4bdd-48a3-b53b-447e9e4eddf7 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Retype volume completed successfully.
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Flow 'volume_create_manager' (39edf30d-bb05-47da-915f-ee5fe5c2ae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01764cf-ddac-4334-9af6-0dbde9a5ffe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01764cf-ddac-4334-9af6-0dbde9a5ffe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-259698585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa9ecc1-cdc1-4bc8-a22c-772c69c49346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df921c671dd54ccf9eb0aa4c69c9916e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:13Z,use_quota=True,user_id='3e694ef489704257a1d79bfc90669bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c253cc60-4289-42e4-b9cf-ebc601086fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c253cc60-4289-42e4-b9cf-ebc601086fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4950a6cf-245a-412f-8950-1af3d61ba37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4950a6cf-245a-412f-8950-1af3d61ba37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa9ecc1-cdc1-4bc8-a22c-772c69c49346', 'volume_name': 'volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34dd06d3-8999-4e86-b928-ab7253239b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34dd06d3-8999-4e86-b928-ab7253239b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673de022-30d9-4f65-941a-0839a38f2517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:13 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Volume caa9ecc1-cdc1-4bc8-a22c-772c69c49346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346', 'volume_size': 1}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-259698585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa9ecc1-cdc1-4bc8-a22c-772c69c49346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df921c671dd54ccf9eb0aa4c69c9916e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:13Z,use_quota=True,user_id='3e694ef489704257a1d79bfc90669bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Creating volume caa9ecc1-cdc1-4bc8-a22c-772c69c49346 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:58:13 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:13 devstack sudo[91205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346 1073741824
Nov 04 00:58:13 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Acquiring lock "cinder-b95de641-d1e6-423b-8dbf-bf476d741b3b-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "cinder-b95de641-d1e6-423b-8dbf-bf476d741b3b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Acquiring lock "cinder-quobyte-b95de641-d1e6-423b-8dbf-bf476d741b3b" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:58:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "cinder-quobyte-b95de641-d1e6-423b-8dbf-bf476d741b3b" acquired by "delete_volume" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[2878411a-2350-44b5-85f3-4a22a8b9c735]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:14 devstack sudo[91212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b
Nov 04 00:58:14 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:14 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346 1073741824" returned: 0 in 0.790s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:14 devstack sudo[91215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346
Nov 04 00:58:14 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:14 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b" returned: 0 in 0.531s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:14 devstack sudo[91220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b
Nov 04 00:58:14 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:14 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346" returned: 0 in 0.452s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673de022-30d9-4f65-941a-0839a38f2517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6a5397-479e-4b24-9a28-f1a597179c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:14 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Volume volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346 (caa9ecc1-cdc1-4bc8-a22c-772c69c49346): created successfully
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6a5397-479e-4b24-9a28-f1a597179c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Flow 'volume_create_manager' (39edf30d-bb05-47da-915f-ee5fe5c2ae90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:15 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d3a7dfeb-262b-4cff-bee3-793ff2089d85 tempest-ServerActionsTestOtherA-2120743137 None] Created volume successfully.
Nov 04 00:58:15 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b95de641-d1e6-423b-8dbf-bf476d741b3b" returned: 0 in 0.521s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "cinder-quobyte-b95de641-d1e6-423b-8dbf-bf476d741b3b" released by "delete_volume" :: held 1.161s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:58:15 devstack cinder-volume[86660]: WARNING cinder.quota [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:58:15 devstack cinder-volume[86660]: WARNING cinder.quota [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 04 00:58:15 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Created reservations ['7d52292a-d89b-45f6-8831-651f6bfffc51', 'e5777360-8d8b-4e0d-b473-a446e6d0724d', 'c5fd59c0-348f-461d-afa5-3e92ae56d775', 'd3be695b-efb5-48fe-9fab-9c6b598bc1a0'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:58:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:15 devstack sudo[91287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:58:15 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:15 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.576s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:15 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:58:15 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Deleted volume successfully.
Nov 04 00:58:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c39a199-a551-4dda-b6a7-6e0bec8a5179 tempest-VolumeRetypeWithoutMigrationTest-319051609 None] Lock "cinder-b95de641-d1e6-423b-8dbf-bf476d741b3b-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:58:25 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=54,cinder:SELECT=42,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:58:26 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=43,cinder:UPDATE=43,cinder:DELETE=6,cinder:INSERT=7 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Flow 'volume_create_manager' (918671e1-3f96-40b4-a891-7531f918b79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1fbfed-8a57-428c-980a-265748f9d25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1fbfed-8a57-428c-980a-265748f9d25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1398221477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a593aedd-6608-4aaa-b6d1-5449b3a6e805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc983c72e01c40769617eb93fff4dcb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:29Z,use_quota=True,user_id='0b3fbc6987d041369485d8ca3264b32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356f9f3b-7f13-48f9-b628-54740a1b53b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356f9f3b-7f13-48f9-b628-54740a1b53b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a2bd92-caf8-47d9-9171-e76244cd33d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a2bd92-caf8-47d9-9171-e76244cd33d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a593aedd-6608-4aaa-b6d1-5449b3a6e805', 'volume_name': 'volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfabc666-f90b-42b6-b72f-5ed8184e4f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfabc666-f90b-42b6-b72f-5ed8184e4f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8f5ede-75af-4fbb-a391-d175eb0691e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:29 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Volume a593aedd-6608-4aaa-b6d1-5449b3a6e805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805', 'volume_size': 1}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1398221477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a593aedd-6608-4aaa-b6d1-5449b3a6e805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc983c72e01c40769617eb93fff4dcb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:29Z,use_quota=True,user_id='0b3fbc6987d041369485d8ca3264b32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Creating volume a593aedd-6608-4aaa-b6d1-5449b3a6e805 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:58:29 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:58:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:29 devstack sudo[91941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805 1073741824
Nov 04 00:58:29 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:30 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805 1073741824" returned: 0 in 0.751s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:30 devstack sudo[91949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805
Nov 04 00:58:30 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:31 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805" returned: 0 in 0.484s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:58:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8f5ede-75af-4fbb-a391-d175eb0691e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d50460d-70d7-45d6-8690-d3aa930d2459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:31 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Volume volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805 (a593aedd-6608-4aaa-b6d1-5449b3a6e805): created successfully
Nov 04 00:58:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d50460d-70d7-45d6-8690-d3aa930d2459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Flow 'volume_create_manager' (918671e1-3f96-40b4-a891-7531f918b79c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:31 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-890c75ec-bd3a-4c4b-95ee-0ba2ecf92043 tempest-VolumesServicesTestJSON-2107219474 None] Created volume successfully.
Nov 04 00:58:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Acquiring lock "cinder-a593aedd-6608-4aaa-b6d1-5449b3a6e805-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:58:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Lock "cinder-a593aedd-6608-4aaa-b6d1-5449b3a6e805-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:58:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Acquiring lock "cinder-quobyte-a593aedd-6608-4aaa-b6d1-5449b3a6e805" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:58:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Lock "cinder-quobyte-a593aedd-6608-4aaa-b6d1-5449b3a6e805" acquired by "delete_volume" :: waited 0.040s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:58:32 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[310c3850-b561-4737-8607-0de7ad72bcf0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:58:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:32 devstack sudo[91953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805
Nov 04 00:58:32 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:32 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805" returned: 0 in 0.478s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:32 devstack sudo[91959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805
Nov 04 00:58:32 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:33 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a593aedd-6608-4aaa-b6d1-5449b3a6e805" returned: 0 in 0.347s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Lock "cinder-quobyte-a593aedd-6608-4aaa-b6d1-5449b3a6e805" released by "delete_volume" :: held 0.914s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Created reservations ['ff11beca-2190-4d20-9ed1-4899b4435139', '2e08f653-3288-4a13-90fa-4ee4f2892201', 'bea6a96f-f912-424f-a735-b9683776536c', 'b7666ba0-a4bc-4c98-a7ad-030ec21d59a0'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:33 devstack sudo[91966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:58:33 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:33 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.395s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:58:33 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Deleted volume successfully.
Nov 04 00:58:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1c71f8ba-068a-4b7c-adc4-41f641800d75 tempest-VolumesServicesTestJSON-2107219474 None] Lock "cinder-a593aedd-6608-4aaa-b6d1-5449b3a6e805-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:58:43 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:INSERT=2 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:58:43 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-488d73e4-f053-4c95-bb67-39168b8f55e5 req-1618969d-b36d-4980-97d7-7246ff269d6b tempest-AttachVolumeTestJSON-488239250 None] Terminate volume connection completed successfully.
Nov 04 00:58:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-488d73e4-f053-4c95-bb67-39168b8f55e5 req-1618969d-b36d-4980-97d7-7246ff269d6b tempest-AttachVolumeTestJSON-488239250 None] Deleting attachment 11bc4442-78f7-4615-89ab-5ed49230cdad. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 00:58:43 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Flow 'volume_create_manager' (c66ff165-2f92-4e4b-aafe-aede973da3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645cb1be-01b1-4927-875d-576009f8c3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645cb1be-01b1-4927-875d-576009f8c3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-755638533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d742b4-2d61-45ef-acbf-bf3b05488587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0ab81cf444eb9b7e643a3274fc8d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:49Z,use_quota=True,user_id='5a9e4d3e0b0547ac8d60367e62838cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466e6cc8-3e31-472f-a482-68cecff9c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466e6cc8-3e31-472f-a482-68cecff9c940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb908bb8-34d5-4282-81f4-f66dac6ae8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb908bb8-34d5-4282-81f4-f66dac6ae8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41d742b4-2d61-45ef-acbf-bf3b05488587', 'volume_name': 'volume-41d742b4-2d61-45ef-acbf-bf3b05488587', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68348f19-b498-4f40-adc0-1e1ca8eb9e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68348f19-b498-4f40-adc0-1e1ca8eb9e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261937d9-70e3-4e40-9444-f19422993137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:49 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Volume 41d742b4-2d61-45ef-acbf-bf3b05488587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41d742b4-2d61-45ef-acbf-bf3b05488587', 'volume_size': 1}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-755638533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d742b4-2d61-45ef-acbf-bf3b05488587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0ab81cf444eb9b7e643a3274fc8d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:49Z,use_quota=True,user_id='5a9e4d3e0b0547ac8d60367e62838cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Creating volume 41d742b4-2d61-45ef-acbf-bf3b05488587 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:58:49 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:58:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:49 devstack sudo[92133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587 1073741824
Nov 04 00:58:49 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:50 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587 1073741824" returned: 0 in 0.574s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:50 devstack sudo[92143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587
Nov 04 00:58:50 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:50 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587" returned: 0 in 0.264s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:58:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261937d9-70e3-4e40-9444-f19422993137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d742b4-2d61-45ef-acbf-bf3b05488587', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59111d35-e3b5-4730-901f-1988adeba76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:50 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Volume volume-41d742b4-2d61-45ef-acbf-bf3b05488587 (41d742b4-2d61-45ef-acbf-bf3b05488587): created successfully
Nov 04 00:58:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59111d35-e3b5-4730-901f-1988adeba76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Flow 'volume_create_manager' (c66ff165-2f92-4e4b-aafe-aede973da3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:50 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-bd224b52-5b8e-4545-96da-57dbf1751024 tempest-VolumesListAdminTestJSON-536298456 None] Created volume successfully.
Nov 04 00:58:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:58:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:51 devstack sudo[92151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:58:51 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Flow 'volume_create_manager' (b2be278a-bf7f-4897-80d5-315f5e753ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848a4ffc-0b65-4a2d-9560-3629a8cddc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848a4ffc-0b65-4a2d-9560-3629a8cddc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-520373890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67f0c08-9cda-4a34-bef1-63912d84e2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0ab81cf444eb9b7e643a3274fc8d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:52Z,use_quota=True,user_id='5a9e4d3e0b0547ac8d60367e62838cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60911ef-56de-4e0c-9a26-cc4e2582ca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60911ef-56de-4e0c-9a26-cc4e2582ca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22303bb2-72d3-4aa1-9b3b-26b19ae5eeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22303bb2-72d3-4aa1-9b3b-26b19ae5eeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a67f0c08-9cda-4a34-bef1-63912d84e2e2', 'volume_name': 'volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f297c7-e696-46c1-b2c0-87a7f526a513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f297c7-e696-46c1-b2c0-87a7f526a513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c186fb8-0e70-4752-8cdd-7b8894b64d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:52 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Volume a67f0c08-9cda-4a34-bef1-63912d84e2e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2', 'volume_size': 1}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-520373890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67f0c08-9cda-4a34-bef1-63912d84e2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0ab81cf444eb9b7e643a3274fc8d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:52Z,use_quota=True,user_id='5a9e4d3e0b0547ac8d60367e62838cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Creating volume a67f0c08-9cda-4a34-bef1-63912d84e2e2 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:58:52 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:52 devstack sudo[92172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2 1073741824
Nov 04 00:58:52 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:52 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.985s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 8 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 00:58:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 00:58:53 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2 1073741824" returned: 0 in 0.876s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:53 devstack sudo[92181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2
Nov 04 00:58:53 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:53 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2" returned: 0 in 0.475s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:58:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c186fb8-0e70-4752-8cdd-7b8894b64d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d943c27e-7381-4a59-a827-0cd41f160d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:53 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Volume volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2 (a67f0c08-9cda-4a34-bef1-63912d84e2e2): created successfully
Nov 04 00:58:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d943c27e-7381-4a59-a827-0cd41f160d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Flow 'volume_create_manager' (b2be278a-bf7f-4897-80d5-315f5e753ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:53 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-705c421b-675d-4e21-a143-5104996418be tempest-VolumesListAdminTestJSON-536298456 None] Created volume successfully.
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Flow 'volume_create_manager' (455d375e-44cf-4324-92c7-ece37224584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c89f972-fead-405d-aac4-6b86d176fb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c89f972-fead-405d-aac4-6b86d176fb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1194877953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d08b8b1-3a44-4644-9a69-729649dc091c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0ab81cf444eb9b7e643a3274fc8d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:55Z,use_quota=True,user_id='5a9e4d3e0b0547ac8d60367e62838cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dee0590-1311-41cd-9ac4-013736177f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dee0590-1311-41cd-9ac4-013736177f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab3046f-e87c-481a-a7ab-40d40c171e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab3046f-e87c-481a-a7ab-40d40c171e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d08b8b1-3a44-4644-9a69-729649dc091c', 'volume_name': 'volume-0d08b8b1-3a44-4644-9a69-729649dc091c', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c649c3ee-f49b-40eb-9a77-e158e5155fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c649c3ee-f49b-40eb-9a77-e158e5155fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de1db61-1610-4382-832b-bd2e60f75cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:55 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Volume 0d08b8b1-3a44-4644-9a69-729649dc091c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d08b8b1-3a44-4644-9a69-729649dc091c', 'volume_size': 1}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1194877953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d08b8b1-3a44-4644-9a69-729649dc091c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0ab81cf444eb9b7e643a3274fc8d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:55Z,use_quota=True,user_id='5a9e4d3e0b0547ac8d60367e62838cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Creating volume 0d08b8b1-3a44-4644-9a69-729649dc091c {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:58:55 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:55 devstack sudo[92190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c 1073741824
Nov 04 00:58:55 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:55 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c 1073741824" returned: 0 in 0.535s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:55 devstack sudo[92197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c
Nov 04 00:58:55 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:56 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c" returned: 0 in 0.291s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:58:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de1db61-1610-4382-832b-bd2e60f75cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d08b8b1-3a44-4644-9a69-729649dc091c', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6099c43-761e-4d66-ac42-2b9fbb051850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:56 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Volume volume-0d08b8b1-3a44-4644-9a69-729649dc091c (0d08b8b1-3a44-4644-9a69-729649dc091c): created successfully
Nov 04 00:58:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6099c43-761e-4d66-ac42-2b9fbb051850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Flow 'volume_create_manager' (455d375e-44cf-4324-92c7-ece37224584f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:56 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7c0413b9-81db-4426-a4eb-0a76ba9b3caf tempest-VolumesListAdminTestJSON-536298456 None] Created volume successfully.
Nov 04 00:58:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-689b0326-2aee-45b1-b5b1-22b3dd538486 req-7f25cf72-2e76-4f10-b257-510256022a44 tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-689b0326-2aee-45b1-b5b1-22b3dd538486 req-7f25cf72-2e76-4f10-b257-510256022a44 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-689b0326-2aee-45b1-b5b1-22b3dd538486 req-7f25cf72-2e76-4f10-b257-510256022a44 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-689b0326-2aee-45b1-b5b1-22b3dd538486 req-7f25cf72-2e76-4f10-b257-510256022a44 tempest-ServerActionsTestOtherA-2120743137 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f86c4eb1-85c9-43ed-8eb8-3fe3fcf4e94c', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 00:58:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-689b0326-2aee-45b1-b5b1-22b3dd538486 req-7f25cf72-2e76-4f10-b257-510256022a44 tempest-ServerActionsTestOtherA-2120743137 None] attachment_update completed successfully.
Nov 04 00:58:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Acquiring lock "cinder-b78a78c8-ce3e-4528-aed0-187ac55c7e25-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:58:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Lock "cinder-b78a78c8-ce3e-4528-aed0-187ac55c7e25-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:58:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Acquiring lock "cinder-quobyte-b78a78c8-ce3e-4528-aed0-187ac55c7e25" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:58:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Lock "cinder-quobyte-b78a78c8-ce3e-4528-aed0-187ac55c7e25" acquired by "delete_volume" :: waited 0.040s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:58:57 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb087da-89d2-46aa-b4fc-9006f65e44c7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:58:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:57 devstack sudo[92631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25
Nov 04 00:58:57 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Flow 'volume_create_manager' (f157b95b-ba61-4553-99a1-9ed01452dd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5329cb2f-4a36-4716-b71a-15075fb59af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5329cb2f-4a36-4716-b71a-15075fb59af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06406e78-542d-4598-92f3-30bda4598806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c321d0f343c646c39c5ad1c33e5ad2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:58Z,use_quota=True,user_id='ef99965b3bce48d3a745a4d0583c84ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbecfea5-6abd-4306-a463-0e55ab41ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbecfea5-6abd-4306-a463-0e55ab41ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2797576-34ed-46db-8b8d-beb5e25a1f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2797576-34ed-46db-8b8d-beb5e25a1f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06406e78-542d-4598-92f3-30bda4598806', 'volume_name': 'volume-06406e78-542d-4598-92f3-30bda4598806', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51caf3f1-f9a7-421d-8d0c-a860ddeb659f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51caf3f1-f9a7-421d-8d0c-a860ddeb659f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf91c44-0d08-4732-bef8-b354db383f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:58 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Volume 06406e78-542d-4598-92f3-30bda4598806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06406e78-542d-4598-92f3-30bda4598806', 'volume_size': 1}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06406e78-542d-4598-92f3-30bda4598806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c321d0f343c646c39c5ad1c33e5ad2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:58:58Z,use_quota=True,user_id='ef99965b3bce48d3a745a4d0583c84ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Creating volume 06406e78-542d-4598-92f3-30bda4598806 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:58:58 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:58 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25" returned: 0 in 0.683s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:58 devstack sudo[92637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806 1073741824
Nov 04 00:58:58 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:58 devstack sudo[92639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25
Nov 04 00:58:58 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:58 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b78a78c8-ce3e-4528-aed0-187ac55c7e25" returned: 0 in 0.266s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Lock "cinder-quobyte-b78a78c8-ce3e-4528-aed0-187ac55c7e25" released by "delete_volume" :: held 1.022s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Created reservations ['8c6fbe22-9100-4868-a84a-b649506bcf03', 'f801554a-afb7-43a2-b868-d63b19e31df4', 'b19701fe-a646-4a60-8d52-27d66ccbaf49', '52af10cc-a8c7-4fde-8495-6879a9dbfb11'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:58 devstack sudo[92646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:58:58 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:58 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806 1073741824" returned: 0 in 0.514s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:58:58 devstack sudo[92648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806
Nov 04 00:58:58 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:58:59 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:59 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:58:59 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Deleted volume successfully.
Nov 04 00:58:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f00f31f-0902-4979-97f7-956c74d85e6f tempest-AttachVolumeShelveTestJSON-1184414305 None] Lock "cinder-b78a78c8-ce3e-4528-aed0-187ac55c7e25-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:58:59 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root
Nov 04 00:58:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806" returned: 0 in 0.322s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:58:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:58:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:58:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf91c44-0d08-4732-bef8-b354db383f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06406e78-542d-4598-92f3-30bda4598806', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5094942a-a6b3-4a74-bde2-3b71e7486a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:58:59 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Volume volume-06406e78-542d-4598-92f3-30bda4598806 (06406e78-542d-4598-92f3-30bda4598806): created successfully
Nov 04 00:58:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5094942a-a6b3-4a74-bde2-3b71e7486a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:58:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Flow 'volume_create_manager' (f157b95b-ba61-4553-99a1-9ed01452dd62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:58:59 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-181a8f19-1d28-4927-abba-929a3e91b058 tempest-VolumesListAdminTestJSON-644383355 None] Created volume successfully.
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Acquiring lock "cinder-06406e78-542d-4598-92f3-30bda4598806-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Lock "cinder-06406e78-542d-4598-92f3-30bda4598806-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Acquiring lock "cinder-quobyte-06406e78-542d-4598-92f3-30bda4598806" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Lock "cinder-quobyte-06406e78-542d-4598-92f3-30bda4598806" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[70827052-b1cd-4aec-b3d3-475bd8a03a97]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "cinder-0d08b8b1-3a44-4644-9a69-729649dc091c-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-0d08b8b1-3a44-4644-9a69-729649dc091c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "cinder-quobyte-0d08b8b1-3a44-4644-9a69-729649dc091c" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-quobyte-0d08b8b1-3a44-4644-9a69-729649dc091c" acquired by "delete_volume" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[934956db-1be5-4188-ae71-941d464d019d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:00 devstack sudo[92661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806
Nov 04 00:59:00 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:01 devstack sudo[92664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c
Nov 04 00:59:01 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-23ac4cc9-2e8d-4667-b7a0-9f8523cd62cb req-099b901d-2849-4b04-ab33-d0a50b2bcdf4 tempest-ServerActionsTestOtherA-2120743137 None] Terminate volume connection completed successfully.
Nov 04 00:59:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-23ac4cc9-2e8d-4667-b7a0-9f8523cd62cb req-099b901d-2849-4b04-ab33-d0a50b2bcdf4 tempest-ServerActionsTestOtherA-2120743137 None] Deleting attachment f86c4eb1-85c9-43ed-8eb8-3fe3fcf4e94c. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 00:59:01 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:01 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c" returned: 0 in 0.638s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806" returned: 0 in 0.914s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:01 devstack sudo[92701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c
Nov 04 00:59:01 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:01 devstack sudo[92702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806
Nov 04 00:59:01 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:02 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-06406e78-542d-4598-92f3-30bda4598806" returned: 0 in 0.672s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Lock "cinder-quobyte-06406e78-542d-4598-92f3-30bda4598806" released by "delete_volume" :: held 1.713s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:02 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d08b8b1-3a44-4644-9a69-729649dc091c" returned: 0 in 0.886s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-quobyte-0d08b8b1-3a44-4644-9a69-729649dc091c" released by "delete_volume" :: held 1.598s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Created reservations ['d7b7f830-02ed-415b-b7d2-6304663ed70b', '91e39bbe-5d96-4e08-a77f-7fd8d5784751', 'b02c7a77-3fca-408d-9a94-760d5438b590', 'd5350365-e8f0-4315-82d5-099c898add55'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Created reservations ['1c85c865-c02f-4ca4-8fe5-dc169dfd4160', 'c814101e-745f-4122-9c10-5b6f6e1b1875', 'bce1116b-909e-404a-934e-740328041d5c', 'af53b1e7-455a-4a78-a543-6714135e55ec'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:02 devstack sudo[92768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:59:02 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:02 devstack sudo[92772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:59:02 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-23ac4cc9-2e8d-4667-b7a0-9f8523cd62cb req-d53423b3-577c-433b-9946-ca81ea272973 tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-23ac4cc9-2e8d-4667-b7a0-9f8523cd62cb req-d53423b3-577c-433b-9946-ca81ea272973 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-23ac4cc9-2e8d-4667-b7a0-9f8523cd62cb req-d53423b3-577c-433b-9946-ca81ea272973 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-23ac4cc9-2e8d-4667-b7a0-9f8523cd62cb req-d53423b3-577c-433b-9946-ca81ea272973 tempest-ServerActionsTestOtherA-2120743137 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd54b4e62-b761-47b6-af44-ee3a3d75f19b', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 00:59:03 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.474s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:59:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Deleted volume successfully.
Nov 04 00:59:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-23ac4cc9-2e8d-4667-b7a0-9f8523cd62cb req-d53423b3-577c-433b-9946-ca81ea272973 tempest-ServerActionsTestOtherA-2120743137 None] attachment_update completed successfully.
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-405e6c50-aa99-43fa-8d40-ac83c4d93f4a tempest-VolumesListAdminTestJSON-644383355 None] Lock "cinder-06406e78-542d-4598-92f3-30bda4598806-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:03 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.468s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:59:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Deleted volume successfully.
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "cinder-a67f0c08-9cda-4a34-bef1-63912d84e2e2-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da4f6ee5-e320-4428-92d6-b5a1a843d474 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-0d08b8b1-3a44-4644-9a69-729649dc091c-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-a67f0c08-9cda-4a34-bef1-63912d84e2e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "cinder-quobyte-a67f0c08-9cda-4a34-bef1-63912d84e2e2" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-quobyte-a67f0c08-9cda-4a34-bef1-63912d84e2e2" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[544c0cd2-a1c2-4332-ab6e-58b100fae0da]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:03 devstack sudo[92778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2
Nov 04 00:59:03 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:04 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2" returned: 0 in 0.447s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:04 devstack sudo[92793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2
Nov 04 00:59:04 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:04 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a67f0c08-9cda-4a34-bef1-63912d84e2e2" returned: 0 in 0.276s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-quobyte-a67f0c08-9cda-4a34-bef1-63912d84e2e2" released by "delete_volume" :: held 0.780s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Created reservations ['e6b6ecce-0958-4887-a4a3-c93f3434c8e5', 'be6ba29a-63a4-4c20-8186-fe68d69ed173', '493f083f-a992-4d69-8ea1-78755c6fca51', 'ade2b682-44b6-4055-86ca-671152e7ec03'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:04 devstack sudo[92806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:59:04 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "cinder-41d742b4-2d61-45ef-acbf-bf3b05488587-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-41d742b4-2d61-45ef-acbf-bf3b05488587-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "cinder-quobyte-41d742b4-2d61-45ef-acbf-bf3b05488587" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-quobyte-41d742b4-2d61-45ef-acbf-bf3b05488587" acquired by "delete_volume" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[90208749-c637-4ecd-88ad-1087825e8ed9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.428s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:04 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:59:04 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:04 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Deleted volume successfully.
Nov 04 00:59:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-57a3b34e-d50a-44ca-8be2-471e7bab31c2 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-a67f0c08-9cda-4a34-bef1-63912d84e2e2-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:05 devstack sudo[92908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587
Nov 04 00:59:05 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:05 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587" returned: 0 in 0.578s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:05 devstack sudo[93253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587
Nov 04 00:59:05 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:05 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41d742b4-2d61-45ef-acbf-bf3b05488587" returned: 0 in 0.431s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-quobyte-41d742b4-2d61-45ef-acbf-bf3b05488587" released by "delete_volume" :: held 1.130s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:05 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Created reservations ['79fb904f-15fe-4f30-8209-e2a20d739b12', 'c8c528ad-9df4-4207-9edf-305b63ac0ab1', 'd7bbf605-8461-4281-9114-63895268fbe7', '7df15b29-b40b-4a0e-aeff-8c681733ff5c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:59:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:06 devstack sudo[93267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:59:06 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:06 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.313s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:06 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:59:06 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Deleted volume successfully.
Nov 04 00:59:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aa25e504-32cd-4ef9-b688-09d5194ac287 tempest-VolumesListAdminTestJSON-536298456 None] Lock "cinder-41d742b4-2d61-45ef-acbf-bf3b05488587-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:16 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=47,cinder:UPDATE=54,cinder:DELETE=4,cinder:INSERT=9 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:59:16 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=49,cinder:UPDATE=56,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Flow 'volume_create_manager' (7b1da8b1-f4c0-47c4-8cdf-c9be32fbe70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4634c31-0133-4340-947b-7eb83c2b7198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4634c31-0133-4340-947b-7eb83c2b7198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-34734288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fd32bd-c2cf-4b1c-851f-3bdeacb4d879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f7b78144994748bd8d114f4611dee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:18Z,use_quota=True,user_id='5e579cd24bfc459c97e9a0c4e8bfad4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c615bd-32c4-49a1-ba3c-b867ed25dbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c615bd-32c4-49a1-ba3c-b867ed25dbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f4495-ef3f-4c6a-86e7-9092e8afae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f4495-ef3f-4c6a-86e7-9092e8afae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87fd32bd-c2cf-4b1c-851f-3bdeacb4d879', 'volume_name': 'volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f395332a-eb88-4b61-9009-56c431418a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f395332a-eb88-4b61-9009-56c431418a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38ebb4e-bf4e-4f56-9009-3288b43a62f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:18 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Volume 87fd32bd-c2cf-4b1c-851f-3bdeacb4d879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879', 'volume_size': 1}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-34734288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fd32bd-c2cf-4b1c-851f-3bdeacb4d879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f7b78144994748bd8d114f4611dee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:18Z,use_quota=True,user_id='5e579cd24bfc459c97e9a0c4e8bfad4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Creating volume 87fd32bd-c2cf-4b1c-851f-3bdeacb4d879 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:59:18 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:59:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:18 devstack sudo[93343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879 1073741824
Nov 04 00:59:18 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:19 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879 1073741824" returned: 0 in 0.786s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:19 devstack sudo[93349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879
Nov 04 00:59:19 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:19 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879" returned: 0 in 0.447s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:59:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38ebb4e-bf4e-4f56-9009-3288b43a62f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6a4f8e-a12c-42d4-ac36-7a3e8c982182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:19 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Volume volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879 (87fd32bd-c2cf-4b1c-851f-3bdeacb4d879): created successfully
Nov 04 00:59:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6a4f8e-a12c-42d4-ac36-7a3e8c982182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Flow 'volume_create_manager' (7b1da8b1-f4c0-47c4-8cdf-c9be32fbe70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:19 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c51a1b2d-2945-4a07-9c33-f1c8446358dd tempest-VolumesTransfersV355Test-1497688815 None] Created volume successfully.
Nov 04 00:59:21 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7ca9a04e-1eab-4c65-a7fb-3041ab783d65 tempest-VolumesTransfersV355Test-1052465772 None] Transfer volume completed successfully.
Nov 04 00:59:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Acquiring lock "cinder-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Lock "cinder-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Acquiring lock "cinder-quobyte-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Lock "cinder-quobyte-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879" acquired by "delete_volume" :: waited 0.034s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:22 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef9d5a2-cce4-41c5-88ab-cc38c7a4a713]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:22 devstack sudo[93384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879
Nov 04 00:59:22 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:22 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879" returned: 0 in 0.524s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:22 devstack sudo[93392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879
Nov 04 00:59:22 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:22 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879" returned: 0 in 0.275s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Lock "cinder-quobyte-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879" released by "delete_volume" :: held 0.870s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:23 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Created reservations ['8939e812-1ba6-4112-8738-e3dc9ae2ae71', '9b5d8487-9830-4905-a515-9a6a2f1b3a3e', '29bc8dfc-9adb-4558-b96c-62f00f6fe9b5', '1cca37a8-94bb-4b07-a2c5-cb42372ad5e1'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:59:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:23 devstack sudo[93397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:59:23 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:23 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.344s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:23 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:59:23 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Deleted volume successfully.
Nov 04 00:59:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51128c65-8ff5-4e46-a79c-54e767bdb876 tempest-VolumesTransfersV355Test-524113040 None] Lock "cinder-87fd32bd-c2cf-4b1c-851f-3bdeacb4d879-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Flow 'volume_create_manager' (8ea68304-a451-446e-931c-d3220492d71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e32401d-c016-492b-9dc6-58fd9486b233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e32401d-c016-492b-9dc6-58fd9486b233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2030088622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c62017-06b1-415f-88e1-99416dc8a746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f7b78144994748bd8d114f4611dee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:24Z,use_quota=True,user_id='5e579cd24bfc459c97e9a0c4e8bfad4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5974b08-ef5a-4c6b-906f-2ec30108e1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5974b08-ef5a-4c6b-906f-2ec30108e1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3214390d-d5d9-4e36-8c7e-1441509f985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3214390d-d5d9-4e36-8c7e-1441509f985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c62017-06b1-415f-88e1-99416dc8a746', 'volume_name': 'volume-f6c62017-06b1-415f-88e1-99416dc8a746', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09ffec9-e9b1-419d-a4fd-4447b75d480e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09ffec9-e9b1-419d-a4fd-4447b75d480e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f2031b-d536-4e0d-8983-ef1989e2ac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:24 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Volume f6c62017-06b1-415f-88e1-99416dc8a746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c62017-06b1-415f-88e1-99416dc8a746', 'volume_size': 1}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2030088622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c62017-06b1-415f-88e1-99416dc8a746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f7b78144994748bd8d114f4611dee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:24Z,use_quota=True,user_id='5e579cd24bfc459c97e9a0c4e8bfad4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Creating volume f6c62017-06b1-415f-88e1-99416dc8a746 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:59:24 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:24 devstack sudo[93400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746 1073741824
Nov 04 00:59:24 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:24 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746 1073741824" returned: 0 in 0.683s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:25 devstack sudo[93441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746
Nov 04 00:59:25 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:25 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746" returned: 0 in 0.327s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:59:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f2031b-d536-4e0d-8983-ef1989e2ac94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c62017-06b1-415f-88e1-99416dc8a746', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ba63dd-d1cf-418c-bfc4-eeabbd7cc582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:25 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Volume volume-f6c62017-06b1-415f-88e1-99416dc8a746 (f6c62017-06b1-415f-88e1-99416dc8a746): created successfully
Nov 04 00:59:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ba63dd-d1cf-418c-bfc4-eeabbd7cc582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Flow 'volume_create_manager' (8ea68304-a451-446e-931c-d3220492d71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:25 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-32faa36d-2d56-47f3-a7b6-0f528ab45d2b tempest-VolumesTransfersV355Test-1497688815 None] Created volume successfully.
Nov 04 00:59:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Acquiring lock "cinder-f6c62017-06b1-415f-88e1-99416dc8a746-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Lock "cinder-f6c62017-06b1-415f-88e1-99416dc8a746-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Acquiring lock "cinder-quobyte-f6c62017-06b1-415f-88e1-99416dc8a746" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Lock "cinder-quobyte-f6c62017-06b1-415f-88e1-99416dc8a746" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:26 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8815fb-512e-429c-8884-ed486f59c5ca]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:26 devstack sudo[93450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746
Nov 04 00:59:26 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:27 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746" returned: 0 in 0.454s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:27 devstack sudo[93455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746
Nov 04 00:59:27 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:27 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f6c62017-06b1-415f-88e1-99416dc8a746" returned: 0 in 0.338s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Lock "cinder-quobyte-f6c62017-06b1-415f-88e1-99416dc8a746" released by "delete_volume" :: held 0.878s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:27 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Created reservations ['fdeeea40-fc29-429e-bc50-a50f14ce6eb0', '6c0645bd-b392-417d-827b-cd770959fd46', '424f48b9-7111-458d-a627-67a0a1ff490a', '3fde0c35-2ff0-4755-a9b0-93e6f4809ccf'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:59:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:27 devstack sudo[93458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:59:27 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:28 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.360s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:28 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:59:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Deleted volume successfully.
Nov 04 00:59:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-aad57e77-4882-4ca9-87c4-cf77d310f7c4 tempest-VolumesTransfersV355Test-524113040 None] Lock "cinder-f6c62017-06b1-415f-88e1-99416dc8a746-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:33 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-256423f0-cd11-41e1-91a3-c96469ba3ceb req-0cde707b-5545-4321-83f2-5d1bfdb11891 tempest-ServerActionsTestOtherA-2120743137 None] Terminate volume connection completed successfully.
Nov 04 00:59:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-256423f0-cd11-41e1-91a3-c96469ba3ceb req-0cde707b-5545-4321-83f2-5d1bfdb11891 tempest-ServerActionsTestOtherA-2120743137 None] Deleting attachment d54b4e62-b761-47b6-af44-ee3a3d75f19b. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 00:59:43 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=19,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:59:43 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=12,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Flow 'volume_create_manager' (18cf333d-eb22-46a9-bce0-b1667bc61a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b914ee89-622f-410c-833f-f4388b338e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b914ee89-622f-410c-833f-f4388b338e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1449975099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013f298f-50af-45fb-b6df-82624b118739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841ad0ca62c42218c707af60e94c39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:44Z,use_quota=True,user_id='f29d39d31296412bb0f4913218a1fb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f11fbf5-0e24-4f61-8a24-f9f92c312250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f11fbf5-0e24-4f61-8a24-f9f92c312250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138b3c5e-78b9-4b5b-bc70-7626e31d1138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138b3c5e-78b9-4b5b-bc70-7626e31d1138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '013f298f-50af-45fb-b6df-82624b118739', 'volume_name': 'volume-013f298f-50af-45fb-b6df-82624b118739', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a8061d-2358-44c0-ba7f-356a7ad20a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a8061d-2358-44c0-ba7f-356a7ad20a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8981878-2d05-4bbe-a428-1606268da165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:44 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Volume 013f298f-50af-45fb-b6df-82624b118739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-013f298f-50af-45fb-b6df-82624b118739', 'volume_size': 1}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1449975099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013f298f-50af-45fb-b6df-82624b118739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841ad0ca62c42218c707af60e94c39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:44Z,use_quota=True,user_id='f29d39d31296412bb0f4913218a1fb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Creating volume 013f298f-50af-45fb-b6df-82624b118739 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:59:44 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:44 devstack sudo[93687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739 1073741824
Nov 04 00:59:44 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Flow 'volume_create_manager' (8eecc895-e7eb-4ee8-8b6e-4eef53508ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e85ddb2-289a-4690-90d8-07ca3c6af26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e85ddb2-289a-4690-90d8-07ca3c6af26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2047671560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34af302-bcc6-4c70-ad3f-23b0ca59ac2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df921c671dd54ccf9eb0aa4c69c9916e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:44Z,use_quota=True,user_id='3e694ef489704257a1d79bfc90669bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c352aea3-6daf-4b62-91eb-efc5bbc3afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c352aea3-6daf-4b62-91eb-efc5bbc3afe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1329bdd0-fe17-4e49-a6dc-a4e2d37ea251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG cinder.image.glance [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Creating Keystone auth plugin from conf {{(pid=86660) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 00:59:44 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739 1073741824" returned: 0 in 0.686s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:45 devstack sudo[93693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739
Nov 04 00:59:45 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1329bdd0-fe17-4e49-a6dc-a4e2d37ea251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c34af302-bcc6-4c70-ad3f-23b0ca59ac2a', 'volume_name': 'volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547609220>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20c53a8-54f8-43a3-8e94-88d9309ca045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20c53a8-54f8-43a3-8e94-88d9309ca045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bb4215-7bb7-4e1b-8904-25a71f286a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:45 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Volume c34af302-bcc6-4c70-ad3f-23b0ca59ac2a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547609220>}
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Trying to clone c34af302-bcc6-4c70-ad3f-23b0ca59ac2a from image feeea883-a973-4c2d-b14e-c13d05c107a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]). {{(pid=86660) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 00:59:45 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739" returned: 0 in 0.403s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8981878-2d05-4bbe-a428-1606268da165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-013f298f-50af-45fb-b6df-82624b118739', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e87fc65-1497-4535-b542-eaf7df87131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:45 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Volume volume-013f298f-50af-45fb-b6df-82624b118739 (013f298f-50af-45fb-b6df-82624b118739): created successfully
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e87fc65-1497-4535-b542-eaf7df87131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Flow 'volume_create_manager' (18cf333d-eb22-46a9-bce0-b1667bc61a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-310d48d0-3d0d-4bee-8eeb-28be025f36b6 tempest-VolumesTransfersV357Test-628651754 None] Created volume successfully.
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 00:59:45 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Image download 20.69 MB at 20.69 MB/s
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff6ee49-84f3-43cf-912c-4037f5bdb0d7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:46 devstack sudo[93718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD
Nov 04 00:59:46 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:46 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Temporary image feeea883-a973-4c2d-b14e-c13d05c107a4 is fetched for user 3e694ef489704257a1d79bfc90669bdb. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[243c1f69-2f4f-4aee-9c04-4362f80105bd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:46 devstack sudo[93724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD
Nov 04 00:59:46 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:46 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2047671560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34af302-bcc6-4c70-ad3f-23b0ca59ac2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df921c671dd54ccf9eb0aa4c69c9916e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:44Z,use_quota=True,user_id='3e694ef489704257a1d79bfc90669bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Creating volume c34af302-bcc6-4c70-ad3f-23b0ca59ac2a {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:59:46 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:59:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:46 devstack sudo[93729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a 1073741824
Nov 04 00:59:46 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e0155365-d98c-48a1-bb06-253fe0ada340 tempest-VolumesTransfersV357Test-1155176191 None] Transfer volume completed successfully.
Nov 04 00:59:47 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a 1073741824" returned: 0 in 0.553s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:47 devstack sudo[93735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a
Nov 04 00:59:47 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Acquiring lock "cinder-013f298f-50af-45fb-b6df-82624b118739-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Lock "cinder-013f298f-50af-45fb-b6df-82624b118739-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Acquiring lock "cinder-quobyte-013f298f-50af-45fb-b6df-82624b118739" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Lock "cinder-quobyte-013f298f-50af-45fb-b6df-82624b118739" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:47 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a" returned: 0 in 0.282s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c2ae3a-1933-43ef-ae51-07009544501a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Attempting download of feeea883-a973-4c2d-b14e-c13d05c107a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}])) to volume c34af302-bcc6-4c70-ad3f-23b0ca59ac2a. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb742e1-8d31-46a6-a19f-13a900c9a816]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_2191al63 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:47 devstack sudo[93738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739
Nov 04 00:59:47 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:47 devstack sudo[93739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_2191al63
Nov 04 00:59:47 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:48 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739" returned: 0 in 0.365s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:48 devstack sudo[93745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739
Nov 04 00:59:48 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:48 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_2191al63" returned: 0 in 0.350s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_2191al63 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:48 devstack sudo[93749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_2191al63
Nov 04 00:59:48 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:48 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-013f298f-50af-45fb-b6df-82624b118739" returned: 0 in 0.260s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Lock "cinder-quobyte-013f298f-50af-45fb-b6df-82624b118739" released by "delete_volume" :: held 0.690s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Created reservations ['e8d4c91a-d673-4d9d-b7d7-3e6b24be10b6', '41522b56-95ef-441b-90eb-091b7e90823e', '485f187c-6460-4a4a-95d9-ebe5e85c2971', 'a638b882-6d7d-48b4-aec7-b2b6ac983639'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:59:48 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_2191al63" returned: 1 in 0.358s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_2191al63' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[57149050-422d-4999-b4c5-49ec79b36d84]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:48 devstack sudo[93755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:59:48 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:48 devstack sudo[93754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD
Nov 04 00:59:48 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:48 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.315s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:59:48 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Deleted volume successfully.
Nov 04 00:59:48 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] feeea883-a973-4c2d-b14e-c13d05c107a4 was qcow2, converting to qcow2 {{(pid=86660) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfb4a2a1-bff8-4b48-bcbe-accddaee9665 tempest-VolumesTransfersV357Test-1770693845 None] Lock "cinder-013f298f-50af-45fb-b6df-82624b118739-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:49 devstack sudo[93763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a
Nov 04 00:59:49 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Flow 'volume_create_manager' (09fbc001-8452-469a-9229-31ff4e7cdf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e768db7-aad2-4064-9f62-6f9dccc25528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e768db7-aad2-4064-9f62-6f9dccc25528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1249634869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa8b2e8-45f6-433a-b98e-3da22c7b79c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841ad0ca62c42218c707af60e94c39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:49Z,use_quota=True,user_id='f29d39d31296412bb0f4913218a1fb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291f8f16-bf57-4a89-ae14-4f396b3147ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291f8f16-bf57-4a89-ae14-4f396b3147ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa8c2d4-d072-4e94-9ce3-a9240d68a1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa8c2d4-d072-4e94-9ce3-a9240d68a1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa8b2e8-45f6-433a-b98e-3da22c7b79c9', 'volume_name': 'volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e49adb1-6aae-47b6-ba3e-2f4014559157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e49adb1-6aae-47b6-ba3e-2f4014559157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e389e76-6834-4333-a43f-54824d537161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:49 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Volume baa8b2e8-45f6-433a-b98e-3da22c7b79c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9', 'volume_size': 1}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1249634869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa8b2e8-45f6-433a-b98e-3da22c7b79c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4841ad0ca62c42218c707af60e94c39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:49Z,use_quota=True,user_id='f29d39d31296412bb0f4913218a1fb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Creating volume baa8b2e8-45f6-433a-b98e-3da22c7b79c9 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:59:49 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:59:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:49 devstack sudo[93778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9 1073741824
Nov 04 00:59:49 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:50 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9 1073741824" returned: 0 in 0.580s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:50 devstack sudo[93785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9
Nov 04 00:59:50 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:50 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9" returned: 0 in 0.282s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:59:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e389e76-6834-4333-a43f-54824d537161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad381b0c-b56d-46ae-8181-1f1abd664c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:50 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Volume volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9 (baa8b2e8-45f6-433a-b98e-3da22c7b79c9): created successfully
Nov 04 00:59:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad381b0c-b56d-46ae-8181-1f1abd664c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Flow 'volume_create_manager' (09fbc001-8452-469a-9229-31ff4e7cdf95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:50 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1048e913-3224-4a42-b553-03e59ccf7f50 tempest-VolumesTransfersV357Test-628651754 None] Created volume successfully.
Nov 04 00:59:51 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a" returned: 0 in 2.135s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_fzl0wrgbdevstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 00:59:51 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Converted 112.00 MB image at 52.44 MB/s
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:51 devstack sudo[93788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a 1G
Nov 04 00:59:51 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:51 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a 1G" returned: 0 in 0.314s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Downloaded image feeea883-a973-4c2d-b14e-c13d05c107a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}])) to volume c34af302-bcc6-4c70-ad3f-23b0ca59ac2a successfully. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Temporary image feeea883-a973-4c2d-b14e-c13d05c107a4 for user 3e694ef489704257a1d79bfc90669bdb is deleted. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Marking volume c34af302-bcc6-4c70-ad3f-23b0ca59ac2a as bootable. {{(pid=86660) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Copying metadata from image feeea883-a973-4c2d-b14e-c13d05c107a4 to c34af302-bcc6-4c70-ad3f-23b0ca59ac2a. {{(pid=86660) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Creating volume glance metadata for volume c34af302-bcc6-4c70-ad3f-23b0ca59ac2a backed by image feeea883-a973-4c2d-b14e-c13d05c107a4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86660) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bb4215-7bb7-4e1b-8904-25a71f286a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547609220>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65dc431f-c8be-4aab-a3a3-060423eb1ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:51 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Volume volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a (c34af302-bcc6-4c70-ad3f-23b0ca59ac2a): created successfully
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65dc431f-c8be-4aab-a3a3-060423eb1ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Flow 'volume_create_manager' (8eecc895-e7eb-4ee8-8b6e-4eef53508ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:51 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-af598797-aab9-4359-a599-2df9fc76bac0 tempest-ServerActionsTestOtherA-2120743137 None] Created volume successfully.
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:51 devstack sudo[93794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:59:51 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:51 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Acquiring lock "cinder-baa8b2e8-45f6-433a-b98e-3da22c7b79c9-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Lock "cinder-baa8b2e8-45f6-433a-b98e-3da22c7b79c9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Acquiring lock "cinder-quobyte-baa8b2e8-45f6-433a-b98e-3da22c7b79c9" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Lock "cinder-quobyte-baa8b2e8-45f6-433a-b98e-3da22c7b79c9" acquired by "delete_volume" :: waited 0.036s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbbf720-c542-4e48-8dbf-08e8686345e0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:52 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.544s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 00:59:52 devstack sudo[93797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9
Nov 04 00:59:52 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:52 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9" returned: 0 in 0.543s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:52 devstack sudo[93803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9
Nov 04 00:59:52 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:53 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-baa8b2e8-45f6-433a-b98e-3da22c7b79c9" returned: 0 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Lock "cinder-quobyte-baa8b2e8-45f6-433a-b98e-3da22c7b79c9" released by "delete_volume" :: held 0.953s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Created reservations ['177f93b0-211c-4c5f-86c3-e0e8b66dfb67', 'befeb699-7700-417b-bc71-da2e680974e3', '068ab7ae-8bc5-4a36-b3bf-f921162f778a', '2a48f7b2-3450-4500-81ca-b09c80b53390'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:53 devstack sudo[93806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 00:59:53 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:53 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.398s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 00:59:53 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Deleted volume successfully.
Nov 04 00:59:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd55f5b7-5a09-4e14-aa24-9849bee5b8ec tempest-VolumesTransfersV357Test-1770693845 None] Lock "cinder-baa8b2e8-45f6-433a-b98e-3da22c7b79c9-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Flow 'volume_create_manager' (f8443eab-e4b3-4ccb-9540-fdb3515bceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe029dbe-b0da-4a20-acc1-b50550933d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe029dbe-b0da-4a20-acc1-b50550933d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1453260876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bc69e7-6942-4074-bbdf-37b8b9f1075a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b887ed0d42ad4f2e9c00fceee7aa7d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:55Z,use_quota=True,user_id='c51931e0be204e8ca34de983e2b86288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9d04a8-10c5-4cf9-8160-5f40200d0609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9d04a8-10c5-4cf9-8160-5f40200d0609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d85c1e5-ed5f-4fdb-a3f4-0747a2182cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d85c1e5-ed5f-4fdb-a3f4-0747a2182cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07bc69e7-6942-4074-bbdf-37b8b9f1075a', 'volume_name': 'volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f259af-48fd-4246-832b-6f9572a8d2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f259af-48fd-4246-832b-6f9572a8d2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4c4c81-802c-4ce5-9582-536b12931582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:55 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Volume 07bc69e7-6942-4074-bbdf-37b8b9f1075a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a', 'volume_size': 1}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T23:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1453260876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bc69e7-6942-4074-bbdf-37b8b9f1075a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b887ed0d42ad4f2e9c00fceee7aa7d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T23:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T23:59:55Z,use_quota=True,user_id='c51931e0be204e8ca34de983e2b86288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Creating volume 07bc69e7-6942-4074-bbdf-37b8b9f1075a {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 00:59:55 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 00:59:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:55 devstack sudo[93833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a 1073741824
Nov 04 00:59:55 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:56 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a 1073741824" returned: 0 in 0.627s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 00:59:56 devstack sudo[93841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a
Nov 04 00:59:56 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-22889de1-b4a2-44c2-8811-d952cf3e22e5 req-2d0c6894-0b3e-4e30-a7f3-efcf94646fca tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:56 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a" returned: 0 in 0.348s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-22889de1-b4a2-44c2-8811-d952cf3e22e5 req-2d0c6894-0b3e-4e30-a7f3-efcf94646fca tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.055s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-22889de1-b4a2-44c2-8811-d952cf3e22e5 req-2d0c6894-0b3e-4e30-a7f3-efcf94646fca tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4c4c81-802c-4ce5-9582-536b12931582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f8f293-cf6c-4862-ba6a-4fd98b621178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 00:59:56 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Volume volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a (07bc69e7-6942-4074-bbdf-37b8b9f1075a): created successfully
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f8f293-cf6c-4862-ba6a-4fd98b621178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Flow 'volume_create_manager' (f8443eab-e4b3-4ccb-9540-fdb3515bceb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 00:59:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-22889de1-b4a2-44c2-8811-d952cf3e22e5 req-2d0c6894-0b3e-4e30-a7f3-efcf94646fca tempest-ServerActionsTestOtherA-2120743137 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55c58e13-ecd9-403e-9f29-f80404b6af94', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 00:59:56 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-13e5bc05-ca74-4f0f-9b57-2273319912aa tempest-AttachVolumeTestJSON-488239250 None] Created volume successfully.
Nov 04 00:59:56 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-22889de1-b4a2-44c2-8811-d952cf3e22e5 req-2d0c6894-0b3e-4e30-a7f3-efcf94646fca tempest-ServerActionsTestOtherA-2120743137 None] attachment_update completed successfully.
Nov 04 00:59:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-e0bd7f5f-d411-4fd4-808e-97bc36e4b79f req-c8364d9f-672d-4f90-a2ad-aa970929e7a9 tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 00:59:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-e0bd7f5f-d411-4fd4-808e-97bc36e4b79f req-c8364d9f-672d-4f90-a2ad-aa970929e7a9 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 00:59:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-e0bd7f5f-d411-4fd4-808e-97bc36e4b79f req-c8364d9f-672d-4f90-a2ad-aa970929e7a9 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 00:59:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-e0bd7f5f-d411-4fd4-808e-97bc36e4b79f req-c8364d9f-672d-4f90-a2ad-aa970929e7a9 tempest-AttachVolumeTestJSON-488239250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c4c8a36-96ff-4c8c-96d3-53cbeee440a4', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 00:59:58 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-e0bd7f5f-d411-4fd4-808e-97bc36e4b79f req-c8364d9f-672d-4f90-a2ad-aa970929e7a9 tempest-AttachVolumeTestJSON-488239250 None] attachment_update completed successfully.
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Flow 'volume_create_manager' (dd508018-3cdb-4ed5-a3b1-afaaa0f1931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c1691a-378c-402d-9ff4-73899a948e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c1691a-378c-402d-9ff4-73899a948e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-563114261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1123b69f-a3fb-477c-ab6b-fa8389bb64c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b887ed0d42ad4f2e9c00fceee7aa7d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:02Z,use_quota=True,user_id='c51931e0be204e8ca34de983e2b86288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f8e1c27-5a49-4ae5-869a-e99126625645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f8e1c27-5a49-4ae5-869a-e99126625645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cf6d8f-afbf-43e5-97aa-b6b48d5a7108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cf6d8f-afbf-43e5-97aa-b6b48d5a7108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1123b69f-a3fb-477c-ab6b-fa8389bb64c9', 'volume_name': 'volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e3ed65-de36-4b08-992b-3ebde0217c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e3ed65-de36-4b08-992b-3ebde0217c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babb5c23-51b5-441b-b58f-9adec54c3a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Volume 1123b69f-a3fb-477c-ab6b-fa8389bb64c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9', 'volume_size': 1}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-563114261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1123b69f-a3fb-477c-ab6b-fa8389bb64c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b887ed0d42ad4f2e9c00fceee7aa7d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:02Z,use_quota=True,user_id='c51931e0be204e8ca34de983e2b86288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Creating volume 1123b69f-a3fb-477c-ab6b-fa8389bb64c9 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:00:01 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:00:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:01 devstack sudo[94326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9 1073741824
Nov 04 01:00:01 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:02 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9 1073741824" returned: 0 in 0.762s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:02 devstack sudo[94332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9
Nov 04 01:00:02 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:03 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9" returned: 0 in 0.300s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:00:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babb5c23-51b5-441b-b58f-9adec54c3a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7edaed-ca3e-41ad-8cae-4f5681bc55fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:03 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Volume volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9 (1123b69f-a3fb-477c-ab6b-fa8389bb64c9): created successfully
Nov 04 01:00:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7edaed-ca3e-41ad-8cae-4f5681bc55fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Flow 'volume_create_manager' (dd508018-3cdb-4ed5-a3b1-afaaa0f1931f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c70ed92e-e36a-4644-b302-b8c2da71d499 tempest-AttachVolumeTestJSON-488239250 None] Created volume successfully.
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-7a4feed8-2c65-47e9-a98b-5c7879fdbb44 req-cdc997cb-6566-4dbc-9b35-2610cb8bc5e8 tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-7a4feed8-2c65-47e9-a98b-5c7879fdbb44 req-cdc997cb-6566-4dbc-9b35-2610cb8bc5e8 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-7a4feed8-2c65-47e9-a98b-5c7879fdbb44 req-cdc997cb-6566-4dbc-9b35-2610cb8bc5e8 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-7a4feed8-2c65-47e9-a98b-5c7879fdbb44 req-cdc997cb-6566-4dbc-9b35-2610cb8bc5e8 tempest-AttachVolumeTestJSON-488239250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2aaa0d8f-9180-4d67-ae64-2e29883249d2', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:00:05 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-7a4feed8-2c65-47e9-a98b-5c7879fdbb44 req-cdc997cb-6566-4dbc-9b35-2610cb8bc5e8 tempest-AttachVolumeTestJSON-488239250 None] attachment_update completed successfully.
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Flow 'volume_create_manager' (4d9e8627-985c-4e3a-ac76-73c1b627ab93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fa2b96-50c1-4124-82c0-f7afc04d6e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fa2b96-50c1-4124-82c0-f7afc04d6e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1033911340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c246029-bcae-42f0-969e-a4a8a8b021bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3114ea544541e99b3acb5f5d84cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:06Z,use_quota=True,user_id='68210cf371df4163a49e66ef130a35ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bffa867-abad-4ebb-a1a8-eb33a1b6f472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bffa867-abad-4ebb-a1a8-eb33a1b6f472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bc949d-20dc-46a0-9cd6-13b694236848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bc949d-20dc-46a0-9cd6-13b694236848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c246029-bcae-42f0-969e-a4a8a8b021bc', 'volume_name': 'volume-0c246029-bcae-42f0-969e-a4a8a8b021bc', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d5c84b-2174-4cdf-b23a-cec01a39ce2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d5c84b-2174-4cdf-b23a-cec01a39ce2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6b3049-018f-4b78-974f-90a88e447ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:05 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Volume 0c246029-bcae-42f0-969e-a4a8a8b021bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c246029-bcae-42f0-969e-a4a8a8b021bc', 'volume_size': 1}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1033911340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c246029-bcae-42f0-969e-a4a8a8b021bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3114ea544541e99b3acb5f5d84cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:06Z,use_quota=True,user_id='68210cf371df4163a49e66ef130a35ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Creating volume 0c246029-bcae-42f0-969e-a4a8a8b021bc {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:00:05 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:00:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:06 devstack sudo[94392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc 1073741824
Nov 04 01:00:06 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:06 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc 1073741824" returned: 0 in 0.843s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:06 devstack sudo[94399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc
Nov 04 01:00:06 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Flow 'volume_create_manager' (c915fbb5-33a2-4cad-845e-22d637fb28d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4648c3-6a6b-4875-bb67-7bcd5d7abc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4648c3-6a6b-4875-bb67-7bcd5d7abc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1830162203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9810f1c-7308-4e2c-8672-98e72452e2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ea705d59b04c6ab165707d70ff94d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:07Z,use_quota=True,user_id='37bd9b62ae6f4cffa72e9b090607f0d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcaa871-cefd-4d62-b0e7-4f3200ee1620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcaa871-cefd-4d62-b0e7-4f3200ee1620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5ee8ca-3af2-4318-958b-f6c206385556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5ee8ca-3af2-4318-958b-f6c206385556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9810f1c-7308-4e2c-8672-98e72452e2d0', 'volume_name': 'volume-b9810f1c-7308-4e2c-8672-98e72452e2d0', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e4df62-a358-4d92-8dad-4832c3e8f73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e4df62-a358-4d92-8dad-4832c3e8f73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb623a9c-7c1f-4669-ba82-507d5f661b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:07 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Volume b9810f1c-7308-4e2c-8672-98e72452e2d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9810f1c-7308-4e2c-8672-98e72452e2d0', 'volume_size': 1}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:07 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc" returned: 0 in 0.688s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1830162203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9810f1c-7308-4e2c-8672-98e72452e2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ea705d59b04c6ab165707d70ff94d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:07Z,use_quota=True,user_id='37bd9b62ae6f4cffa72e9b090607f0d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Creating volume b9810f1c-7308-4e2c-8672-98e72452e2d0 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:00:07 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:07 devstack sudo[94404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0 1073741824
Nov 04 01:00:07 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6b3049-018f-4b78-974f-90a88e447ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c246029-bcae-42f0-969e-a4a8a8b021bc', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474de0d0-ba19-411c-aa85-91839acaee9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:07 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Volume volume-0c246029-bcae-42f0-969e-a4a8a8b021bc (0c246029-bcae-42f0-969e-a4a8a8b021bc): created successfully
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474de0d0-ba19-411c-aa85-91839acaee9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Flow 'volume_create_manager' (4d9e8627-985c-4e3a-ac76-73c1b627ab93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:07 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-09ef25c2-cafb-4d77-87e7-1d58b9ac2835 tempest-VolumesCloneTest-1174830826 None] Created volume successfully.
Nov 04 01:00:08 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0 1073741824" returned: 0 in 0.775s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:08 devstack sudo[94412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0
Nov 04 01:00:08 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:08 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0" returned: 0 in 0.390s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:00:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb623a9c-7c1f-4669-ba82-507d5f661b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9810f1c-7308-4e2c-8672-98e72452e2d0', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a78852-a42a-424c-966d-5652135a2344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:08 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-731fbae4-07b6-4acf-9af1-097e7f19f3e9 req-78648a72-ebb1-4ed4-905f-84525d79f067 tempest-AttachVolumeTestJSON-488239250 None] Terminate volume connection completed successfully.
Nov 04 01:00:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-731fbae4-07b6-4acf-9af1-097e7f19f3e9 req-78648a72-ebb1-4ed4-905f-84525d79f067 tempest-AttachVolumeTestJSON-488239250 None] Deleting attachment 2c4c8a36-96ff-4c8c-96d3-53cbeee440a4. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:00:08 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Volume volume-b9810f1c-7308-4e2c-8672-98e72452e2d0 (b9810f1c-7308-4e2c-8672-98e72452e2d0): created successfully
Nov 04 01:00:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a78852-a42a-424c-966d-5652135a2344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Flow 'volume_create_manager' (c915fbb5-33a2-4cad-845e-22d637fb28d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:09 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-db63b34a-6549-4c48-bd8a-c6563926c646 tempest-AttachVolumeNegativeTest-1455147747 None] Created volume successfully.
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Flow 'volume_create_manager' (cd9d96af-84d6-490e-9825-4d03ee656b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50595761-a469-4928-b559-a2308f2bbe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50595761-a469-4928-b559-a2308f2bbe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-758039223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcfa6c66-74bc-4516-a0d5-b96381671c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3114ea544541e99b3acb5f5d84cd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=0c246029-bcae-42f0-969e-a4a8a8b021bc,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:10Z,use_quota=True,user_id='68210cf371df4163a49e66ef130a35ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b238f4-1f10-4e28-8f3a-decaec06b1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b238f4-1f10-4e28-8f3a-decaec06b1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6ef228-a223-46cf-978a-5f8beff2b6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6ef228-a223-46cf-978a-5f8beff2b6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fcfa6c66-74bc-4516-a0d5-b96381671c4d', 'volume_name': 'volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d', 'volume_size': 2, 'source_volid': '0c246029-bcae-42f0-969e-a4a8a8b021bc', 'source_volstatus': 'available'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7201031-4e17-4d41-9485-e68ee326e18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7201031-4e17-4d41-9485-e68ee326e18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7c993d-7d20-44bc-9c4f-3d9fe97122a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:10 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Volume fcfa6c66-74bc-4516-a0d5-b96381671c4d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d', 'volume_size': 2, 'source_volid': '0c246029-bcae-42f0-969e-a4a8a8b021bc', 'source_volstatus': 'available'}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:10 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Cloning volume 0c246029-bcae-42f0-969e-a4a8a8b021bc to volume fcfa6c66-74bc-4516-a0d5-b96381671c4d
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Creating offline snapshot 171fbde7-2523-4dfe-ba99-4bdca1467eed of volume 0c246029-bcae-42f0-969e-a4a8a8b021bc {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[06687ac6-1e41-408d-82c7-66a01dac28f4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:10 devstack sudo[94426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc
Nov 04 01:00:10 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:11 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc" returned: 0 in 0.556s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:11 devstack sudo[94440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed 1G
Nov 04 01:00:11 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-6f372f96-7fca-4954-9746-257268bf54e2 req-19975a73-59d7-4b70-8808-7f356007b164 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-e23df3af-af4e-4257-b2ee-cf54c9139817 req-6f67290d-ff16-49db-9f8b-6d5a7e3d5517 tempest-AttachVolumeTestJSON-488239250 None] Terminate volume connection completed successfully.
Nov 04 01:00:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-e23df3af-af4e-4257-b2ee-cf54c9139817 req-6f67290d-ff16-49db-9f8b-6d5a7e3d5517 tempest-AttachVolumeTestJSON-488239250 None] Deleting attachment 2aaa0d8f-9180-4d67-ae64-2e29883249d2. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:00:11 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed 1G" returned: 0 in 0.753s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c246029-bcae-42f0-969e-a4a8a8b021bc -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:11 devstack sudo[94455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c246029-bcae-42f0-969e-a4a8a8b021bc -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed
Nov 04 01:00:11 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:12 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c246029-bcae-42f0-969e-a4a8a8b021bc -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed" returned: 0 in 0.518s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:12 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed is being set with open permissions: ugo+rw
Nov 04 01:00:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:12 devstack sudo[94460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed
Nov 04 01:00:12 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:12 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed" returned: 0 in 0.455s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:12 devstack sudo[94465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.info
Nov 04 01:00:12 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:13 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.info" returned: 0 in 0.632s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:13 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.info is being set with open permissions: ugo+rw
Nov 04 01:00:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:13 devstack sudo[94489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.info
Nov 04 01:00:13 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:13 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.info" returned: 0 in 0.424s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Acquiring lock "cinder-quobyte-fcfa6c66-74bc-4516-a0d5-b96381671c4d" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Lock "cinder-quobyte-fcfa6c66-74bc-4516-a0d5-b96381671c4d" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] snapshot: 171fbde7-2523-4dfe-ba99-4bdca1467eed, volume: fcfa6c66-74bc-4516-a0d5-b96381671c4d,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 01:00:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:14 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08a8593-7eb2-4f88-99b5-f4643c834617]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:14 devstack sudo[94506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed
Nov 04 01:00:14 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:14 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed" returned: 0 in 0.896s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c246029-bcae-42f0-969e-a4a8a8b021bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:00:14 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63602e1-fd9b-462e-a399-0e3ac8afbdbd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:15 devstack sudo[94521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc
Nov 04 01:00:15 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:15 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc" returned: 0 in 0.716s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 01:00:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 01:00:15 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 01:00:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:15 devstack sudo[94571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d
Nov 04 01:00:15 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:15 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-b77bbadd-fd55-4686-ae1c-d0f91999996e req-10194347-2569-442a-9063-d963f0967a91 tempest-ServerActionsTestOtherA-2120743137 None] Terminate volume connection completed successfully.
Nov 04 01:00:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-b77bbadd-fd55-4686-ae1c-d0f91999996e req-10194347-2569-442a-9063-d963f0967a91 tempest-ServerActionsTestOtherA-2120743137 None] Deleting attachment 55c58e13-ecd9-403e-9f29-f80404b6af94. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:00:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-b77bbadd-fd55-4686-ae1c-d0f91999996e req-085fa290-048d-4263-bed6-ea39e2a73668 tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:23 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d" returned: 0 in 7.451s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc, size 1024.00 MB, duration 7.45 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:00:23 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Converted 1024.00 MB image at 137.41 MB/s
Nov 04 01:00:23 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d is being set with open permissions: ugo+rw
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:23 devstack sudo[94599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d
Nov 04 01:00:23 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:23 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d" returned: 0 in 0.235s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Lock "cinder-quobyte-fcfa6c66-74bc-4516-a0d5-b96381671c4d" released by "_copy_volume_from_snapshot" :: held 9.432s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Acquiring lock "cinder-quobyte-171fbde7-2523-4dfe-ba99-4bdca1467eed" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Lock "cinder-quobyte-171fbde7-2523-4dfe-ba99-4bdca1467eed" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Deleting offline snapshot 171fbde7-2523-4dfe-ba99-4bdca1467eed of volume 0c246029-bcae-42f0-969e-a4a8a8b021bc {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] snapshot_file for this snap is: volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53ce672-e694-45c7-8da8-05a635511637]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:23 devstack sudo[94602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed
Nov 04 01:00:23 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:23 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed" returned: 0 in 0.351s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c246029-bcae-42f0-969e-a4a8a8b021bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b942b0-da56-4f9c-b14a-8aef7d0fd41b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:23 devstack sudo[94607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc
Nov 04 01:00:23 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:24 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc" returned: 0 in 0.535s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:24 devstack sudo[94613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed
Nov 04 01:00:24 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:24 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed" returned: 0 in 0.305s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:24 devstack sudo[94618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed
Nov 04 01:00:24 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:24 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc.171fbde7-2523-4dfe-ba99-4bdca1467eed" returned: 0 in 0.229s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Lock "cinder-quobyte-171fbde7-2523-4dfe-ba99-4bdca1467eed" released by "_delete_snapshot" :: held 1.512s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.579s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-6f372f96-7fca-4954-9746-257268bf54e2 req-19975a73-59d7-4b70-8808-7f356007b164 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.621s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-6f372f96-7fca-4954-9746-257268bf54e2 req-19975a73-59d7-4b70-8808-7f356007b164 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-b77bbadd-fd55-4686-ae1c-d0f91999996e req-085fa290-048d-4263-bed6-ea39e2a73668 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.238s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7c993d-7d20-44bc-9c4f-3d9fe97122a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d', 'volume_size': 2, 'source_volid': '0c246029-bcae-42f0-969e-a4a8a8b021bc', 'source_volstatus': 'available'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da46840-f466-49b4-90d6-dffa0c40301c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:25 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Volume volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d (fcfa6c66-74bc-4516-a0d5-b96381671c4d): created successfully
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da46840-f466-49b4-90d6-dffa0c40301c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Flow 'volume_create_manager' (cd9d96af-84d6-490e-9825-4d03ee656b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-b77bbadd-fd55-4686-ae1c-d0f91999996e req-085fa290-048d-4263-bed6-ea39e2a73668 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.106s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-6f372f96-7fca-4954-9746-257268bf54e2 req-19975a73-59d7-4b70-8808-7f356007b164 tempest-AttachVolumeNegativeTest-1455147747 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-b9810f1c-7308-4e2c-8672-98e72452e2d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9dbf7d5-eb64-4b6a-b46f-6b043bb0cca8', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:00:25 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-17c006d8-e860-4519-8ede-8d0e3bb46a68 tempest-VolumesCloneTest-1174830826 None] Created volume successfully.
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-b77bbadd-fd55-4686-ae1c-d0f91999996e req-085fa290-048d-4263-bed6-ea39e2a73668 tempest-ServerActionsTestOtherA-2120743137 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c51d2cf-52f1-460e-89d2-bcc1cf88a219', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:00:25 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-6f372f96-7fca-4954-9746-257268bf54e2 req-19975a73-59d7-4b70-8808-7f356007b164 tempest-AttachVolumeNegativeTest-1455147747 None] attachment_update completed successfully.
Nov 04 01:00:25 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-b77bbadd-fd55-4686-ae1c-d0f91999996e req-085fa290-048d-4263-bed6-ea39e2a73668 tempest-ServerActionsTestOtherA-2120743137 None] attachment_update completed successfully.
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "cinder-1123b69f-a3fb-477c-ab6b-fa8389bb64c9-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-1123b69f-a3fb-477c-ab6b-fa8389bb64c9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "cinder-quobyte-1123b69f-a3fb-477c-ab6b-fa8389bb64c9" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-quobyte-1123b69f-a3fb-477c-ab6b-fa8389bb64c9" acquired by "delete_volume" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[461e55f7-72b3-4c29-8031-c3215182e0a0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:25 devstack sudo[94722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9
Nov 04 01:00:25 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Acquiring lock "cinder-fcfa6c66-74bc-4516-a0d5-b96381671c4d-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Lock "cinder-fcfa6c66-74bc-4516-a0d5-b96381671c4d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Acquiring lock "cinder-quobyte-fcfa6c66-74bc-4516-a0d5-b96381671c4d" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Lock "cinder-quobyte-fcfa6c66-74bc-4516-a0d5-b96381671c4d" acquired by "delete_volume" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbaa9a4-a8c8-40c3-9286-f6483d923ac3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:26 devstack sudo[95053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d
Nov 04 01:00:26 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:26 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9" returned: 0 in 0.651s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:26 devstack sudo[95069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9
Nov 04 01:00:26 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:26 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d" returned: 0 in 0.739s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:26 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1123b69f-a3fb-477c-ab6b-fa8389bb64c9" returned: 0 in 0.532s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:26 devstack sudo[95087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d
Nov 04 01:00:26 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-quobyte-1123b69f-a3fb-477c-ab6b-fa8389bb64c9" released by "delete_volume" :: held 1.268s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:26 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Created reservations ['b1083c50-9074-447f-96eb-a56ea9a41804', 'b2af5b58-0f7d-4889-9b65-a064dd8c36d1', 'bb6b18c9-30cb-41ab-b912-c1d4c6103780', '2df28382-933c-4235-9da6-ff18e88808d5'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:27 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fcfa6c66-74bc-4516-a0d5-b96381671c4d" returned: 0 in 0.337s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:27 devstack sudo[95090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Lock "cinder-quobyte-fcfa6c66-74bc-4516-a0d5-b96381671c4d" released by "delete_volume" :: held 1.187s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:27 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Created reservations ['05f1cd22-b62c-419f-9142-3e685af4bfa2', 'cf72a1ef-82ac-4bab-b26b-751d11d6f60c', 'db1c0893-ecbb-48c5-877a-aa3be80717dc', '0e0a1398-e067-4ad0-87d7-54e8b8439a54'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:27 devstack sudo[95094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:00:27 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:27 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.306s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:00:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Deleted volume successfully.
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e4263f2c-1aba-40a0-8dbd-98c8bcd5a15b tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-1123b69f-a3fb-477c-ab6b-fa8389bb64c9-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:27 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.274s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:00:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Deleted volume successfully.
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d365634e-9cc1-48eb-847d-8ce86eb65127 tempest-VolumesCloneTest-1174830826 None] Lock "cinder-fcfa6c66-74bc-4516-a0d5-b96381671c4d-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "cinder-07bc69e7-6942-4074-bbdf-37b8b9f1075a-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-07bc69e7-6942-4074-bbdf-37b8b9f1075a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "cinder-quobyte-07bc69e7-6942-4074-bbdf-37b8b9f1075a" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-quobyte-07bc69e7-6942-4074-bbdf-37b8b9f1075a" acquired by "delete_volume" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:28 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae5aa41-ec15-45a9-bac8-46117be21e29]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:28 devstack sudo[95100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a
Nov 04 01:00:28 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Acquiring lock "cinder-0c246029-bcae-42f0-969e-a4a8a8b021bc-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Lock "cinder-0c246029-bcae-42f0-969e-a4a8a8b021bc-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Acquiring lock "cinder-quobyte-0c246029-bcae-42f0-969e-a4a8a8b021bc" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Lock "cinder-quobyte-0c246029-bcae-42f0-969e-a4a8a8b021bc" acquired by "delete_volume" :: waited 0.064s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:28 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[216ad2f3-dd47-475e-a5da-d4f2da91f407]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:28 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a" returned: 0 in 0.760s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:28 devstack sudo[95106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a
Nov 04 01:00:28 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:28 devstack sudo[95104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc
Nov 04 01:00:28 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:29 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-07bc69e7-6942-4074-bbdf-37b8b9f1075a" returned: 0 in 0.395s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-quobyte-07bc69e7-6942-4074-bbdf-37b8b9f1075a" released by "delete_volume" :: held 1.264s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:29 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc" returned: 0 in 0.576s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Created reservations ['84d64675-f2f5-40b0-8efa-17fd70d3be40', '6aff58cb-632f-4a1b-9032-863056ef2f5c', '6f1f2a2f-6c66-4bb1-ba97-9cc576845c0e', 'f04c57a9-c56b-4ed4-8e6d-11a24c085397'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:00:29 devstack sudo[95113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc
Nov 04 01:00:29 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:29 devstack sudo[95115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:00:29 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:29 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c246029-bcae-42f0-969e-a4a8a8b021bc" returned: 0 in 0.457s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Lock "cinder-quobyte-0c246029-bcae-42f0-969e-a4a8a8b021bc" released by "delete_volume" :: held 1.169s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:29 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Created reservations ['02fcce28-8b5d-4e72-a96f-e9deb302cadf', 'f1bbfd4e-9951-4849-85fe-4379cf3e532e', 'd259702c-cfc7-4184-8e3b-b5b5c07abf0a', '472dba08-5475-4d6d-a541-37082d4fa4a2'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:00:30 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.513s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:00:30 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Deleted volume successfully.
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d1ac32e5-3bb3-497f-9b82-478c608842eb tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-07bc69e7-6942-4074-bbdf-37b8b9f1075a-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:30 devstack sudo[95120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:00:30 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:30 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.412s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "cinder-0d72c8d3-0d74-427e-a58e-5738ac25e789-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:30 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Deleted volume successfully.
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-0d72c8d3-0d74-427e-a58e-5738ac25e789-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b6dc85fb-ced1-4e41-a2e2-ba136ac4fb5d tempest-VolumesCloneTest-1174830826 None] Lock "cinder-0c246029-bcae-42f0-969e-a4a8a8b021bc-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "cinder-quobyte-0d72c8d3-0d74-427e-a58e-5738ac25e789" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-quobyte-0d72c8d3-0d74-427e-a58e-5738ac25e789" acquired by "delete_volume" :: waited 0.039s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb545a3e-30bb-47d3-a274-92b77c961934]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:31 devstack sudo[95124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789
Nov 04 01:00:31 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:31 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789" returned: 0 in 0.687s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:31 devstack sudo[95129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789
Nov 04 01:00:31 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:32 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0d72c8d3-0d74-427e-a58e-5738ac25e789" returned: 0 in 0.539s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-quobyte-0d72c8d3-0d74-427e-a58e-5738ac25e789" released by "delete_volume" :: held 1.318s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Created reservations ['a348be28-227e-4fd1-90a3-cc2163e7687e', '9f6d873d-0d03-4a15-945e-0cab21039dc1', 'bba38fa9-0190-4c5e-bb82-e20e26a4694a', '78fc4776-c2ff-4863-b774-b3a863acb9dc'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:32 devstack sudo[95132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:00:32 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:32 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.557s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:00:32 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Deleted volume successfully.
Nov 04 01:00:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0c9b13-2b00-4438-9a9d-f18fda8c76e6 tempest-AttachVolumeTestJSON-488239250 None] Lock "cinder-0d72c8d3-0d74-427e-a58e-5738ac25e789-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Flow 'volume_create_manager' (61f98fe0-dc39-4585-9bd7-5bf1b8a43ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e376c812-dd03-4839-a892-958caa929c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e376c812-dd03-4839-a892-958caa929c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1714734097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b369fad-c45c-4b4e-b1ec-ef3fd1291003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285998e7ac1d462fa4f5840059ebd4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:38Z,use_quota=True,user_id='a01e1af929d04f84a9b9dd72661e8ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0401146b-1740-411f-bd46-59d4c426364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0401146b-1740-411f-bd46-59d4c426364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d493c470-7bb9-47fc-99b2-7b5e4491d4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d493c470-7bb9-47fc-99b2-7b5e4491d4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b369fad-c45c-4b4e-b1ec-ef3fd1291003', 'volume_name': 'volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003', 'volume_size': 2}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360fa881-3d73-486c-be8c-d880f0e44e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360fa881-3d73-486c-be8c-d880f0e44e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20d7b7b-e32a-4cd8-b71f-b1a7e277a320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:37 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Volume 1b369fad-c45c-4b4e-b1ec-ef3fd1291003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003', 'volume_size': 2}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1714734097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b369fad-c45c-4b4e-b1ec-ef3fd1291003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285998e7ac1d462fa4f5840059ebd4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:38Z,use_quota=True,user_id='a01e1af929d04f84a9b9dd72661e8ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Creating volume 1b369fad-c45c-4b4e-b1ec-ef3fd1291003 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:00:37 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:00:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003 2147483648 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:37 devstack sudo[95161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003 2147483648
Nov 04 01:00:37 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:38 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003 2147483648" returned: 0 in 0.740s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:38 devstack sudo[95168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003
Nov 04 01:00:38 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:39 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003" returned: 0 in 0.317s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:00:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20d7b7b-e32a-4cd8-b71f-b1a7e277a320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003', 'volume_size': 2}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12f9aee-214e-4903-a29d-328433dc4437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:39 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Volume volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003 (1b369fad-c45c-4b4e-b1ec-ef3fd1291003): created successfully
Nov 04 01:00:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12f9aee-214e-4903-a29d-328433dc4437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Flow 'volume_create_manager' (61f98fe0-dc39-4585-9bd7-5bf1b8a43ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:39 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ffd74374-e4f2-4827-8e5e-316536cd5a2b tempest-VolumesCloneNegativeTest-868902550 None] Created volume successfully.
Nov 04 01:00:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Acquiring lock "cinder-1b369fad-c45c-4b4e-b1ec-ef3fd1291003-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Lock "cinder-1b369fad-c45c-4b4e-b1ec-ef3fd1291003-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Acquiring lock "cinder-quobyte-1b369fad-c45c-4b4e-b1ec-ef3fd1291003" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Lock "cinder-quobyte-1b369fad-c45c-4b4e-b1ec-ef3fd1291003" acquired by "delete_volume" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:40 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e55a4fc-eefc-48e6-a4c3-a14ebaf2fd17]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:40 devstack sudo[95213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003
Nov 04 01:00:40 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:41 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003" returned: 0 in 0.684s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:41 devstack sudo[95221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003
Nov 04 01:00:41 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:42 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b369fad-c45c-4b4e-b1ec-ef3fd1291003" returned: 0 in 0.972s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Lock "cinder-quobyte-1b369fad-c45c-4b4e-b1ec-ef3fd1291003" released by "delete_volume" :: held 1.744s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:42 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Created reservations ['b58c41ad-9cd8-4984-9b92-5c51cc9180ac', '01d4cc7a-2dfe-44ac-a2eb-2d0eb1472b09', 'e4a2911c-6e3d-48b4-af05-303750ae5009', '0129fec0-c289-409b-898e-0b0d86776724'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:00:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:42 devstack sudo[95225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:00:42 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:43 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.464s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:43 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:00:43 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Deleted volume successfully.
Nov 04 01:00:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77cd2aad-0c47-4c35-b86c-4b6d3aebf939 tempest-VolumesCloneNegativeTest-868902550 None] Lock "cinder-1b369fad-c45c-4b4e-b1ec-ef3fd1291003-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=97,cinder:UPDATE=97,cinder:INSERT=28,cinder:DELETE=10 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=114,cinder:UPDATE=108,cinder:INSERT=28,cinder:DELETE=7 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Flow 'volume_create_manager' (adcfb22c-6ba0-4592-9058-57418cebbf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922656ac-4993-409b-8418-bacaae2bcdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922656ac-4993-409b-8418-bacaae2bcdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1215626107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024aaca7-b3c6-419e-8740-16ac6029fd0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d61d12722e5c46929a20a593c1cf78d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:48Z,use_quota=True,user_id='dd0bac25aee347a7a796b57c747f70d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2bed63-0b6e-4037-8c43-6ab718eaf809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2bed63-0b6e-4037-8c43-6ab718eaf809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df62d9a-6efa-43a5-9934-9822eeaa9631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df62d9a-6efa-43a5-9934-9822eeaa9631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '024aaca7-b3c6-419e-8740-16ac6029fd0c', 'volume_name': 'volume-024aaca7-b3c6-419e-8740-16ac6029fd0c', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158be66b-4997-4347-b8ad-2310d5bab3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158be66b-4997-4347-b8ad-2310d5bab3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cd93be-1c1f-431e-a095-65904a5b9a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:48 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Volume 024aaca7-b3c6-419e-8740-16ac6029fd0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-024aaca7-b3c6-419e-8740-16ac6029fd0c', 'volume_size': 1}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1215626107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024aaca7-b3c6-419e-8740-16ac6029fd0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d61d12722e5c46929a20a593c1cf78d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:48Z,use_quota=True,user_id='dd0bac25aee347a7a796b57c747f70d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Creating volume 024aaca7-b3c6-419e-8740-16ac6029fd0c {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:00:48 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:48 devstack sudo[95270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c 1073741824
Nov 04 01:00:48 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:48 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c 1073741824" returned: 0 in 0.515s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:48 devstack sudo[95276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c
Nov 04 01:00:48 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:49 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c" returned: 0 in 0.276s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cd93be-1c1f-431e-a095-65904a5b9a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-024aaca7-b3c6-419e-8740-16ac6029fd0c', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a833bea-37c8-4c90-942c-0ef315d345f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:49 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Volume volume-024aaca7-b3c6-419e-8740-16ac6029fd0c (024aaca7-b3c6-419e-8740-16ac6029fd0c): created successfully
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a833bea-37c8-4c90-942c-0ef315d345f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Flow 'volume_create_manager' (adcfb22c-6ba0-4592-9058-57418cebbf47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:49 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-0f05e616-fd7f-44aa-9bcb-8674809cdbc2 req-80279ffb-6089-4890-88ea-de63f6353b50 tempest-VolumesGetTestJSON-1857716361 None] Created volume successfully.
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Acquiring lock "cinder-024aaca7-b3c6-419e-8740-16ac6029fd0c-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Lock "cinder-024aaca7-b3c6-419e-8740-16ac6029fd0c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Acquiring lock "cinder-quobyte-024aaca7-b3c6-419e-8740-16ac6029fd0c" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Lock "cinder-quobyte-024aaca7-b3c6-419e-8740-16ac6029fd0c" acquired by "delete_volume" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f32af70-9701-48e3-94d7-68cd6b12a0a7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Flow 'volume_create_manager' (c7da1386-4b86-4ffa-b444-75a182bed186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ecd952-2d43-456c-a36c-654c959c67d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ecd952-2d43-456c-a36c-654c959c67d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1046584161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cefc46-934f-40fd-b3fd-332b9abc7c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea425b5ea4048caa87799544a11c86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:50Z,use_quota=True,user_id='1b453387aec740f0b097ec0e5a5a3327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79868ff6-e1ee-4f5f-99ac-c1c2fb1fa10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79868ff6-e1ee-4f5f-99ac-c1c2fb1fa10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec933f06-a644-4495-a5a9-10b58068b28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec933f06-a644-4495-a5a9-10b58068b28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41cefc46-934f-40fd-b3fd-332b9abc7c53', 'volume_name': 'volume-41cefc46-934f-40fd-b3fd-332b9abc7c53', 'volume_size': 2}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fb6fd1-fc37-43f5-9b14-066b507455dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fb6fd1-fc37-43f5-9b14-066b507455dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7134586e-780b-407d-b93f-e90cd68225dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:50 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Volume 41cefc46-934f-40fd-b3fd-332b9abc7c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41cefc46-934f-40fd-b3fd-332b9abc7c53', 'volume_size': 2}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1046584161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cefc46-934f-40fd-b3fd-332b9abc7c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea425b5ea4048caa87799544a11c86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:50Z,use_quota=True,user_id='1b453387aec740f0b097ec0e5a5a3327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Creating volume 41cefc46-934f-40fd-b3fd-332b9abc7c53 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:00:50 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 2147483648 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:50 devstack sudo[95280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c
Nov 04 01:00:50 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:50 devstack sudo[95282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 2147483648
Nov 04 01:00:50 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:50 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c" returned: 0 in 0.401s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:50 devstack sudo[95291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c
Nov 04 01:00:50 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:50 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 2147483648" returned: 0 in 0.473s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:50 devstack sudo[95295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53
Nov 04 01:00:50 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:50 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-024aaca7-b3c6-419e-8740-16ac6029fd0c" returned: 0 in 0.277s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Lock "cinder-quobyte-024aaca7-b3c6-419e-8740-16ac6029fd0c" released by "delete_volume" :: held 0.745s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.quota [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Created reservations ['e5b79a04-b7e1-4d45-8ee9-5f24f041b149', '99556322-77f7-4783-8ec4-4634b5a583e1', '67b88d38-341f-4103-bd9e-db6f951f3d2e', 'eb9e4634-d66e-40a6-9c0d-c4a2c017b4ac'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:50 devstack sudo[95297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:00:50 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:50 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53" returned: 0 in 0.295s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7134586e-780b-407d-b93f-e90cd68225dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41cefc46-934f-40fd-b3fd-332b9abc7c53', 'volume_size': 2}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b58f1b1-f04d-48e4-89fc-271aaf9fbc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:50 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Volume volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 (41cefc46-934f-40fd-b3fd-332b9abc7c53): created successfully
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b58f1b1-f04d-48e4-89fc-271aaf9fbc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Flow 'volume_create_manager' (c7da1386-4b86-4ffa-b444-75a182bed186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:50 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-20a4d394-9239-49a0-a1be-81b0926f27d5 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Created volume successfully.
Nov 04 01:00:51 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.299s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:51 devstack cinder-volume[86660]: DEBUG cinder.manager [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:00:51 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Deleted volume successfully.
Nov 04 01:00:51 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-14d774fa-7b2f-414f-a5f3-9c0f3b1dd290 req-dea1ddae-f37b-4641-8db2-a9926ecdf536 tempest-VolumesGetTestJSON-1857716361 None] Lock "cinder-024aaca7-b3c6-419e-8740-16ac6029fd0c-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:00:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:51 devstack sudo[95301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:00:51 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:52 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.343s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:00:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:00:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:00:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:00:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Creating offline snapshot 966097f0-0366-42e8-a88c-c6b028d4dbe2 of volume 41cefc46-934f-40fd-b3fd-332b9abc7c53 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:00:52 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e46d73-e93a-4e41-ad44-1f08e2d04013]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:52 devstack sudo[95304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53
Nov 04 01:00:52 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:53 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53" returned: 0 in 0.551s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2 2G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:53 devstack sudo[95309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2 2G
Nov 04 01:00:53 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:53 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2 2G" returned: 0 in 0.548s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:53 devstack sudo[95315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2
Nov 04 01:00:53 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:53 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2" returned: 0 in 0.365s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:53 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2 is being set with open permissions: ugo+rw
Nov 04 01:00:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:53 devstack sudo[95323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2
Nov 04 01:00:53 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:54 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2" returned: 0 in 0.330s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:54 devstack sudo[95326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.info
Nov 04 01:00:54 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:54 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.info" returned: 0 in 0.340s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:54 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.info is being set with open permissions: ugo+rw
Nov 04 01:00:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:54 devstack sudo[95364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.info
Nov 04 01:00:54 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:54 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.info" returned: 0 in 0.307s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.582s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4356638f-8666-45a8-8d56-cd065f70a509 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Create snapshot completed successfully
Nov 04 01:00:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Acquiring lock "cinder-966097f0-0366-42e8-a88c-c6b028d4dbe2-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "cinder-966097f0-0366-42e8-a88c-c6b028d4dbe2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Acquiring lock "cinder-quobyte-41cefc46-934f-40fd-b3fd-332b9abc7c53" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "cinder-quobyte-41cefc46-934f-40fd-b3fd-332b9abc7c53" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Acquiring lock "cinder-quobyte-966097f0-0366-42e8-a88c-c6b028d4dbe2" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "cinder-quobyte-966097f0-0366-42e8-a88c-c6b028d4dbe2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Deleting offline snapshot 966097f0-0366-42e8-a88c-c6b028d4dbe2 of volume 41cefc46-934f-40fd-b3fd-332b9abc7c53 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:00:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] snapshot_file for this snap is: volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:00:55 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe3273f-8a96-411d-bf3d-a3f14cc7d320]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:56 devstack sudo[95379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2
Nov 04 01:00:56 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:56 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2" returned: 0 in 0.517s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41cefc46-934f-40fd-b3fd-332b9abc7c53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:00:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aed1ada-9a3b-4e20-877d-323db7a97845]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:56 devstack sudo[95408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53
Nov 04 01:00:56 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:56 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53" returned: 0 in 0.415s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:56 devstack sudo[95413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2
Nov 04 01:00:56 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2fdd577e-ebf0-4969-974f-d5e6cb7ea131 tempest-GroupsV314Test-1858255611 None] Group tempest-GroupsV314Test-Group-146524019: creating
Nov 04 01:00:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2fdd577e-ebf0-4969-974f-d5e6cb7ea131 tempest-GroupsV314Test-1858255611 None] Group tempest-GroupsV314Test-Group-146524019: created successfully
Nov 04 01:00:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2fdd577e-ebf0-4969-974f-d5e6cb7ea131 tempest-GroupsV314Test-1858255611 None] Create group completed successfully.
Nov 04 01:00:57 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2" returned: 0 in 0.506s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:57 devstack sudo[95420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2
Nov 04 01:00:57 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:57 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53.966097f0-0366-42e8-a88c-c6b028d4dbe2" returned: 0 in 0.259s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "cinder-quobyte-966097f0-0366-42e8-a88c-c6b028d4dbe2" released by "_delete_snapshot" :: held 1.886s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "cinder-quobyte-41cefc46-934f-40fd-b3fd-332b9abc7c53" released by "delete_snapshot" :: held 1.923s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:57 devstack cinder-volume[86660]: WARNING cinder.quota [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:00:57 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Created reservations ['e14177ab-4cd9-4045-9a35-086a3d61e3c8', '7a3dd121-eb6d-4869-aa79-469dfb78b06a', '4618f4bb-1cd8-43cf-9e2d-95296d15be24', '86e0e0c2-b252-443c-8510-b8a36710b624'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:00:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Delete snapshot completed successfully.
Nov 04 01:00:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1d151ed8-1592-431d-92bd-fc82594d1793 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "cinder-966097f0-0366-42e8-a88c-c6b028d4dbe2-delete_snapshot" released by "delete_snapshot" :: held 2.077s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-617c9675-1e18-4861-ad97-59fe11c833e7 tempest-ServerActionsTestOtherA-2120743137 None] Terminate volume connection completed successfully.
Nov 04 01:00:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-617c9675-1e18-4861-ad97-59fe11c833e7 tempest-ServerActionsTestOtherA-2120743137 None] Deleting attachment 8c51d2cf-52f1-460e-89d2-bcc1cf88a219. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Acquiring lock "cinder-41cefc46-934f-40fd-b3fd-332b9abc7c53-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "cinder-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "cinder-41cefc46-934f-40fd-b3fd-332b9abc7c53-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Lock "cinder-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Acquiring lock "cinder-quobyte-41cefc46-934f-40fd-b3fd-332b9abc7c53" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "cinder-quobyte-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "cinder-quobyte-41cefc46-934f-40fd-b3fd-332b9abc7c53" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Lock "cinder-quobyte-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a" acquired by "delete_volume" :: waited 0.049s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8743884-fb49-4c97-8802-7325378ecc90]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88b196f-1d9d-457e-854c-f5d205697e14]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:58 devstack sudo[95425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53
Nov 04 01:00:58 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:58 devstack sudo[95426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a
Nov 04 01:00:58 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "cinder-caa9ecc1-cdc1-4bc8-a22c-772c69c49346-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:58 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53" returned: 0 in 0.427s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Lock "cinder-caa9ecc1-cdc1-4bc8-a22c-772c69c49346-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:58 devstack sudo[95436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53
Nov 04 01:00:58 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:58 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "cinder-quobyte-caa9ecc1-cdc1-4bc8-a22c-772c69c49346" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a" returned: 0 in 0.515s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Lock "cinder-quobyte-caa9ecc1-cdc1-4bc8-a22c-772c69c49346" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:00:58 devstack sudo[95438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a
Nov 04 01:00:58 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3215af-1bca-443c-9228-372cb9fb6a42]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:58 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-41cefc46-934f-40fd-b3fd-332b9abc7c53" returned: 0 in 0.338s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:58 devstack sudo[95440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346
Nov 04 01:00:58 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "cinder-quobyte-41cefc46-934f-40fd-b3fd-332b9abc7c53" released by "delete_volume" :: held 0.858s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Created reservations ['0a0b2050-5e78-42e0-ab5e-5031c250ab08', '34e71731-3a8f-4af2-beed-3d51042e5750', '0efa9da3-fe9c-4ea6-80c9-3eb58430ab8d', '07b05623-0485-4484-96a8-87e0eb2e11f8'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:00:59 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a" returned: 0 in 0.406s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Lock "cinder-quobyte-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a" released by "delete_volume" :: held 0.997s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Flow 'volume_create_manager' (e3c60a0e-4c03-4040-91e1-6548ea2b087d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740f2d4a-1ead-4eba-b9c0-4ad626f3a0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740f2d4a-1ead-4eba-b9c0-4ad626f3a0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1595758510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55703b3c-549e-4c62-9379-4f0522198ca2,host='devstack@QuobyteHD#QuobyteHD',id=6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c824f819bcf6494b9026946194bbee82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:59Z,use_quota=True,user_id='f88658a0d0804a3593b919a82a041310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c49bb86-51ce-4c0e-af14-3789c8c6ecc1),volume_type_id=9c49bb86-51ce-4c0e-af14-3789c8c6ecc1)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:59 devstack sudo[95444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:00:59 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb3152c-8005-4ff5-ab64-549de102aa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb3152c-8005-4ff5-ab64-549de102aa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae90e93-2096-4ecc-ba59-f6e1e543efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae90e93-2096-4ecc-ba59-f6e1e543efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975', 'volume_name': 'volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7e4f93-ae5b-4b7f-a469-f219dff1f2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7e4f93-ae5b-4b7f-a469-f219dff1f2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fdd41cf-403a-453e-a1db-644d01b5e5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:00:59 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Volume 6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975', 'volume_size': 1}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=55703b3c-549e-4c62-9379-4f0522198ca2,created_at=2026-11-04T00:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1595758510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55703b3c-549e-4c62-9379-4f0522198ca2,host='devstack@QuobyteHD#QuobyteHD',id=6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c824f819bcf6494b9026946194bbee82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:00:59Z,use_quota=True,user_id='f88658a0d0804a3593b919a82a041310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c49bb86-51ce-4c0e-af14-3789c8c6ecc1),volume_type_id=9c49bb86-51ce-4c0e-af14-3789c8c6ecc1)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Creating volume 6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:00:59 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:59 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346" returned: 0 in 0.608s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:59 devstack sudo[95450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 1073741824
Nov 04 01:00:59 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:59 devstack sudo[95452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346
Nov 04 01:00:59 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.quota [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Created reservations ['a427fad5-c6ef-4509-a051-bd4c86b3f7d3', '065d0ab7-e0f8-4c94-b70d-d964d80d7980', '52592a83-513f-4f63-bc0d-98eb5b6308f2', '4a6c4dba-8997-470f-8449-80a4632dfc99'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:00:59 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.369s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:59 devstack sudo[95455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:00:59 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:00:59 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Deleted volume successfully.
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-32205a9c-d8bd-4c26-8165-7a7ff03500f7 tempest-VolumesSnapshotNegativeTestJSON-1913632370 None] Lock "cinder-41cefc46-934f-40fd-b3fd-332b9abc7c53-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:59 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-caa9ecc1-cdc1-4bc8-a22c-772c69c49346" returned: 0 in 0.340s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Lock "cinder-quobyte-caa9ecc1-cdc1-4bc8-a22c-772c69c49346" released by "delete_volume" :: held 1.011s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Created reservations ['3c6bf7f1-00c5-454d-8e60-e9f495c16c91', 'e7e416e8-eacd-46f0-9834-4f8a10fce891', 'e80132b4-bc93-4e71-8064-332e6248abf5', '0db7f2c9-7634-4e9a-a16c-72f16a3ef86b'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:00:59 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.301s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.manager [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:00:59 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Deleted volume successfully.
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-af40410f-ad5b-42b6-ae73-22319f91b67e req-3bf6c786-6ba8-4065-a182-074689004efc tempest-ServerActionsTestOtherA-2120743137 None] Lock "cinder-c34af302-bcc6-4c70-ad3f-23b0ca59ac2a-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:00:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:00 devstack sudo[95463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:01:00 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:00 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 1073741824" returned: 0 in 0.683s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:00 devstack sudo[95466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975
Nov 04 01:01:00 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:00 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.281s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:01:00 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Deleted volume successfully.
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd0f24fa-0b9b-4d0b-8031-8db0e9bd5cf3 tempest-ServerActionsTestOtherA-2120743137 None] Lock "cinder-caa9ecc1-cdc1-4bc8-a22c-772c69c49346-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:01:00 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975" returned: 0 in 0.264s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fdd41cf-403a-453e-a1db-644d01b5e5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd9e2dc-774d-489c-9892-022fda4729fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:00 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Volume volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 (6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975): created successfully
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd9e2dc-774d-489c-9892-022fda4729fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Flow 'volume_create_manager' (e3c60a0e-4c03-4040-91e1-6548ea2b087d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:01:00 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e48dd86a-9880-4fea-bf4a-9698fa618e30 tempest-GroupsV314Test-1858255611 None] Created volume successfully.
Nov 04 01:01:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:03 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Cloning volume 6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 to volume c5b87a6c-26dd-41ae-9019-e6f184bedaed
Nov 04 01:01:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Creating offline snapshot 5a4c7715-6f34-43d5-a6e2-fbf609275761 of volume 6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:01:03 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf37ed84-b004-4e17-9c91-e4a190263c3b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:03 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975
Nov 04 01:01:03 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:03 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975" returned: 0 in 0.478s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:03 devstack sudo[95501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761 1G
Nov 04 01:01:03 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:04 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761 1G" returned: 0 in 0.543s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:04 devstack sudo[95509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761
Nov 04 01:01:04 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:04 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761" returned: 0 in 0.416s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:04 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761 is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 01:01:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:04 devstack sudo[95562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761
Nov 04 01:01:04 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:05 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761" returned: 0 in 0.360s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:05 devstack sudo[95567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.info
Nov 04 01:01:05 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:05 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.info" returned: 0 in 0.299s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:05 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:05 devstack sudo[95570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.info
Nov 04 01:01:05 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:05 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.info" returned: 0 in 0.296s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Acquiring lock "cinder-quobyte-c5b87a6c-26dd-41ae-9019-e6f184bedaed" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Lock "cinder-quobyte-c5b87a6c-26dd-41ae-9019-e6f184bedaed" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] snapshot: 5a4c7715-6f34-43d5-a6e2-fbf609275761, volume: c5b87a6c-26dd-41ae-9019-e6f184bedaed,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c473f1b4-1fb9-48e7-8235-b45ba6aaa5de]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:06 devstack sudo[95575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761
Nov 04 01:01:06 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:06 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761" returned: 0 in 0.578s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:01:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cc21c5-f8de-474c-96ab-a4f557a9c14f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:06 devstack sudo[95584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975
Nov 04 01:01:06 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:07 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975" returned: 0 in 0.560s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 01:01:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 01:01:07 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 01:01:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:07 devstack sudo[95609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed
Nov 04 01:01:07 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:15 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=44,cinder:UPDATE=49,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:01:15 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=41,cinder:UPDATE=49,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:01:15 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed" returned: 0 in 8.900s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:15 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975, size 1024.00 MB, duration 8.90 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:01:15 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Converted 1024.00 MB image at 115.04 MB/s
Nov 04 01:01:15 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 01:01:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:15 devstack sudo[95649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed
Nov 04 01:01:15 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:16 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed" returned: 0 in 0.340s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Lock "cinder-quobyte-c5b87a6c-26dd-41ae-9019-e6f184bedaed" released by "_copy_volume_from_snapshot" :: held 10.487s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Acquiring lock "cinder-quobyte-5a4c7715-6f34-43d5-a6e2-fbf609275761" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Lock "cinder-quobyte-5a4c7715-6f34-43d5-a6e2-fbf609275761" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Deleting offline snapshot 5a4c7715-6f34-43d5-a6e2-fbf609275761 of volume 6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] snapshot_file for this snap is: volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99989e8-e87b-4dbf-bd72-e8f9a06c113a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:16 devstack sudo[95653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761
Nov 04 01:01:16 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:16 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761" returned: 0 in 0.429s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8e389f-a3cd-4fea-88b6-fea1316ceb63]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:17 devstack sudo[95658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975
Nov 04 01:01:17 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:17 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975" returned: 0 in 0.659s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:17 devstack sudo[95663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761
Nov 04 01:01:17 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:18 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761" returned: 0 in 0.572s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:18 devstack sudo[95673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761
Nov 04 01:01:18 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:18 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975.5a4c7715-6f34-43d5-a6e2-fbf609275761" returned: 0 in 0.277s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Lock "cinder-quobyte-5a4c7715-6f34-43d5-a6e2-fbf609275761" released by "_delete_snapshot" :: held 2.125s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:01:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.373s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:18 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8bf40074-0b8c-4d4f-9a7e-77d5504b3049 tempest-GroupsV314Test-1858255611 None] Create group from source-group-55703b3c-549e-4c62-9379-4f0522198ca2 completed successfully.
Nov 04 01:01:19 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-a1961b74-e1f6-43df-8601-a138d34b43ab req-bf609cea-9643-4db3-b987-7b4971f41695 tempest-AttachVolumeNegativeTest-1455147747 None] Terminate volume connection completed successfully.
Nov 04 01:01:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-a1961b74-e1f6-43df-8601-a138d34b43ab req-bf609cea-9643-4db3-b987-7b4971f41695 tempest-AttachVolumeNegativeTest-1455147747 None] Deleting attachment e9dbf7d5-eb64-4b6a-b46f-6b043bb0cca8. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:01:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Acquiring lock "cinder-quobyte-c5b87a6c-26dd-41ae-9019-e6f184bedaed" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:01:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Lock "cinder-quobyte-c5b87a6c-26dd-41ae-9019-e6f184bedaed" acquired by "delete_volume" :: waited 0.044s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:01:20 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[12032723-38ea-4403-a5bd-24db6b293e0c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:20 devstack sudo[95681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed
Nov 04 01:01:20 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:20 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed" returned: 0 in 0.512s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:20 devstack sudo[95687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed
Nov 04 01:01:20 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:20 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c5b87a6c-26dd-41ae-9019-e6f184bedaed" returned: 0 in 0.336s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Lock "cinder-quobyte-c5b87a6c-26dd-41ae-9019-e6f184bedaed" released by "delete_volume" :: held 0.975s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:01:21 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Created reservations ['8352193c-5300-463c-9c4c-662b970e109f'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:01:21 devstack cinder-volume[86660]: WARNING cinder.quota [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-498430556 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-498430556, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:01:21 devstack cinder-volume[86660]: WARNING cinder.quota [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-498430556 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-498430556, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:01:21 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Created reservations ['7234079a-7b1a-4e19-b4a9-36b8f07e4acd', 'a34f8264-3215-43a7-97ea-a3e8b7cf7a8b', '63ea67b4-af23-4714-ad5d-db4cecdfe0a8', '92992504-d7c1-465f-ae76-1e4e824cc650'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:01:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:01:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:01:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:21 devstack sudo[95710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:01:21 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:21 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.283s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:21 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:01:21 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1037e61b-bb2c-4d05-9976-8fe3e2c50fb1 tempest-GroupsV314Test-1858255611 None] Delete group completed successfully.
Nov 04 01:01:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Acquiring lock "cinder-quobyte-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:01:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Lock "cinder-quobyte-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975" acquired by "delete_volume" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:01:22 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[1577e64d-d187-4d31-8bd7-cf188513c34e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:23 devstack sudo[95714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975
Nov 04 01:01:23 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:23 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975" returned: 0 in 0.467s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:23 devstack sudo[95721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975
Nov 04 01:01:23 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:23 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975" returned: 0 in 0.318s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Lock "cinder-quobyte-6b2c1da7-a9ad-4ccc-94f3-9ba12b5cb975" released by "delete_volume" :: held 0.905s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:01:23 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Created reservations ['36724754-a3e3-44fa-8594-1f1cae5ed716'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:01:23 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Created reservations ['ba8d3c03-c977-4e5e-86c8-e2867f96c144', '0232190c-a027-44f3-b939-798cde93e4d2', 'ac252206-1caa-4cc9-8bae-c755572e55a8', 'c17ef875-5b2b-4358-9024-ae25e9829bcd'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:01:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:01:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:01:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:24 devstack sudo[95726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:01:24 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:24 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.316s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:24 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:01:24 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f87aac68-fe6b-4317-b850-92e5adc848ca tempest-GroupsV314Test-1858255611 None] Delete group completed successfully.
Nov 04 01:01:34 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=24,cinder:SELECT=19,cinder:INSERT=4 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:01:34 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=25,cinder:SELECT=19,cinder:INSERT=6 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Flow 'volume_create_manager' (7c14d43a-dfa8-436b-9b58-18b960da1533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f75955-3d1b-49c4-9aa8-e98c80d60cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f75955-3d1b-49c4-9aa8-e98c80d60cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-493179073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d11a416-eb54-4551-84d8-4b201fe972db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434759d09c0d4e4fbb222dff048beee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:01:40Z,use_quota=True,user_id='1f98645cd5c743798e51c3f304844069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b3ebd15-8e90-492c-b5be-46262234bd10),volume_type_id=0b3ebd15-8e90-492c-b5be-46262234bd10)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22824100-a1f5-44cd-a960-a30ba8ac09bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22824100-a1f5-44cd-a960-a30ba8ac09bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237cb187-c7c4-4a23-b4ea-297502668756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237cb187-c7c4-4a23-b4ea-297502668756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d11a416-eb54-4551-84d8-4b201fe972db', 'volume_name': 'volume-4d11a416-eb54-4551-84d8-4b201fe972db', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c81eeb-23cd-4a36-a766-13727241022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c81eeb-23cd-4a36-a766-13727241022e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc07743-4d5d-4186-96b4-4b5fbb8b0961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:39 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Volume 4d11a416-eb54-4551-84d8-4b201fe972db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d11a416-eb54-4551-84d8-4b201fe972db', 'volume_size': 1}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-493179073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d11a416-eb54-4551-84d8-4b201fe972db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434759d09c0d4e4fbb222dff048beee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:01:40Z,use_quota=True,user_id='1f98645cd5c743798e51c3f304844069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b3ebd15-8e90-492c-b5be-46262234bd10),volume_type_id=0b3ebd15-8e90-492c-b5be-46262234bd10)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Creating volume 4d11a416-eb54-4551-84d8-4b201fe972db {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:01:39 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:01:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:39 devstack sudo[95740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db 1073741824
Nov 04 01:01:39 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Flow 'volume_create_manager' (cdf0204d-85a8-47bd-8d6c-64a6644c10b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076dbf63-3bed-4ce5-b61f-eaa64beeaa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076dbf63-3bed-4ce5-b61f-eaa64beeaa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-953541663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202f8681-402b-459e-825b-beef0fdb3931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434759d09c0d4e4fbb222dff048beee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:01:40Z,use_quota=True,user_id='1f98645cd5c743798e51c3f304844069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4865dbd2-27d1-48b6-bb8a-7a71ac2678d7),volume_type_id=4865dbd2-27d1-48b6-bb8a-7a71ac2678d7)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be756e9d-119e-45bf-ac48-bcd2f5bba847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be756e9d-119e-45bf-ac48-bcd2f5bba847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a437eefc-4be2-43ca-b303-c5beeb98a6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a437eefc-4be2-43ca-b303-c5beeb98a6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202f8681-402b-459e-825b-beef0fdb3931', 'volume_name': 'volume-202f8681-402b-459e-825b-beef0fdb3931', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca8adf4-da8b-43c3-a3b7-f3ab29634c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca8adf4-da8b-43c3-a3b7-f3ab29634c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960dec2e-3455-4af2-a82e-5b471ef8e700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:40 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Volume 202f8681-402b-459e-825b-beef0fdb3931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202f8681-402b-459e-825b-beef0fdb3931', 'volume_size': 1}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:40 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db 1073741824" returned: 0 in 1.053s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Flow 'volume_create_manager' (8251bdf6-1e41-4620-9397-8e9f94a770ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a5e0be-a05c-4e7f-8e5a-48483c796d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a5e0be-a05c-4e7f-8e5a-48483c796d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2066869766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da5b054-b2b8-4d54-9a41-85d72c9f287d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da46637ac3644df7acc3995926568a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:01:41Z,use_quota=True,user_id='e224bc3a20d84c2488957b9e46aa34cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189ace20-9c09-43b3-ab3a-fdd0f5ee0ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189ace20-9c09-43b3-ab3a-fdd0f5ee0ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204a542c-a7fc-4e87-b53d-eaaad701ea35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204a542c-a7fc-4e87-b53d-eaaad701ea35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da5b054-b2b8-4d54-9a41-85d72c9f287d', 'volume_name': 'volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97012d3-c264-437f-a59e-6c946ba9e808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97012d3-c264-437f-a59e-6c946ba9e808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0eeb5e-d6aa-4dc7-b772-6314d7d96d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:41 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d', 'volume_size': 1}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:41 devstack sudo[95752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db
Nov 04 01:01:41 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:41 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db" returned: 0 in 0.481s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.096s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-953541663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202f8681-402b-459e-825b-beef0fdb3931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434759d09c0d4e4fbb222dff048beee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:01:40Z,use_quota=True,user_id='1f98645cd5c743798e51c3f304844069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4865dbd2-27d1-48b6-bb8a-7a71ac2678d7),volume_type_id=4865dbd2-27d1-48b6-bb8a-7a71ac2678d7)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Creating volume 202f8681-402b-459e-825b-beef0fdb3931 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:01:41 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:41 devstack sudo[95765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931 1073741824
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc07743-4d5d-4186-96b4-4b5fbb8b0961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d11a416-eb54-4551-84d8-4b201fe972db', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:41 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a14b9e2-83bb-43dd-bba4-806bd3f12340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:41 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Volume volume-4d11a416-eb54-4551-84d8-4b201fe972db (4d11a416-eb54-4551-84d8-4b201fe972db): created successfully
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a14b9e2-83bb-43dd-bba4-806bd3f12340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Flow 'volume_create_manager' (7c14d43a-dfa8-436b-9b58-18b960da1533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:01:41 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-141f2103-342d-4fb0-8570-40a60914a1d6 tempest-TestInstancesWithCinderVolumes-1562750928 None] Created volume successfully.
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Flow 'volume_create_manager' (dcbd7b7a-d8e8-40db-8623-95e67cad821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8572eced-ae34-4a28-ba0a-fc3484c7db6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8572eced-ae34-4a28-ba0a-fc3484c7db6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2063055862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a083e87-5f09-4c7d-b647-5ad5c3ac55aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434759d09c0d4e4fbb222dff048beee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:01:42Z,use_quota=True,user_id='1f98645cd5c743798e51c3f304844069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ed91c54-72a7-4940-aa06-f71572fd5f1b),volume_type_id=4ed91c54-72a7-4940-aa06-f71572fd5f1b)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966efd5a-6428-44d0-b051-ad4112f8c358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966efd5a-6428-44d0-b051-ad4112f8c358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d0f8a8-4f76-45cf-8d0f-7b43e1ddb1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:41 devstack cinder-volume[86660]: DEBUG cinder.image.glance [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Creating Keystone auth plugin from conf {{(pid=86660) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 01:01:42 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931 1073741824" returned: 0 in 0.926s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:42 devstack sudo[95777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931
Nov 04 01:01:42 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d0f8a8-4f76-45cf-8d0f-7b43e1ddb1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a083e87-5f09-4c7d-b647-5ad5c3ac55aa', 'volume_name': 'volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa', 'volume_size': 1, 'image_id': '074b0751-2bf3-471f-806c-751c58d071ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/074b0751-2bf3-471f-806c-751c58d071ec', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--240890187', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '434759d09c0d4e4fbb222dff048beee4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '074b0751-2bf3-471f-806c-751c58d071ec', 'created_at': datetime.datetime(2026, 11, 4, 0, 1, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 1, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/074b0751-2bf3-471f-806c-751c58d071ec/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b5477980b0>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4933ca03-d86f-4e31-b288-f9fc344f8f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4933ca03-d86f-4e31-b288-f9fc344f8f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367b253a-bcf1-499c-ace1-51b2ebc484b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:42 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Volume 8a083e87-5f09-4c7d-b647-5ad5c3ac55aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa', 'volume_size': 1, 'image_id': '074b0751-2bf3-471f-806c-751c58d071ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/074b0751-2bf3-471f-806c-751c58d071ec', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--240890187', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '434759d09c0d4e4fbb222dff048beee4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '074b0751-2bf3-471f-806c-751c58d071ec', 'created_at': datetime.datetime(2026, 11, 4, 0, 1, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 1, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/074b0751-2bf3-471f-806c-751c58d071ec/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b5477980b0>}
Nov 04 01:01:42 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Trying to clone 8a083e87-5f09-4c7d-b647-5ad5c3ac55aa from image 074b0751-2bf3-471f-806c-751c58d071ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/074b0751-2bf3-471f-806c-751c58d071ec', 'metadata': {}}]). {{(pid=86660) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 01:01:43 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931" returned: 0 in 0.508s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2066869766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da5b054-b2b8-4d54-9a41-85d72c9f287d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da46637ac3644df7acc3995926568a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:01:41Z,use_quota=True,user_id='e224bc3a20d84c2488957b9e46aa34cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Creating volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:01:43 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960dec2e-3455-4af2-a82e-5b471ef8e700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202f8681-402b-459e-825b-beef0fdb3931', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ddefff-36b4-43f0-9ebe-dc6c0fc208ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:43 devstack sudo[95783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d 1073741824
Nov 04 01:01:43 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:43 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Volume volume-202f8681-402b-459e-825b-beef0fdb3931 (202f8681-402b-459e-825b-beef0fdb3931): created successfully
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ddefff-36b4-43f0-9ebe-dc6c0fc208ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Flow 'volume_create_manager' (cdf0204d-85a8-47bd-8d6c-64a6644c10b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:01:43 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-551126b9-bbb6-4217-88f4-496c0b7f4867 tempest-TestInstancesWithCinderVolumes-1562750928 None] Created volume successfully.
Nov 04 01:01:43 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d 1073741824" returned: 0 in 0.792s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:44 devstack sudo[95807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d
Nov 04 01:01:44 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:44 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d" returned: 0 in 0.400s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:01:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0eeb5e-d6aa-4dc7-b772-6314d7d96d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fc7e67-4d29-48b7-8ec6-cf97354d6f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:01:44 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Volume volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d (6da5b054-b2b8-4d54-9a41-85d72c9f287d): created successfully
Nov 04 01:01:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fc7e67-4d29-48b7-8ec6-cf97354d6f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:01:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Flow 'volume_create_manager' (8251bdf6-1e41-4620-9397-8e9f94a770ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:01:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4983410f-6778-4f57-81ac-913ebe648a27 tempest-SnapshotsActionsTest-438073493 None] Created volume successfully.
Nov 04 01:01:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] Creating offline snapshot d34c7477-de06-4364-8742-024ed98db32d of volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:01:45 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedb86a2-11d7-45ad-9fcc-7407706da02e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:45 devstack sudo[95824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d
Nov 04 01:01:45 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:46 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d" returned: 0 in 0.581s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:46 devstack sudo[95829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d 1G
Nov 04 01:01:46 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:46 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d 1G" returned: 0 in 0.527s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:46 devstack sudo[95836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:01:46 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:47 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 0.408s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:47 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d is being set with open permissions: ugo+rw
Nov 04 01:01:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:47 devstack sudo[95843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:01:47 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:47 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 0.464s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:47 devstack sudo[95859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.info
Nov 04 01:01:47 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:48 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.info" returned: 0 in 0.648s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:48 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.info is being set with open permissions: ugo+rw
Nov 04 01:01:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:48 devstack sudo[95914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.info
Nov 04 01:01:48 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:49 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.info" returned: 0 in 0.788s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.633s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:49 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-05c65e92-c340-4898-8607-76775595966b tempest-SnapshotsActionsTest-438073493 None] Create snapshot completed successfully
Nov 04 01:01:49 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD, size 20.69 MB, duration 6.72 sec {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 01:01:49 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Image download 20.69 MB at 3.08 MB/s
Nov 04 01:01:49 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e244a4-ae6b-44c5-8fdd-30a961b7c170]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:49 devstack sudo[95956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD
Nov 04 01:01:49 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:50 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:50 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Temporary image 074b0751-2bf3-471f-806c-751c58d071ec is fetched for user 1f98645cd5c743798e51c3f304844069. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 01:01:50 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0256172-edb2-4acd-bb21-6311eb117d19]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:51 devstack sudo[95988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD
Nov 04 01:01:51 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:01:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:01:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:01:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:51 devstack sudo[96003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:01:51 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:52 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD" returned: 0 in 1.503s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2063055862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a083e87-5f09-4c7d-b647-5ad5c3ac55aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434759d09c0d4e4fbb222dff048beee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:01:42Z,use_quota=True,user_id='1f98645cd5c743798e51c3f304844069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ed91c54-72a7-4940-aa06-f71572fd5f1b),volume_type_id=4ed91c54-72a7-4940-aa06-f71572fd5f1b)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Creating volume 8a083e87-5f09-4c7d-b647-5ad5c3ac55aa {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:01:52 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:52 devstack sudo[96026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa 1073741824
Nov 04 01:01:52 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:52 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 1.206s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:01:53 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:01:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:01:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:01:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:01:53 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa 1073741824" returned: 0 in 1.156s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:53 devstack sudo[96040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa
Nov 04 01:01:53 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:54 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa" returned: 0 in 0.400s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:01:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.818s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:01:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] Creating offline snapshot f65f185b-3ddc-4649-89cf-b4d0872c83c8 of volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:01:54 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Attempting download of 074b0751-2bf3-471f-806c-751c58d071ec ((None, [{'url': 'file:///opt/stack/data/glance/images/074b0751-2bf3-471f-806c-751c58d071ec', 'metadata': {}}])) to volume 8a083e87-5f09-4c7d-b647-5ad5c3ac55aa. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 01:01:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70a95dd-b1de-4caf-9715-a81c63e1ad4f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e887d244-44c6-4ad0-833e-5f795d2f4036]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_074b0751-2bf3-471f-806c-751c58d071ec_wp1rvacq {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:54 devstack sudo[96044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:01:54 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:54 devstack sudo[96045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_074b0751-2bf3-471f-806c-751c58d071ec_wp1rvacq
Nov 04 01:01:54 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:55 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_074b0751-2bf3-471f-806c-751c58d071ec_wp1rvacq" returned: 0 in 0.663s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_074b0751-2bf3-471f-806c-751c58d071ec_wp1rvacq {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:55 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 0.849s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:01:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:55 devstack sudo[96056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8 1G
Nov 04 01:01:55 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:55 devstack sudo[96055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_074b0751-2bf3-471f-806c-751c58d071ec_wp1rvacq
Nov 04 01:01:55 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:55 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_074b0751-2bf3-471f-806c-751c58d071ec_wp1rvacq" returned: 1 in 0.585s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_074b0751-2bf3-471f-806c-751c58d071ec_wp1rvacq' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:01:55 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fe5940-ebc9-4849-b214-45aae4ee0c0b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:56 devstack sudo[96063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD
Nov 04 01:01:56 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:56 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8 1G" returned: 0 in 1.217s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:56 devstack sudo[96067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8
Nov 04 01:01:56 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:56 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD" returned: 0 in 1.063s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:56 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] 074b0751-2bf3-471f-806c-751c58d071ec was qcow2, converting to qcow2 {{(pid=86660) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 01:01:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:56 devstack sudo[96074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa
Nov 04 01:01:56 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:57 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8" returned: 0 in 0.705s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:57 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8 is being set with open permissions: ugo+rw
Nov 04 01:01:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:01:57 devstack sudo[96079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8
Nov 04 01:01:57 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:01:57 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root
Nov 04 01:01:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8" returned: 0 in 0.722s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:01:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.830s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:01:58 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d7445a73-eafc-43b2-a2bb-daf23fc62add tempest-SnapshotsActionsTest-438073493 None] Create snapshot completed successfully
Nov 04 01:01:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-f65f185b-3ddc-4649-89cf-b4d0872c83c8-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:01:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-f65f185b-3ddc-4649-89cf-b4d0872c83c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:01:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:01:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:01:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-quobyte-f65f185b-3ddc-4649-89cf-b4d0872c83c8" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:01:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-f65f185b-3ddc-4649-89cf-b4d0872c83c8" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:01:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Deleting offline snapshot f65f185b-3ddc-4649-89cf-b4d0872c83c8 of volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:01:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] snapshot_file for this snap is: volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:01:59 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[689dc65d-57c7-43c5-add3-1e574991bd8e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:01:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:00 devstack sudo[96090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8
Nov 04 01:02:00 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:00 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa" returned: 0 in 3.641s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:00 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_074b0751-2bf3-471f-806c-751c58d071ec_58mtfccodevstack@QuobyteHD, size 112.00 MB, duration 3.64 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:02:00 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Converted 112.00 MB image at 30.74 MB/s
Nov 04 01:02:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:00 devstack sudo[96097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa 1G
Nov 04 01:02:00 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:00 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8" returned: 0 in 0.825s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:00 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf1cac9-3a3b-4131-9f4b-a98d198ff5ac]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:01 devstack sudo[96103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:02:01 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:01 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa 1G" returned: 0 in 0.626s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Downloaded image 074b0751-2bf3-471f-806c-751c58d071ec ((None, [{'url': 'file:///opt/stack/data/glance/images/074b0751-2bf3-471f-806c-751c58d071ec', 'metadata': {}}])) to volume 8a083e87-5f09-4c7d-b647-5ad5c3ac55aa successfully. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Temporary image 074b0751-2bf3-471f-806c-751c58d071ec for user 1f98645cd5c743798e51c3f304844069 is deleted. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Marking volume 8a083e87-5f09-4c7d-b647-5ad5c3ac55aa as bootable. {{(pid=86660) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Copying metadata from image 074b0751-2bf3-471f-806c-751c58d071ec to 8a083e87-5f09-4c7d-b647-5ad5c3ac55aa. {{(pid=86660) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Creating volume glance metadata for volume 8a083e87-5f09-4c7d-b647-5ad5c3ac55aa backed by image 074b0751-2bf3-471f-806c-751c58d071ec with: {'image_id': '074b0751-2bf3-471f-806c-751c58d071ec', 'image_name': 'tempest-scenario-img--240890187', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86660) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367b253a-bcf1-499c-ace1-51b2ebc484b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa', 'volume_size': 1, 'image_id': '074b0751-2bf3-471f-806c-751c58d071ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/074b0751-2bf3-471f-806c-751c58d071ec', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--240890187', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '434759d09c0d4e4fbb222dff048beee4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '074b0751-2bf3-471f-806c-751c58d071ec', 'created_at': datetime.datetime(2026, 11, 4, 0, 1, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 1, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/074b0751-2bf3-471f-806c-751c58d071ec/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b5477980b0>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628f1919-0d8e-4be9-83d4-e44ef3166f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Volume volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa (8a083e87-5f09-4c7d-b647-5ad5c3ac55aa): created successfully
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628f1919-0d8e-4be9-83d4-e44ef3166f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Flow 'volume_create_manager' (dcbd7b7a-d8e8-40db-8623-95e67cad821f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:02:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3f0c16e0-f7f1-453a-9c12-a7bae4a02904 tempest-TestInstancesWithCinderVolumes-1562750928 None] Created volume successfully.
Nov 04 01:02:01 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 0.936s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:01 devstack sudo[96124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8
Nov 04 01:02:01 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:02 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8" returned: 0 in 0.872s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:02 devstack sudo[96150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8
Nov 04 01:02:02 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:02 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.f65f185b-3ddc-4649-89cf-b4d0872c83c8" returned: 0 in 0.381s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-f65f185b-3ddc-4649-89cf-b4d0872c83c8" released by "_delete_snapshot" :: held 3.193s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" released by "delete_snapshot" :: held 3.255s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:03 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Created reservations ['ae0fa39f-6f09-4bea-ad8b-794467311ef1', 'a948f2c3-eeac-4821-af52-d6d725f90b94', '5bf59b16-d036-4a40-9fea-be4066b42886', 'd246c570-5c7d-40f6-adff-7b02c34a3e36'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:02:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Delete snapshot completed successfully.
Nov 04 01:02:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-56934df2-8d38-4e72-8a6c-c3091133d985 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-f65f185b-3ddc-4649-89cf-b4d0872c83c8-delete_snapshot" released by "delete_snapshot" :: held 3.570s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] Creating offline snapshot 622503ef-e86d-40c6-b7c5-b74f21c0a512 of volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:02:04 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bbd619-1416-4b7d-a33f-5d143e26396a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:05 devstack sudo[96160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:02:05 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:05 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 0.965s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:06 devstack sudo[96200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512 1G
Nov 04 01:02:06 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:07 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512 1G" returned: 0 in 1.353s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:07 devstack sudo[96216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512
Nov 04 01:02:07 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-113a941c-dd28-47e5-95ab-b701a49ec935 req-9042ee4e-0ba1-42e0-92bf-fe31e192f499 tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:08 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512" returned: 0 in 0.738s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:08 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512 is being set with open permissions: ugo+rw
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:08 devstack sudo[96269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512
Nov 04 01:02:08 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Flow 'volume_create_manager' (385253bb-fa94-4c73-90bb-1e510bd8851b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bbd936-1ffa-4211-853a-c68ee76d0320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bbd936-1ffa-4211-853a-c68ee76d0320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1970806494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1e3d6e-8a3e-411f-bd61-9d12580fa671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdda9c19d7e74531b34e6f79b4996a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:02:08Z,use_quota=True,user_id='d213446a490740bd940878a70c66f2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5d9844-bab2-4f2d-97d8-5ddd6706a7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5d9844-bab2-4f2d-97d8-5ddd6706a7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da322aa-4715-4b3b-adac-d1c9824eb7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da322aa-4715-4b3b-adac-d1c9824eb7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1e3d6e-8a3e-411f-bd61-9d12580fa671', 'volume_name': 'volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7adf2ae8-e83f-442e-94dc-6ee6c41d0c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7adf2ae8-e83f-442e-94dc-6ee6c41d0c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02dba80-db7a-4884-8764-288da7b33241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:08 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Volume 9d1e3d6e-8a3e-411f-bd61-9d12580fa671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671', 'volume_size': 1}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:08 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512" returned: 0 in 0.676s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.990s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-113a941c-dd28-47e5-95ab-b701a49ec935 req-9042ee4e-0ba1-42e0-92bf-fe31e192f499 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.080s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-113a941c-dd28-47e5-95ab-b701a49ec935 req-9042ee4e-0ba1-42e0-92bf-fe31e192f499 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.410s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1970806494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1e3d6e-8a3e-411f-bd61-9d12580fa671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdda9c19d7e74531b34e6f79b4996a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:02:08Z,use_quota=True,user_id='d213446a490740bd940878a70c66f2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Creating volume 9d1e3d6e-8a3e-411f-bd61-9d12580fa671 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:02:08 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:08 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d145f00a-6db8-4252-9641-921a2ed307b1 tempest-SnapshotsActionsTest-438073493 None] Create snapshot completed successfully
Nov 04 01:02:08 devstack sudo[96282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671 1073741824
Nov 04 01:02:08 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-113a941c-dd28-47e5-95ab-b701a49ec935 req-9042ee4e-0ba1-42e0-92bf-fe31e192f499 tempest-TestInstancesWithCinderVolumes-1562750928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6174135-e3e3-4164-bd39-2f35d7db7ab2', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:02:09 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-113a941c-dd28-47e5-95ab-b701a49ec935 req-9042ee4e-0ba1-42e0-92bf-fe31e192f499 tempest-TestInstancesWithCinderVolumes-1562750928 None] attachment_update completed successfully.
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-622503ef-e86d-40c6-b7c5-b74f21c0a512-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-622503ef-e86d-40c6-b7c5-b74f21c0a512-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-quobyte-622503ef-e86d-40c6-b7c5-b74f21c0a512" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-622503ef-e86d-40c6-b7c5-b74f21c0a512" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Deleting offline snapshot 622503ef-e86d-40c6-b7c5-b74f21c0a512 of volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] snapshot_file for this snap is: volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf602758-1281-4c3d-b794-a91ccdb292a3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:09 devstack sudo[96287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512
Nov 04 01:02:09 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:09 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671 1073741824" returned: 0 in 0.748s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:09 devstack sudo[96289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671
Nov 04 01:02:09 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:09 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512" returned: 0 in 0.433s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8ae007-6c4d-45ef-8dce-5986eb603c76]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:10 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671" returned: 0 in 0.401s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:02:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02dba80-db7a-4884-8764-288da7b33241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12518761-652f-42ca-840f-d96a52db807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:10 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Volume volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671 (9d1e3d6e-8a3e-411f-bd61-9d12580fa671): created successfully
Nov 04 01:02:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12518761-652f-42ca-840f-d96a52db807d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Flow 'volume_create_manager' (385253bb-fa94-4c73-90bb-1e510bd8851b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:02:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-33dfe4aa-5f1f-4b0b-940c-26c9e2628bcf tempest-ServerRescueNegativeTestJSON-1620551735 None] Created volume successfully.
Nov 04 01:02:10 devstack sudo[96294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:02:10 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:10 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 0.605s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:10 devstack sudo[96302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512
Nov 04 01:02:10 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:11 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512" returned: 0 in 0.486s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:11 devstack sudo[96408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512
Nov 04 01:02:11 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:11 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.622503ef-e86d-40c6-b7c5-b74f21c0a512" returned: 0 in 0.854s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-622503ef-e86d-40c6-b7c5-b74f21c0a512" released by "_delete_snapshot" :: held 2.622s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" released by "delete_snapshot" :: held 2.665s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:12 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Created reservations ['e91ecc1b-61c3-47f6-933c-c167d161c079', 'd6f0e8c2-ca36-4672-b5bc-81ee1b9d0623', '4437f5f8-697e-474f-80e9-cc3398ecd617', 'ef2c1923-0cd7-4933-bc67-5067382162d9'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:02:12 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Delete snapshot completed successfully.
Nov 04 01:02:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-49aab8ca-e898-4efc-ad01-d7f914270fca tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-622503ef-e86d-40c6-b7c5-b74f21c0a512-delete_snapshot" released by "delete_snapshot" :: held 3.070s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] Creating offline snapshot 32e77777-4b46-4de9-b8d7-5d009aad8ae1 of volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:02:13 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2f7139-f8c0-4785-99e1-04d579063639]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:13 devstack sudo[96797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:02:13 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:14 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 0.797s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:14 devstack sudo[96809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1 1G
Nov 04 01:02:14 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:15 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1 1G" returned: 0 in 1.122s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:15 devstack sudo[96827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1
Nov 04 01:02:15 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:16 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1" returned: 0 in 0.995s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:16 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1 is being set with open permissions: ugo+rw
Nov 04 01:02:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:16 devstack sudo[96859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1
Nov 04 01:02:16 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:17 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1" returned: 0 in 0.675s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.847s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c59243dd-9f92-4259-84b7-a6a56c0363a5 tempest-SnapshotsActionsTest-438073493 None] Create snapshot completed successfully
Nov 04 01:02:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-32e77777-4b46-4de9-b8d7-5d009aad8ae1-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-32e77777-4b46-4de9-b8d7-5d009aad8ae1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-quobyte-32e77777-4b46-4de9-b8d7-5d009aad8ae1" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-32e77777-4b46-4de9-b8d7-5d009aad8ae1" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Deleting offline snapshot 32e77777-4b46-4de9-b8d7-5d009aad8ae1 of volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:02:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] snapshot_file for this snap is: volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:02:18 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc35be3-68e8-426b-a13f-8fa159123723]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:18 devstack sudo[96875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1
Nov 04 01:02:18 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:19 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1" returned: 0 in 0.876s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:19 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d2b1e4-b99d-490b-b959-fe1d6d6c56a4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:19 devstack sudo[96889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:02:19 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:20 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 1.140s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:20 devstack sudo[96899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1
Nov 04 01:02:20 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:21 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1" returned: 0 in 1.102s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:21 devstack sudo[96939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1
Nov 04 01:02:21 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Flow 'volume_create_manager' (ec70f083-a61e-4eb5-ac75-bf51e1fe017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5795e2-e0c7-46f0-aad0-2d44afaaf370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5795e2-e0c7-46f0-aad0-2d44afaaf370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1237005266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366fd6a5-f79b-47d8-a5e0-80b55b3b679d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ea705d59b04c6ab165707d70ff94d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:02:22Z,use_quota=True,user_id='37bd9b62ae6f4cffa72e9b090607f0d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0761b9-8c6c-4b1d-a14d-d39221d94220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0761b9-8c6c-4b1d-a14d-d39221d94220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c4d668-4a08-4540-bd11-9a309823507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c4d668-4a08-4540-bd11-9a309823507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '366fd6a5-f79b-47d8-a5e0-80b55b3b679d', 'volume_name': 'volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cf3c74-4776-42a5-9f2a-2678c62551cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cf3c74-4776-42a5-9f2a-2678c62551cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b86e0a-1cc7-468b-85e2-1135458fb56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:21 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Volume 366fd6a5-f79b-47d8-a5e0-80b55b3b679d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d', 'volume_size': 1}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1237005266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366fd6a5-f79b-47d8-a5e0-80b55b3b679d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ea705d59b04c6ab165707d70ff94d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:02:22Z,use_quota=True,user_id='37bd9b62ae6f4cffa72e9b090607f0d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Creating volume 366fd6a5-f79b-47d8-a5e0-80b55b3b679d {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:02:21 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:02:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:21 devstack sudo[96941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d 1073741824
Nov 04 01:02:21 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:22 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.32e77777-4b46-4de9-b8d7-5d009aad8ae1" returned: 0 in 0.820s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-32e77777-4b46-4de9-b8d7-5d009aad8ae1" released by "_delete_snapshot" :: held 4.281s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" released by "delete_snapshot" :: held 4.384s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:22 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Created reservations ['f73cc18a-2856-45ee-98ce-af0fa6e83bd0', '997530ce-93b6-4e25-b815-f045750dbe90', '56459e9b-542d-48cc-ae47-e9cdb60c598a', '4b791c6b-6eef-4e18-9922-7de10c844f15'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:02:22 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d 1073741824" returned: 0 in 0.966s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:23 devstack sudo[96948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d
Nov 04 01:02:23 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:23 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Delete snapshot completed successfully.
Nov 04 01:02:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-39dd016c-6186-4dd2-b862-a1c519fef6e0 tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-32e77777-4b46-4de9-b8d7-5d009aad8ae1-delete_snapshot" released by "delete_snapshot" :: held 4.951s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:23 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d" returned: 0 in 0.601s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:02:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b86e0a-1cc7-468b-85e2-1135458fb56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63761e1b-2529-4fbe-b38f-4fac6f6e0edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:23 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Volume volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d (366fd6a5-f79b-47d8-a5e0-80b55b3b679d): created successfully
Nov 04 01:02:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63761e1b-2529-4fbe-b38f-4fac6f6e0edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Flow 'volume_create_manager' (ec70f083-a61e-4eb5-ac75-bf51e1fe017d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:02:23 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9c393f5a-513b-454e-98bd-8a81c5c41747 tempest-AttachVolumeNegativeTest-1455147747 None] Created volume successfully.
Nov 04 01:02:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] Creating offline snapshot ac897c67-1a33-4de2-8191-038656be417a of volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:02:24 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecd8a69-7fbf-4359-ae6a-7b7111507655]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:25 devstack sudo[96981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:02:25 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:25 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 0.894s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:25 devstack sudo[97000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a 1G
Nov 04 01:02:25 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-fe355385-0b30-44ed-956a-82b4b2015ba3 req-d95862b4-bad1-425a-9821-95739ffd746e tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:26 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a 1G" returned: 0 in 0.685s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:26 devstack sudo[97006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a
Nov 04 01:02:26 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:27 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a" returned: 0 in 0.629s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:27 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a is being set with open permissions: ugo+rw
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:27 devstack sudo[97012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a
Nov 04 01:02:27 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Acquiring lock "cinder-9d1e3d6e-8a3e-411f-bd61-9d12580fa671-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Lock "cinder-9d1e3d6e-8a3e-411f-bd61-9d12580fa671-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:27 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Acquiring lock "cinder-quobyte-9d1e3d6e-8a3e-411f-bd61-9d12580fa671" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a" returned: 0 in 0.411s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.856s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Lock "cinder-quobyte-9d1e3d6e-8a3e-411f-bd61-9d12580fa671" acquired by "delete_volume" :: waited 0.102s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-fe355385-0b30-44ed-956a-82b4b2015ba3 req-d95862b4-bad1-425a-9821-95739ffd746e tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.769s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[710dd01b-c1c4-4d07-b8ff-ddb5d93d2606]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-fe355385-0b30-44ed-956a-82b4b2015ba3 req-d95862b4-bad1-425a-9821-95739ffd746e tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.067s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-54930668-c881-46d7-a9cd-dbd518718a4f tempest-SnapshotsActionsTest-438073493 None] Create snapshot completed successfully
Nov 04 01:02:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-fe355385-0b30-44ed-956a-82b4b2015ba3 req-d95862b4-bad1-425a-9821-95739ffd746e tempest-AttachVolumeNegativeTest-1455147747 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7ca9c8a-b450-4b70-a122-47743182c2fb', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:02:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-fe355385-0b30-44ed-956a-82b4b2015ba3 req-d95862b4-bad1-425a-9821-95739ffd746e tempest-AttachVolumeNegativeTest-1455147747 None] attachment_update completed successfully.
Nov 04 01:02:27 devstack sudo[97015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671
Nov 04 01:02:27 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-ac897c67-1a33-4de2-8191-038656be417a-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-ac897c67-1a33-4de2-8191-038656be417a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Acquiring lock "cinder-quobyte-ac897c67-1a33-4de2-8191-038656be417a" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-ac897c67-1a33-4de2-8191-038656be417a" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Deleting offline snapshot ac897c67-1a33-4de2-8191-038656be417a of volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] snapshot_file for this snap is: volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f5144e-fbca-4130-9749-5d927988f719]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:28 devstack sudo[97019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a
Nov 04 01:02:28 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:28 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671" returned: 0 in 1.339s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:28 devstack sudo[97025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671
Nov 04 01:02:28 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:29 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a" returned: 0 in 1.304s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:29 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d1e3d6e-8a3e-411f-bd61-9d12580fa671" returned: 0 in 0.871s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:29 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[46debd8b-0105-4361-b58d-beedbe6c5d40]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Lock "cinder-quobyte-9d1e3d6e-8a3e-411f-bd61-9d12580fa671" released by "delete_volume" :: held 2.344s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Created reservations ['88f37d1c-6316-4700-bc50-7d5553f43874', '331e924c-2b69-4ce7-9626-b562272fa474', '4bf7adaa-56ee-43c1-9205-3062e7a80c21', '9a9a47eb-c437-4653-9642-bcce0d04435e'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:02:30 devstack sudo[97031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:02:30 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:30 devstack sudo[97034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:02:30 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:30 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.381s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:02:30 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Deleted volume successfully.
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4587e6bd-93fb-45ae-ae6c-a98a455cd048 tempest-ServerRescueNegativeTestJSON-1620551735 None] Lock "cinder-9d1e3d6e-8a3e-411f-bd61-9d12580fa671-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:30 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 1.055s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:30 devstack sudo[97064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a
Nov 04 01:02:30 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:31 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a" returned: 0 in 0.676s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:31 devstack sudo[97071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a
Nov 04 01:02:31 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:32 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-fdefc162-67e7-4d66-b0c7-ebd9158ea4eb req-6db0afd3-7998-4dc4-af0b-ce7e0566d921 tempest-AttachVolumeNegativeTest-1455147747 None] Terminate volume connection completed successfully.
Nov 04 01:02:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-fdefc162-67e7-4d66-b0c7-ebd9158ea4eb req-6db0afd3-7998-4dc4-af0b-ce7e0566d921 tempest-AttachVolumeNegativeTest-1455147747 None] Deleting attachment a7ca9c8a-b450-4b70-a122-47743182c2fb. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:02:32 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.ac897c67-1a33-4de2-8191-038656be417a" returned: 0 in 0.642s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-ac897c67-1a33-4de2-8191-038656be417a" released by "_delete_snapshot" :: held 4.005s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" released by "delete_snapshot" :: held 4.084s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:32 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Created reservations ['273ca40f-7c3d-4ddc-83ab-caa696729338', '360abad5-2e39-47c1-9ca5-a2dec9bfcb5d', 'a671da6a-95a0-4d99-b7d1-f447e3ede794', 'ccbd45c8-c509-4053-9cb1-612c28fa5879'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:02:32 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Delete snapshot completed successfully.
Nov 04 01:02:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c36c8aad-19c6-4630-9e33-d7d376d5a06f tempest-SnapshotsActionsTest-1896813821 None] Lock "cinder-ac897c67-1a33-4de2-8191-038656be417a-delete_snapshot" released by "delete_snapshot" :: held 4.570s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "cinder-d34c7477-de06-4364-8742-024ed98db32d-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Lock "cinder-d34c7477-de06-4364-8742-024ed98db32d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "cinder-quobyte-d34c7477-de06-4364-8742-024ed98db32d" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Lock "cinder-quobyte-d34c7477-de06-4364-8742-024ed98db32d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Deleting offline snapshot d34c7477-de06-4364-8742-024ed98db32d of volume 6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:02:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] snapshot_file for this snap is: volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:02:33 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[40294fc9-c742-4525-8d18-86f11175f71c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:34 devstack sudo[97105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:02:34 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:34 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 0.852s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:02:34 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e05b133-2cb4-4bcd-9971-9971a47a3851]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:35 devstack sudo[97120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d
Nov 04 01:02:35 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:35 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d" returned: 0 in 0.900s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:35 devstack sudo[97137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:02:35 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:36 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 0.803s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:36 devstack sudo[97147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d
Nov 04 01:02:36 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:36 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d.d34c7477-de06-4364-8742-024ed98db32d" returned: 0 in 0.362s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:36 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=63,cinder:UPDATE=59,cinder:DELETE=6,cinder:INSERT=14 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:02:36 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=58,cinder:SELECT=76,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:02:37 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Lock "cinder-quobyte-d34c7477-de06-4364-8742-024ed98db32d" released by "_delete_snapshot" :: held 3.169s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:37 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" released by "delete_snapshot" :: held 3.221s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:37 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Created reservations ['504e4d1f-4e2d-422c-9e23-f4e1797723bc', 'dcecaaa0-a404-413b-ac80-70c2b1ff3062', 'ed4fb9f6-114f-4928-a543-d40a587460cb', 'c578c690-2fbb-420d-98f0-354e9270b4b5'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:02:37 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Delete snapshot completed successfully.
Nov 04 01:02:37 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9b318adc-e02e-4821-b4fd-43d678687c80 tempest-SnapshotsActionsTest-438073493 None] Lock "cinder-d34c7477-de06-4364-8742-024ed98db32d-delete_snapshot" released by "delete_snapshot" :: held 3.472s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "cinder-6da5b054-b2b8-4d54-9a41-85d72c9f287d-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Lock "cinder-6da5b054-b2b8-4d54-9a41-85d72c9f287d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" acquired by "delete_volume" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:38 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[36150437-a9d1-416d-9e78-b77cd91c3ce6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:38 devstack sudo[97179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d
Nov 04 01:02:38 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:38 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d" returned: 0 in 0.420s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:38 devstack sudo[97185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d
Nov 04 01:02:38 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:39 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6da5b054-b2b8-4d54-9a41-85d72c9f287d" returned: 0 in 0.302s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Lock "cinder-quobyte-6da5b054-b2b8-4d54-9a41-85d72c9f287d" released by "delete_volume" :: held 0.825s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Created reservations ['44ac1199-6362-4b60-aad8-f28ced836986', '087818ad-6af5-4e95-8158-6c3fa401568e', 'f4b980bb-45bc-45c5-ae2d-2fd5f271f208', 'a0093ab3-c408-4a1d-8a47-2cd480a5fcde'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:39 devstack sudo[97188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:02:39 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:39 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.316s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:02:39 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Deleted volume successfully.
Nov 04 01:02:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c306ccb4-c978-484a-905d-472de2bde074 tempest-SnapshotsActionsTest-438073493 None] Lock "cinder-6da5b054-b2b8-4d54-9a41-85d72c9f287d-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:02:49 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=10,cinder:INSERT=6,cinder:UPDATE=12 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:02:49 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:02:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-b177b96c-a7b5-4de4-bd65-b905f7c5db9c req-ac95b01e-df5c-4bde-b801-4a2a0ec63108 tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-b177b96c-a7b5-4de4-bd65-b905f7c5db9c req-ac95b01e-df5c-4bde-b801-4a2a0ec63108 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-b177b96c-a7b5-4de4-bd65-b905f7c5db9c req-ac95b01e-df5c-4bde-b801-4a2a0ec63108 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-b177b96c-a7b5-4de4-bd65-b905f7c5db9c req-ac95b01e-df5c-4bde-b801-4a2a0ec63108 tempest-TestInstancesWithCinderVolumes-1562750928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-4d11a416-eb54-4551-84d8-4b201fe972db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8570a2db-27df-456e-8796-5abc45e116b8', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:02:51 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-b177b96c-a7b5-4de4-bd65-b905f7c5db9c req-ac95b01e-df5c-4bde-b801-4a2a0ec63108 tempest-TestInstancesWithCinderVolumes-1562750928 None] attachment_update completed successfully.
Nov 04 01:02:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:02:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:02:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:02:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:51 devstack sudo[97308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:02:51 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Flow 'volume_create_manager' (f186db40-b4c1-434a-8f73-0b0fca9a6972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1238bcef-5543-4061-a9a5-a3a294a7804d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1238bcef-5543-4061-a9a5-a3a294a7804d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-96660618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1336ce1c-2c40-4fd4-8eeb-033f158caf35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f28438f1d347e8bce9bee907696d32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:02:52Z,use_quota=True,user_id='894245386548467d95d82e66e21f34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8d7dd1-bd61-452b-83cf-5de9cbc6b449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8d7dd1-bd61-452b-83cf-5de9cbc6b449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515cfd90-e2b1-4617-84ff-eb95c9b290c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515cfd90-e2b1-4617-84ff-eb95c9b290c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1336ce1c-2c40-4fd4-8eeb-033f158caf35', 'volume_name': 'volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90be6388-93b6-4bd1-973a-3e4f1d9959b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:52 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90be6388-93b6-4bd1-973a-3e4f1d9959b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eafe971-3bc3-4cc8-a29d-94c449b573c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:52 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Volume 1336ce1c-2c40-4fd4-8eeb-033f158caf35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35', 'volume_size': 1}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-96660618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1336ce1c-2c40-4fd4-8eeb-033f158caf35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f28438f1d347e8bce9bee907696d32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:02:52Z,use_quota=True,user_id='894245386548467d95d82e66e21f34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Creating volume 1336ce1c-2c40-4fd4-8eeb-033f158caf35 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:02:52 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.892s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:02:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:02:52 devstack sudo[97316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 1073741824
Nov 04 01:02:52 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:53 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 1073741824" returned: 0 in 0.968s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:53 devstack sudo[97328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35
Nov 04 01:02:53 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:54 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35" returned: 0 in 0.419s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:02:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:54 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eafe971-3bc3-4cc8-a29d-94c449b573c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:54 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb02238-8883-437c-b5fb-73204c099be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:02:54 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Volume volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 (1336ce1c-2c40-4fd4-8eeb-033f158caf35): created successfully
Nov 04 01:02:54 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb02238-8883-437c-b5fb-73204c099be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:02:54 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Flow 'volume_create_manager' (f186db40-b4c1-434a-8f73-0b0fca9a6972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:02:54 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-888a911a-d5a6-4279-9d1c-8ac65f411204 req-70ee0474-5b48-44e3-a742-7b2a9b34e7d6 tempest-VolumesSnapshotsTestJSON-1468452794 None] Created volume successfully.
Nov 04 01:02:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-1d020722-1807-434c-87ff-ea382408815f req-a3c8caaa-5833-49c0-9471-d91f8bc9182c tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-1d020722-1807-434c-87ff-ea382408815f req-a3c8caaa-5833-49c0-9471-d91f8bc9182c tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-1d020722-1807-434c-87ff-ea382408815f req-a3c8caaa-5833-49c0-9471-d91f8bc9182c tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:02:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:02:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] Creating offline snapshot 93aab18c-ac1e-4921-96c7-eab9a9e15817 of volume 1336ce1c-2c40-4fd4-8eeb-033f158caf35 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:02:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-1d020722-1807-434c-87ff-ea382408815f req-a3c8caaa-5833-49c0-9471-d91f8bc9182c tempest-TestInstancesWithCinderVolumes-1562750928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-202f8681-402b-459e-825b-beef0fdb3931', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fb1a004-d154-4037-bb54-8981381a5451', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:02:55 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f8d870-a3ee-44ad-8dd1-f430746fb6ee]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-1d020722-1807-434c-87ff-ea382408815f req-a3c8caaa-5833-49c0-9471-d91f8bc9182c tempest-TestInstancesWithCinderVolumes-1562750928 None] attachment_update completed successfully.
Nov 04 01:02:55 devstack sudo[97342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35
Nov 04 01:02:55 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:56 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35" returned: 0 in 0.858s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:56 devstack sudo[97350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817 1G
Nov 04 01:02:56 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:56 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817 1G" returned: 0 in 0.560s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:57 devstack sudo[97356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817
Nov 04 01:02:57 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:57 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817" returned: 0 in 0.506s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:57 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817 is being set with open permissions: ugo+rw
Nov 04 01:02:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:57 devstack sudo[97370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817
Nov 04 01:02:57 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:57 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817" returned: 0 in 0.378s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:58 devstack sudo[97373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.info
Nov 04 01:02:58 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:58 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.info" returned: 0 in 0.309s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:58 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.info is being set with open permissions: ugo+rw
Nov 04 01:02:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:02:58 devstack sudo[97376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.info
Nov 04 01:02:58 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:02:58 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root
Nov 04 01:02:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.info" returned: 0 in 0.298s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:02:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.114s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:02:58 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-5b169206-4d1c-4b05-a46b-bb1d47fb4ab8 req-feb6ce3b-7541-497f-b66a-28487804bbf4 tempest-VolumesSnapshotsTestJSON-1468452794 None] Create snapshot completed successfully
Nov 04 01:02:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Acquiring lock "cinder-93aab18c-ac1e-4921-96c7-eab9a9e15817-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "cinder-93aab18c-ac1e-4921-96c7-eab9a9e15817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Acquiring lock "cinder-quobyte-1336ce1c-2c40-4fd4-8eeb-033f158caf35" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "cinder-quobyte-1336ce1c-2c40-4fd4-8eeb-033f158caf35" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Acquiring lock "cinder-quobyte-93aab18c-ac1e-4921-96c7-eab9a9e15817" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:02:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "cinder-quobyte-93aab18c-ac1e-4921-96c7-eab9a9e15817" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:02:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Deleting offline snapshot 93aab18c-ac1e-4921-96c7-eab9a9e15817 of volume 1336ce1c-2c40-4fd4-8eeb-033f158caf35 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:02:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] snapshot_file for this snap is: volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:02:59 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca8a595-91cc-4228-8f6e-13a1b564c369]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:02:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:00 devstack sudo[97379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817
Nov 04 01:03:00 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:00 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817" returned: 0 in 0.467s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:03:00 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b79637-d565-44e8-bdf9-45d44f22dfbd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:00 devstack sudo[97391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35
Nov 04 01:03:00 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:00 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35" returned: 0 in 0.505s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:00 devstack sudo[97407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817
Nov 04 01:03:00 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:01 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817" returned: 0 in 0.512s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:01 devstack sudo[97419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817
Nov 04 01:03:01 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:01 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35.93aab18c-ac1e-4921-96c7-eab9a9e15817" returned: 0 in 0.419s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "cinder-quobyte-93aab18c-ac1e-4921-96c7-eab9a9e15817" released by "_delete_snapshot" :: held 2.067s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "cinder-quobyte-1336ce1c-2c40-4fd4-8eeb-033f158caf35" released by "delete_snapshot" :: held 2.116s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:02 devstack cinder-volume[86660]: DEBUG cinder.quota [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Created reservations ['84ee99d5-9d1f-4f93-8c01-280b8d478bdf', '8f1e03a7-defd-418a-b03d-125be4f5021a', '5a40679d-2ec5-43b7-80c0-afeb51eeb108', '4c13f6f1-128e-43e4-b5ce-6bcf7a1eee1d'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:03:02 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Delete snapshot completed successfully.
Nov 04 01:03:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-410628c3-9edc-4970-b462-b4e6ae35809d req-3fb20ef5-7907-4dd0-a107-d3d984907534 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "cinder-93aab18c-ac1e-4921-96c7-eab9a9e15817-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:02 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-27679252-9318-4d8f-b53b-b79a227913b3 req-47ec0ba9-118e-4e05-a6fa-9c1bf990017f tempest-TestInstancesWithCinderVolumes-1562750928 None] Terminate volume connection completed successfully.
Nov 04 01:03:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-27679252-9318-4d8f-b53b-b79a227913b3 req-47ec0ba9-118e-4e05-a6fa-9c1bf990017f tempest-TestInstancesWithCinderVolumes-1562750928 None] Deleting attachment 8570a2db-27df-456e-8796-5abc45e116b8. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "cinder-4d11a416-eb54-4551-84d8-4b201fe972db-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-4d11a416-eb54-4551-84d8-4b201fe972db-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "cinder-quobyte-4d11a416-eb54-4551-84d8-4b201fe972db" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-quobyte-4d11a416-eb54-4551-84d8-4b201fe972db" acquired by "delete_volume" :: waited 0.034s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4e5ed3-7e20-476f-a589-5f91ab8c8a63]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Acquiring lock "cinder-1336ce1c-2c40-4fd4-8eeb-033f158caf35-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "cinder-1336ce1c-2c40-4fd4-8eeb-033f158caf35-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Acquiring lock "cinder-quobyte-1336ce1c-2c40-4fd4-8eeb-033f158caf35" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:03 devstack sudo[97428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "cinder-quobyte-1336ce1c-2c40-4fd4-8eeb-033f158caf35" acquired by "delete_volume" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:03 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ddf475-6f5b-42cc-855a-1a239ad264fa]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:03 devstack sudo[97430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35
Nov 04 01:03:03 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:03 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db" returned: 0 in 0.642s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:03 devstack sudo[97435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db
Nov 04 01:03:03 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:04 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35" returned: 0 in 0.586s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:04 devstack sudo[97442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35
Nov 04 01:03:04 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:04 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4d11a416-eb54-4551-84d8-4b201fe972db" returned: 0 in 0.463s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-quobyte-4d11a416-eb54-4551-84d8-4b201fe972db" released by "delete_volume" :: held 1.227s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:04 devstack cinder-volume[86660]: WARNING cinder.quota [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1716743836-761128457 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1716743836-761128457, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:03:04 devstack cinder-volume[86660]: WARNING cinder.quota [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1716743836-761128457 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1716743836-761128457, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Created reservations ['504caa6b-d975-4003-b9fb-640d3c31be2a', 'b93baa22-eed1-4e4a-8c40-b3726933d573', '08eeccd1-b23b-41b6-88c5-c2207b3de595', 'e6d8d702-d3bb-4764-bf9c-88f422f9435a'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:04 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1336ce1c-2c40-4fd4-8eeb-033f158caf35" returned: 0 in 0.477s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:04 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:03:04 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "cinder-quobyte-1336ce1c-2c40-4fd4-8eeb-033f158caf35" released by "delete_volume" :: held 1.198s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG cinder.quota [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Created reservations ['d4157247-3236-4b96-a7fd-92421f4a3fb7', 'ba67f5e1-9f3c-4dc0-97be-b728773b978e', '898ccf5f-1d54-49bd-87c0-cffdf5f52e20', 'c590462b-a967-48d1-9b4d-c06e715ff3ae'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:04 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.343s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:04 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:03:04 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Deleted volume successfully.
Nov 04 01:03:04 devstack sudo[97449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:03:04 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bf8604e-b93a-47c6-91d4-0dc11245a1ef tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-4d11a416-eb54-4551-84d8-4b201fe972db-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:05 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.362s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:05 devstack cinder-volume[86660]: DEBUG cinder.manager [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:03:05 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Deleted volume successfully.
Nov 04 01:03:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ef1c19fb-7d7b-4552-9ce1-16816c435003 req-6140036e-a912-4312-a09f-a107b450f7c9 tempest-VolumesSnapshotsTestJSON-1468452794 None] Lock "cinder-1336ce1c-2c40-4fd4-8eeb-033f158caf35-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:07 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-4da8534d-0d28-4d29-a8e0-60f803dfa918 req-f669afd6-ef68-4ccf-be6c-236e30ec397a tempest-TestInstancesWithCinderVolumes-1562750928 None] Terminate volume connection completed successfully.
Nov 04 01:03:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-4da8534d-0d28-4d29-a8e0-60f803dfa918 req-f669afd6-ef68-4ccf-be6c-236e30ec397a tempest-TestInstancesWithCinderVolumes-1562750928 None] Deleting attachment 1fb1a004-d154-4037-bb54-8981381a5451. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:03:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "cinder-202f8681-402b-459e-825b-beef0fdb3931-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-202f8681-402b-459e-825b-beef0fdb3931-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "cinder-quobyte-202f8681-402b-459e-825b-beef0fdb3931" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-quobyte-202f8681-402b-459e-825b-beef0fdb3931" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:08 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cf71a4-3e6e-461d-9de7-c947d18ccd3b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:08 devstack sudo[97530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931
Nov 04 01:03:08 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:09 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931" returned: 0 in 0.443s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:09 devstack sudo[97536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931
Nov 04 01:03:09 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:09 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-202f8681-402b-459e-825b-beef0fdb3931" returned: 0 in 0.282s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-quobyte-202f8681-402b-459e-825b-beef0fdb3931" released by "delete_volume" :: held 0.828s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:09 devstack cinder-volume[86660]: WARNING cinder.quota [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1917159625-674335869 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1917159625-674335869, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:03:09 devstack cinder-volume[86660]: WARNING cinder.quota [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1917159625-674335869 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1917159625-674335869, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:03:09 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Created reservations ['d5010a6f-20f4-4015-bb8b-f6ab5d438077', '3044af5d-575e-4be6-b459-d6c59879aaf3', '3c617a99-7c9a-41d4-a35d-c6a2f9a4b43d', '37daa267-9520-4780-a5fa-390ecc7153bd'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:03:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:09 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:03:09 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:10 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.361s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:10 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:03:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Deleted volume successfully.
Nov 04 01:03:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-734ccb86-944a-4202-a74d-9bc86b51abf3 tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-202f8681-402b-459e-825b-beef0fdb3931-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eebead34-9b8f-4648-9e36-f7cfffefbb6f tempest-BackendsCapabilitiesAdminTestsJSON-1904536167 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6460418701172, 'free_capacity_gb': 1773.6460418701172, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86660) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 04 01:03:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-804edbda-d104-4384-a458-e685d00a1a70 tempest-BackendsCapabilitiesAdminTestsJSON-1904536167 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6460418701172, 'free_capacity_gb': 1773.6460418701172, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86660) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 04 01:03:13 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-bdc6faae-dd0c-4083-96c3-de737df19e61 req-b3943cb5-80b3-4ce0-857f-dee0310f8f15 tempest-TestInstancesWithCinderVolumes-1562750928 None] Terminate volume connection completed successfully.
Nov 04 01:03:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-bdc6faae-dd0c-4083-96c3-de737df19e61 req-b3943cb5-80b3-4ce0-857f-dee0310f8f15 tempest-TestInstancesWithCinderVolumes-1562750928 None] Deleting attachment e6174135-e3e3-4164-bd39-2f35d7db7ab2. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:03:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "cinder-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "cinder-quobyte-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-quobyte-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:14 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a21f0f7-9692-4b87-8598-d0096a9876b8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:14 devstack sudo[97575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa
Nov 04 01:03:14 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:15 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa" returned: 0 in 0.508s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:15 devstack sudo[97580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa
Nov 04 01:03:15 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:15 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa" returned: 0 in 0.332s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-quobyte-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa" released by "delete_volume" :: held 0.892s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:15 devstack cinder-volume[86660]: WARNING cinder.quota [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406836970-1236259180 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406836970-1236259180, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:03:15 devstack cinder-volume[86660]: WARNING cinder.quota [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406836970-1236259180 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406836970-1236259180, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:03:15 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Created reservations ['1231b098-0006-4fe5-a150-f3c235640b45', '32309c8d-1b35-4757-aae5-0c8df4d068e5', 'cc0d2609-0f2e-408a-a932-d4f23dd7edfd', 'ca4d5754-ae96-456c-8e4a-e9461bf74af4'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:03:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:15 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:03:15 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:16 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.412s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:16 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:03:16 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Deleted volume successfully.
Nov 04 01:03:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd345867-7134-4658-aa50-e69bbbf39c1c tempest-TestInstancesWithCinderVolumes-1562750928 None] Lock "cinder-8a083e87-5f09-4c7d-b647-5ad5c3ac55aa-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Flow 'volume_create_manager' (7e6d5501-5b7a-40da-8dfd-9569d3c74d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5338b54e-9c2b-418c-a2df-2cd76e3bc798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5338b54e-9c2b-418c-a2df-2cd76e3bc798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1413158801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d49f84-5e01-49d9-86bf-f7b8161147e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ea705d59b04c6ab165707d70ff94d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:03:18Z,use_quota=True,user_id='37bd9b62ae6f4cffa72e9b090607f0d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5923e023-4880-407b-89c6-06b983e2dd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5923e023-4880-407b-89c6-06b983e2dd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b814232-332c-4787-8c7c-837b9a201ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b814232-332c-4787-8c7c-837b9a201ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d49f84-5e01-49d9-86bf-f7b8161147e4', 'volume_name': 'volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bec92b-e920-410f-aba1-31a47d1cf7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bec92b-e920-410f-aba1-31a47d1cf7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e7e2a2-a42d-4b56-8f15-5a98481602dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:17 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Volume e4d49f84-5e01-49d9-86bf-f7b8161147e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4', 'volume_size': 1}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1413158801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d49f84-5e01-49d9-86bf-f7b8161147e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ea705d59b04c6ab165707d70ff94d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:03:18Z,use_quota=True,user_id='37bd9b62ae6f4cffa72e9b090607f0d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Creating volume e4d49f84-5e01-49d9-86bf-f7b8161147e4 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:03:17 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:03:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:17 devstack sudo[97596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4 1073741824
Nov 04 01:03:17 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:18 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4 1073741824" returned: 0 in 0.668s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:18 devstack sudo[97602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4
Nov 04 01:03:18 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:18 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4" returned: 0 in 0.342s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:03:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e7e2a2-a42d-4b56-8f15-5a98481602dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e0b2a9-3a9d-49c4-93c2-63ced13f2749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:18 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Volume volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4 (e4d49f84-5e01-49d9-86bf-f7b8161147e4): created successfully
Nov 04 01:03:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e0b2a9-3a9d-49c4-93c2-63ced13f2749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Flow 'volume_create_manager' (7e6d5501-5b7a-40da-8dfd-9569d3c74d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:03:18 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e56b222e-39a8-4ef8-8178-dfccf1647493 tempest-AttachVolumeNegativeTest-1455147747 None] Created volume successfully.
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Flow 'volume_create_manager' (3de2e81c-82e1-4eb7-9e6e-9f7f984f36f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354c690b-47cd-41f9-9c3b-34272c32899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354c690b-47cd-41f9-9c3b-34272c32899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1283106696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9bf10b-6911-40a4-be07-79b9cd8e5826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40f416eada34f619f5e4797e85e739f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:03:21Z,use_quota=True,user_id='acb3c3f5eaaa41efb59521eaf8aa3627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48c5f5c-c549-4e98-bc39-5cf630e1ec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48c5f5c-c549-4e98-bc39-5cf630e1ec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861d7a65-f4ab-468c-b5fd-2a59b90dac53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG cinder.image.glance [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Creating Keystone auth plugin from conf {{(pid=86660) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-550147f2-d40b-49f1-bca0-180f4abc215c req-80d73e3a-1be5-4335-9a4e-04dad30308b3 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-550147f2-d40b-49f1-bca0-180f4abc215c req-80d73e3a-1be5-4335-9a4e-04dad30308b3 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-550147f2-d40b-49f1-bca0-180f4abc215c req-80d73e3a-1be5-4335-9a4e-04dad30308b3 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-550147f2-d40b-49f1-bca0-180f4abc215c req-80d73e3a-1be5-4335-9a4e-04dad30308b3 tempest-AttachVolumeNegativeTest-1455147747 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12a803df-663e-4936-8760-232041a2dc8f', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:03:20 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-550147f2-d40b-49f1-bca0-180f4abc215c req-80d73e3a-1be5-4335-9a4e-04dad30308b3 tempest-AttachVolumeNegativeTest-1455147747 None] attachment_update completed successfully.
Nov 04 01:03:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861d7a65-f4ab-468c-b5fd-2a59b90dac53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b9bf10b-6911-40a4-be07-79b9cd8e5826', 'volume_name': 'volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b5476f1280>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07617309-f53b-4ee2-93c4-478c68119401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07617309-f53b-4ee2-93c4-478c68119401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885da694-4d3e-453a-8be3-eebff1edce59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:21 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Volume 6b9bf10b-6911-40a4-be07-79b9cd8e5826: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b5476f1280>}
Nov 04 01:03:21 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Trying to clone 6b9bf10b-6911-40a4-be07-79b9cd8e5826 from image feeea883-a973-4c2d-b14e-c13d05c107a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]). {{(pid=86660) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 01:03:22 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 01:03:22 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Image download 20.69 MB at 20.69 MB/s
Nov 04 01:03:22 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1dc932-336e-4f66-a633-7a36de7f8a9b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:22 devstack sudo[98035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD
Nov 04 01:03:22 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:22 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:22 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Temporary image feeea883-a973-4c2d-b14e-c13d05c107a4 is fetched for user acb3c3f5eaaa41efb59521eaf8aa3627. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 01:03:22 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[90226198-ea85-4300-b5b1-ef1c8cae0a64]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:23 devstack sudo[98041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD
Nov 04 01:03:23 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:23 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1283106696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9bf10b-6911-40a4-be07-79b9cd8e5826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40f416eada34f619f5e4797e85e739f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:03:21Z,use_quota=True,user_id='acb3c3f5eaaa41efb59521eaf8aa3627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Creating volume 6b9bf10b-6911-40a4-be07-79b9cd8e5826 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:03:23 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:23 devstack sudo[98046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 1073741824
Nov 04 01:03:23 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:23 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-69882bd3-6d95-4214-ae06-6008261a6cb9 req-1de8ef9b-905e-47bb-8be1-537ea3038cff tempest-AttachVolumeNegativeTest-1455147747 None] Terminate volume connection completed successfully.
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-69882bd3-6d95-4214-ae06-6008261a6cb9 req-1de8ef9b-905e-47bb-8be1-537ea3038cff tempest-AttachVolumeNegativeTest-1455147747 None] Deleting attachment 12a803df-663e-4936-8760-232041a2dc8f. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:03:23 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 1073741824" returned: 0 in 0.630s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:24 devstack sudo[98078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826
Nov 04 01:03:24 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:24 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826" returned: 0 in 0.359s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:03:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:24 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Attempting download of feeea883-a973-4c2d-b14e-c13d05c107a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}])) to volume 6b9bf10b-6911-40a4-be07-79b9cd8e5826. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 01:03:24 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd5c598-5622-4f13-b7c2-868820ae3576]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_0pf6h2d3 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:24 devstack sudo[98081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_0pf6h2d3
Nov 04 01:03:24 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:24 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_0pf6h2d3" returned: 0 in 0.441s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_0pf6h2d3 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:25 devstack sudo[98085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_0pf6h2d3
Nov 04 01:03:25 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:25 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_0pf6h2d3" returned: 1 in 0.627s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_0pf6h2d3' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:03:25 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[1837e389-e460-485a-8d3c-0ce9befbf78a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:25 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD
Nov 04 01:03:25 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:26 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:26 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] feeea883-a973-4c2d-b14e-c13d05c107a4 was qcow2, converting to qcow2 {{(pid=86660) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 01:03:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:26 devstack sudo[98114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826
Nov 04 01:03:26 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:28 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826" returned: 0 in 2.539s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:28 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_br1vjk5zdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:03:28 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Converted 112.00 MB image at 44.08 MB/s
Nov 04 01:03:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:28 devstack sudo[98129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 1G
Nov 04 01:03:28 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:29 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 1G" returned: 0 in 0.520s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Downloaded image feeea883-a973-4c2d-b14e-c13d05c107a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}])) to volume 6b9bf10b-6911-40a4-be07-79b9cd8e5826 successfully. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Temporary image feeea883-a973-4c2d-b14e-c13d05c107a4 for user acb3c3f5eaaa41efb59521eaf8aa3627 is deleted. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Marking volume 6b9bf10b-6911-40a4-be07-79b9cd8e5826 as bootable. {{(pid=86660) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Copying metadata from image feeea883-a973-4c2d-b14e-c13d05c107a4 to 6b9bf10b-6911-40a4-be07-79b9cd8e5826. {{(pid=86660) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Creating volume glance metadata for volume 6b9bf10b-6911-40a4-be07-79b9cd8e5826 backed by image feeea883-a973-4c2d-b14e-c13d05c107a4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86660) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885da694-4d3e-453a-8be3-eebff1edce59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b5476f1280>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a0b1cb-8b8a-4eec-bd0a-069802f3f86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:29 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Volume volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 (6b9bf10b-6911-40a4-be07-79b9cd8e5826): created successfully
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a0b1cb-8b8a-4eec-bd0a-069802f3f86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Flow 'volume_create_manager' (3de2e81c-82e1-4eb7-9e6e-9f7f984f36f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:03:29 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-34493145-5e53-4901-8987-e5988ab7629e tempest-VolumesImageMetadata-735982187 None] Created volume successfully.
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "cinder-e4d49f84-5e01-49d9-86bf-f7b8161147e4-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-e4d49f84-5e01-49d9-86bf-f7b8161147e4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "cinder-quobyte-e4d49f84-5e01-49d9-86bf-f7b8161147e4" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-quobyte-e4d49f84-5e01-49d9-86bf-f7b8161147e4" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52451c8-695e-4f26-9069-1d8a70abec18]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:30 devstack sudo[98135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4
Nov 04 01:03:30 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:30 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4" returned: 0 in 0.457s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:30 devstack sudo[98142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4
Nov 04 01:03:30 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:30 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d49f84-5e01-49d9-86bf-f7b8161147e4" returned: 0 in 0.305s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-quobyte-e4d49f84-5e01-49d9-86bf-f7b8161147e4" released by "delete_volume" :: held 0.829s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:30 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Created reservations ['d79c49f3-df6b-4bf8-b44f-43dd9d1a317e', '7ae89832-afa4-4556-ba34-682d5704eb49', '60d5703c-d3e6-4775-80a5-0c7dd7ab91e5', '6f5ec2ea-153a-46ff-a6a1-d6ddfaeb6c67'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:03:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:30 devstack sudo[98145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:03:30 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "cinder-366fd6a5-f79b-47d8-a5e0-80b55b3b679d-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-366fd6a5-f79b-47d8-a5e0-80b55b3b679d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "cinder-quobyte-366fd6a5-f79b-47d8-a5e0-80b55b3b679d" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-quobyte-366fd6a5-f79b-47d8-a5e0-80b55b3b679d" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:31 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c22b7b0-a1e2-4309-8210-f0c8b3aa2511]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.457s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:03:31 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Deleted volume successfully.
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4b92cf2e-bc2a-4e38-8523-b2613a956156 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-e4d49f84-5e01-49d9-86bf-f7b8161147e4-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Acquiring lock "cinder-6b9bf10b-6911-40a4-be07-79b9cd8e5826-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Lock "cinder-6b9bf10b-6911-40a4-be07-79b9cd8e5826-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:31 devstack sudo[98148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d
Nov 04 01:03:31 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Acquiring lock "cinder-quobyte-6b9bf10b-6911-40a4-be07-79b9cd8e5826" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Lock "cinder-quobyte-6b9bf10b-6911-40a4-be07-79b9cd8e5826" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[121cedee-6e76-48c8-ba09-86df387d1fc9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:31 devstack sudo[98150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826
Nov 04 01:03:31 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:31 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d" returned: 0 in 0.501s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:31 devstack sudo[98155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d
Nov 04 01:03:31 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:32 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826" returned: 0 in 0.429s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:32 devstack sudo[98161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826
Nov 04 01:03:32 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:32 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-366fd6a5-f79b-47d8-a5e0-80b55b3b679d" returned: 0 in 0.370s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-quobyte-366fd6a5-f79b-47d8-a5e0-80b55b3b679d" released by "delete_volume" :: held 0.965s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Created reservations ['9ab1c3d9-eb04-40eb-bfc6-fb6b5d69db35', '536433d8-d792-494c-b874-c08736c1e428', '02c036e0-dfbe-45f8-9356-f4b2501ed0b2', '5c590822-cac4-4597-b0f4-9c12dd4d7908'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:32 devstack sudo[98165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:03:32 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:32 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6b9bf10b-6911-40a4-be07-79b9cd8e5826" returned: 0 in 0.433s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Lock "cinder-quobyte-6b9bf10b-6911-40a4-be07-79b9cd8e5826" released by "delete_volume" :: held 0.933s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Created reservations ['1d128ce6-d123-4696-8387-272e9124c24e', 'fa20e4a0-8938-454d-add0-cba5c03aa503', '21a60754-de17-488a-808d-cb3a706e76c4', 'dc596163-3a1d-4a41-8951-780c4abfb681'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:32 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:32 devstack sudo[98168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.337s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:32 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "cinder-b9810f1c-7308-4e2c-8672-98e72452e2d0-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:32 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Deleted volume successfully.
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46c24953-feca-4342-8063-8fdd90583b5b tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-366fd6a5-f79b-47d8-a5e0-80b55b3b679d-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-b9810f1c-7308-4e2c-8672-98e72452e2d0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "cinder-quobyte-b9810f1c-7308-4e2c-8672-98e72452e2d0" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-quobyte-b9810f1c-7308-4e2c-8672-98e72452e2d0" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[08834d88-9608-4b6d-856b-e4b81ab00304]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:03:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:33 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.347s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:03:33 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Deleted volume successfully.
Nov 04 01:03:33 devstack sudo[98170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0
Nov 04 01:03:33 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cdbda4c7-e191-4ee4-9482-67bd7ea05be8 tempest-VolumesImageMetadata-735982187 None] Lock "cinder-6b9bf10b-6911-40a4-be07-79b9cd8e5826-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:33 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0" returned: 0 in 0.452s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:33 devstack sudo[98176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0
Nov 04 01:03:33 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:33 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9810f1c-7308-4e2c-8672-98e72452e2d0" returned: 0 in 0.276s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-quobyte-b9810f1c-7308-4e2c-8672-98e72452e2d0" released by "delete_volume" :: held 0.797s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Created reservations ['4b99dc36-0915-4a82-8954-fda1f1c794c6', 'f9c2306e-4411-48e9-b268-f078762b62aa', '1ee2d8a7-1f41-4f2b-bb68-0b649cbeed87', '357fd01a-c310-48c6-a28e-f5612451ba38'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:33 devstack sudo[98180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:03:33 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:34 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.321s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:34 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:03:34 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Deleted volume successfully.
Nov 04 01:03:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-07236dad-2dfa-4fce-a168-4225b8aab1c8 tempest-AttachVolumeNegativeTest-1455147747 None] Lock "cinder-b9810f1c-7308-4e2c-8672-98e72452e2d0-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:03:43 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=79,cinder:UPDATE=86,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:03:44 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=93,cinder:UPDATE=86,cinder:DELETE=7,cinder:INSERT=30 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:03:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:03:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:51 devstack sudo[98188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:03:51 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:51 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.300s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:51 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:03:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:03:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:03:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Flow 'volume_create_manager' (f02ebefd-c28c-4ad2-9b20-ce68a1d50f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26879de0-f008-42f8-96eb-d0a2b96e35e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26879de0-f008-42f8-96eb-d0a2b96e35e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1259379458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fbd442-5b52-4d47-bbfe-4132ddb653af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af49eeca8fb4757a758bd54a1572efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:03:56Z,use_quota=True,user_id='1da3da640e2f4bb3b24fbb7794dd0079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ecd3547-4278-41d3-b87b-9fbee43f71d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ecd3547-4278-41d3-b87b-9fbee43f71d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1655b60-9a5c-4bf6-9504-cee5fe1c39a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1655b60-9a5c-4bf6-9504-cee5fe1c39a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fbd442-5b52-4d47-bbfe-4132ddb653af', 'volume_name': 'volume-79fbd442-5b52-4d47-bbfe-4132ddb653af', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21674b4a-aa5a-4487-a360-f7b10e9058f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21674b4a-aa5a-4487-a360-f7b10e9058f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95f63ce-e6ae-40f5-9420-76a5e059a10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:55 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Volume 79fbd442-5b52-4d47-bbfe-4132ddb653af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fbd442-5b52-4d47-bbfe-4132ddb653af', 'volume_size': 1}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1259379458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fbd442-5b52-4d47-bbfe-4132ddb653af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af49eeca8fb4757a758bd54a1572efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:03:56Z,use_quota=True,user_id='1da3da640e2f4bb3b24fbb7794dd0079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Creating volume 79fbd442-5b52-4d47-bbfe-4132ddb653af {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:03:55 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:03:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:55 devstack sudo[98191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af 1073741824
Nov 04 01:03:55 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:56 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af 1073741824" returned: 0 in 0.554s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:56 devstack sudo[98197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af
Nov 04 01:03:56 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:56 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af" returned: 0 in 0.305s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:03:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95f63ce-e6ae-40f5-9420-76a5e059a10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fbd442-5b52-4d47-bbfe-4132ddb653af', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1c926a-15fa-4750-8325-ab3ba2fd8a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:56 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Volume volume-79fbd442-5b52-4d47-bbfe-4132ddb653af (79fbd442-5b52-4d47-bbfe-4132ddb653af): created successfully
Nov 04 01:03:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1c926a-15fa-4750-8325-ab3ba2fd8a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Flow 'volume_create_manager' (f02ebefd-c28c-4ad2-9b20-ce68a1d50f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:03:56 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3f9d74dc-fd6d-4582-8988-1430145a0558 tempest-VolumesTestJSON-783727846 None] Created volume successfully.
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Flow 'volume_create_manager' (838bb32b-b24d-464f-95ce-45628a661882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f966e9-ac8f-4cc5-9f8c-3e9a0945b1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f966e9-ac8f-4cc5-9f8c-3e9a0945b1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-142372893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ed9d66-811f-444e-aed7-7115bf9d5154,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af49eeca8fb4757a758bd54a1572efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:03:59Z,use_quota=True,user_id='1da3da640e2f4bb3b24fbb7794dd0079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6d954f-e2c4-4693-81d3-1dadbcf4f407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6d954f-e2c4-4693-81d3-1dadbcf4f407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71136827-9762-4fb7-83d0-3ca4cccb0c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71136827-9762-4fb7-83d0-3ca4cccb0c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ed9d66-811f-444e-aed7-7115bf9d5154', 'volume_name': 'volume-17ed9d66-811f-444e-aed7-7115bf9d5154', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76b751d-64be-45d7-8229-6accb1a0454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76b751d-64be-45d7-8229-6accb1a0454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfc7821-d42b-4756-9714-f1f5a1f8e862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:58 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Volume 17ed9d66-811f-444e-aed7-7115bf9d5154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ed9d66-811f-444e-aed7-7115bf9d5154', 'volume_size': 1}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-142372893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ed9d66-811f-444e-aed7-7115bf9d5154,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af49eeca8fb4757a758bd54a1572efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:03:59Z,use_quota=True,user_id='1da3da640e2f4bb3b24fbb7794dd0079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Creating volume 17ed9d66-811f-444e-aed7-7115bf9d5154 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:03:58 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:03:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:58 devstack sudo[98200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154 1073741824
Nov 04 01:03:58 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:59 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154 1073741824" returned: 0 in 0.657s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:59 devstack sudo[98207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154
Nov 04 01:03:59 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Flow 'volume_create_manager' (0e9c2e66-97da-4559-b29c-3033776ac335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d7f628-753e-429f-8c05-c6d5280571a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d7f628-753e-429f-8c05-c6d5280571a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1683884478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d57a42-f8ea-4ed0-bf53-f174436ae333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5351b51f8b6a4379881d5594f9ed1c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:00Z,use_quota=True,user_id='8826f0186bcf4e8ea4a5352906c01864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4a8715-50b9-478d-98c0-187faa8ce75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4a8715-50b9-478d-98c0-187faa8ce75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9c5a8c-8c8c-40d1-bbfd-2f76eb6a25fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9c5a8c-8c8c-40d1-bbfd-2f76eb6a25fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d57a42-f8ea-4ed0-bf53-f174436ae333', 'volume_name': 'volume-11d57a42-f8ea-4ed0-bf53-f174436ae333', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238b4c9c-4790-487b-8bb8-3a934e5bf590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238b4c9c-4790-487b-8bb8-3a934e5bf590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a715653-399f-44b6-af79-7d85741f546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:03:59 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Volume 11d57a42-f8ea-4ed0-bf53-f174436ae333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d57a42-f8ea-4ed0-bf53-f174436ae333', 'volume_size': 1}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:59 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154" returned: 0 in 0.369s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.106s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1683884478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d57a42-f8ea-4ed0-bf53-f174436ae333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5351b51f8b6a4379881d5594f9ed1c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:00Z,use_quota=True,user_id='8826f0186bcf4e8ea4a5352906c01864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Creating volume 11d57a42-f8ea-4ed0-bf53-f174436ae333 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:03:59 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfc7821-d42b-4756-9714-f1f5a1f8e862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ed9d66-811f-444e-aed7-7115bf9d5154', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:03:59 devstack sudo[98210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 1073741824
Nov 04 01:03:59 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:03:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86ca3d8-5cd0-46ee-99d1-0656e9029b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:00 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Volume volume-17ed9d66-811f-444e-aed7-7115bf9d5154 (17ed9d66-811f-444e-aed7-7115bf9d5154): created successfully
Nov 04 01:04:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86ca3d8-5cd0-46ee-99d1-0656e9029b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Flow 'volume_create_manager' (838bb32b-b24d-464f-95ce-45628a661882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:04:00 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-512eb45d-d5c2-4629-8dea-2bf8140d5234 tempest-VolumesTestJSON-783727846 None] Created volume successfully.
Nov 04 01:04:00 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 1073741824" returned: 0 in 0.653s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:00 devstack sudo[98217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333
Nov 04 01:04:00 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:00 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333" returned: 0 in 0.334s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:04:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a715653-399f-44b6-af79-7d85741f546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d57a42-f8ea-4ed0-bf53-f174436ae333', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92306697-4499-47f5-8e75-9e9d8f0ee180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Volume volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 (11d57a42-f8ea-4ed0-bf53-f174436ae333): created successfully
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92306697-4499-47f5-8e75-9e9d8f0ee180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Flow 'volume_create_manager' (0e9c2e66-97da-4559-b29c-3033776ac335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:04:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-586380b6-be84-443c-870a-7f753a4729ea tempest-VolumesActionsTest-1327413969 None] Created volume successfully.
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Flow 'volume_create_manager' (52d706bd-1cc1-4f6b-b41f-3fea023c2b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e25d904-1ba4-47f2-8c6c-d835ed05da1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e25d904-1ba4-47f2-8c6c-d835ed05da1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1981790588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f60c13a-099e-4080-b614-484d753e9859,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af49eeca8fb4757a758bd54a1572efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:01Z,use_quota=True,user_id='1da3da640e2f4bb3b24fbb7794dd0079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e174cd6-906a-4497-bc71-8610b4bd6666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e174cd6-906a-4497-bc71-8610b4bd6666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdc1d4f-a967-4dde-950b-454383e0a207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdc1d4f-a967-4dde-950b-454383e0a207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f60c13a-099e-4080-b614-484d753e9859', 'volume_name': 'volume-8f60c13a-099e-4080-b614-484d753e9859', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2468b6-2ff7-48bb-bd97-fcdd9de802d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2468b6-2ff7-48bb-bd97-fcdd9de802d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c02113-2e9b-4f30-b9f4-0a4195a66d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Volume 8f60c13a-099e-4080-b614-484d753e9859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f60c13a-099e-4080-b614-484d753e9859', 'volume_size': 1}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1981790588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f60c13a-099e-4080-b614-484d753e9859,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3af49eeca8fb4757a758bd54a1572efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:01Z,use_quota=True,user_id='1da3da640e2f4bb3b24fbb7794dd0079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Creating volume 8f60c13a-099e-4080-b614-484d753e9859 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:04:01 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:04:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:01 devstack sudo[98221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859 1073741824
Nov 04 01:04:01 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:02 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859 1073741824" returned: 0 in 0.584s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:02 devstack sudo[98227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859
Nov 04 01:04:02 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:02 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859" returned: 0 in 0.268s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:04:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c02113-2e9b-4f30-b9f4-0a4195a66d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f60c13a-099e-4080-b614-484d753e9859', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eaf508d-35d2-4bae-848d-7bfde27263bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:02 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Volume volume-8f60c13a-099e-4080-b614-484d753e9859 (8f60c13a-099e-4080-b614-484d753e9859): created successfully
Nov 04 01:04:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eaf508d-35d2-4bae-848d-7bfde27263bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Flow 'volume_create_manager' (52d706bd-1cc1-4f6b-b41f-3fea023c2b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:04:02 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-38b9f5cb-e24c-4640-b7b8-7232679b9399 tempest-VolumesTestJSON-783727846 None] Created volume successfully.
Nov 04 01:04:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Acquiring lock "cinder-8f60c13a-099e-4080-b614-484d753e9859-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Lock "cinder-8f60c13a-099e-4080-b614-484d753e9859-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Acquiring lock "cinder-quobyte-8f60c13a-099e-4080-b614-484d753e9859" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Lock "cinder-quobyte-8f60c13a-099e-4080-b614-484d753e9859" acquired by "delete_volume" :: waited 0.057s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:05 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9bd531-7642-40b8-853d-82cf009942d2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:04:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:05 devstack sudo[98235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859
Nov 04 01:04:05 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:05 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859" returned: 0 in 0.553s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:06 devstack sudo[98240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859
Nov 04 01:04:06 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:06 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8f60c13a-099e-4080-b614-484d753e9859" returned: 0 in 0.405s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Lock "cinder-quobyte-8f60c13a-099e-4080-b614-484d753e9859" released by "delete_volume" :: held 1.038s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:06 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Created reservations ['6157fea4-e4d1-4ae6-ae34-a4bbcb70de86', 'f58f8f82-290b-4a98-bd82-5e3e65d5e771', 'b2c6f3de-6cc2-4dc8-81bb-ae746f239d78', '3fffb18e-7ccf-4a25-9d4c-691ba329c268'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:04:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:04:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:04:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:06 devstack sudo[98243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:04:06 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:07 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.526s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:07 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:04:07 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Deleted volume successfully.
Nov 04 01:04:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf47af7c-37a4-4f2f-944e-39ea2cb78982 tempest-VolumesTestJSON-783727846 None] Lock "cinder-8f60c13a-099e-4080-b614-484d753e9859-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Acquiring lock "cinder-17ed9d66-811f-444e-aed7-7115bf9d5154-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Lock "cinder-17ed9d66-811f-444e-aed7-7115bf9d5154-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Acquiring lock "cinder-quobyte-17ed9d66-811f-444e-aed7-7115bf9d5154" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Lock "cinder-quobyte-17ed9d66-811f-444e-aed7-7115bf9d5154" acquired by "delete_volume" :: waited 0.049s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:07 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7241ab-c727-447e-9f18-64919bf46b29]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:04:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:08 devstack sudo[98297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154
Nov 04 01:04:08 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:08 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154" returned: 0 in 0.586s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:08 devstack sudo[98305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154
Nov 04 01:04:08 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:08 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-17ed9d66-811f-444e-aed7-7115bf9d5154" returned: 0 in 0.343s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Lock "cinder-quobyte-17ed9d66-811f-444e-aed7-7115bf9d5154" released by "delete_volume" :: held 1.037s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:08 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Created reservations ['95a675c3-f84b-446a-8b0d-12d3b509ba0e', 'c55a0395-d61f-4bb7-9a7b-82391f976b2b', '95497dc3-470c-4670-82d2-691e5ae425ca', 'f06c6102-b95f-49f8-b4e6-fd4445dcbc92'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:04:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:04:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:04:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:09 devstack sudo[98308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:04:09 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:09 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.361s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:09 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:04:09 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Deleted volume successfully.
Nov 04 01:04:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-746330d2-6ac6-48fb-9fb8-653df405f226 tempest-VolumesTestJSON-783727846 None] Lock "cinder-17ed9d66-811f-444e-aed7-7115bf9d5154-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Acquiring lock "cinder-79fbd442-5b52-4d47-bbfe-4132ddb653af-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Lock "cinder-79fbd442-5b52-4d47-bbfe-4132ddb653af-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Acquiring lock "cinder-quobyte-79fbd442-5b52-4d47-bbfe-4132ddb653af" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Lock "cinder-quobyte-79fbd442-5b52-4d47-bbfe-4132ddb653af" acquired by "delete_volume" :: waited 0.059s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:10 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fc5670-5173-41fe-9af0-61caf16985ec]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:04:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:10 devstack sudo[98312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af
Nov 04 01:04:10 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:10 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af" returned: 0 in 0.624s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:10 devstack sudo[98321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af
Nov 04 01:04:10 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:11 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79fbd442-5b52-4d47-bbfe-4132ddb653af" returned: 0 in 0.529s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Lock "cinder-quobyte-79fbd442-5b52-4d47-bbfe-4132ddb653af" released by "delete_volume" :: held 1.223s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:11 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Created reservations ['74536a4d-045b-49d4-9819-334a7b5c210e', 'f8b5bba6-6e71-4f18-97ea-a0ff4a4c0df7', '5541cc7e-1a78-471a-be77-424ff1d61a23', '2d2f5359-58f2-4f48-bd55-1fba558b0780'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:04:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:04:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:04:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:11 devstack sudo[98362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:04:11 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:12 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.571s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:12 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:04:12 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Deleted volume successfully.
Nov 04 01:04:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc5ecdb8-1faa-45c9-993c-e334f8fc7e81 tempest-VolumesTestJSON-783727846 None] Lock "cinder-79fbd442-5b52-4d47-bbfe-4132ddb653af-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d429bc80-2038-48ff-bf68-bdf92d53a9f2 tempest-VolumesActionsTest-1327413969 None] Acquiring lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333" by "attach_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d429bc80-2038-48ff-bf68-bdf92d53a9f2 tempest-VolumesActionsTest-1327413969 None] Lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333" acquired by "attach_volume" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:16 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d429bc80-2038-48ff-bf68-bdf92d53a9f2 tempest-VolumesActionsTest-1327413969 None] Attaching volume 11d57a42-f8ea-4ed0-bf53-f174436ae333 to instance 30e15aef-dd74-4861-a394-8f5b28351a73 at mountpoint /dev/vdb on host None.
Nov 04 01:04:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d429bc80-2038-48ff-bf68-bdf92d53a9f2 tempest-VolumesActionsTest-1327413969 None] Attach volume completed successfully.
Nov 04 01:04:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d429bc80-2038-48ff-bf68-bdf92d53a9f2 tempest-VolumesActionsTest-1327413969 None] Lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333" released by "attach_volume" :: held 0.290s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5f3b3ac9-27ff-4739-8939-613fb892039d tempest-VolumesActionsTest-1327413969 None] Acquiring lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333-detach_volume" by "detach_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5f3b3ac9-27ff-4739-8939-613fb892039d tempest-VolumesActionsTest-1327413969 None] Lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5f3b3ac9-27ff-4739-8939-613fb892039d tempest-VolumesActionsTest-1327413969 None] Detaching volume 11d57a42-f8ea-4ed0-bf53-f174436ae333 from instance 30e15aef-dd74-4861-a394-8f5b28351a73.
Nov 04 01:04:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5f3b3ac9-27ff-4739-8939-613fb892039d tempest-VolumesActionsTest-1327413969 None] Detach volume completed successfully.
Nov 04 01:04:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5f3b3ac9-27ff-4739-8939-613fb892039d tempest-VolumesActionsTest-1327413969 None] Lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333-detach_volume" released by "detach_volume" :: held 0.193s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:27 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=36,cinder:SELECT=33,cinder:INSERT=10,cinder:DELETE=6 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:04:27 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=27,cinder:UPDATE=43,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Flow 'volume_create_manager' (b533e8c1-fb0d-4e36-9396-931196be0ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67685e70-2c9d-4165-a53f-295dd0349f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67685e70-2c9d-4165-a53f-295dd0349f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1390326525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01d9ee0-caf0-4254-bf57-ad32e92b2d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1005804a41ea492e9d017a1d97b1aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:31Z,use_quota=True,user_id='0c528b38f43d45c494bf75ebdf1e51dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c2b79e-783c-471e-a77d-05f347521feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c2b79e-783c-471e-a77d-05f347521feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe892a5-ceda-486d-a3fc-9758f1ba2333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe892a5-ceda-486d-a3fc-9758f1ba2333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01d9ee0-caf0-4254-bf57-ad32e92b2d69', 'volume_name': 'volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a165de2b-9ed2-4ad1-a77e-12cb2519ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a165de2b-9ed2-4ad1-a77e-12cb2519ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d960faa-b253-4a95-b49c-121be954956c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:31 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Volume b01d9ee0-caf0-4254-bf57-ad32e92b2d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69', 'volume_size': 1}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1390326525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01d9ee0-caf0-4254-bf57-ad32e92b2d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1005804a41ea492e9d017a1d97b1aabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:31Z,use_quota=True,user_id='0c528b38f43d45c494bf75ebdf1e51dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Creating volume b01d9ee0-caf0-4254-bf57-ad32e92b2d69 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:04:31 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:04:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:31 devstack sudo[98571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69 1073741824
Nov 04 01:04:31 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:32 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69 1073741824" returned: 0 in 0.822s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:32 devstack sudo[98579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69
Nov 04 01:04:32 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:32 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69" returned: 0 in 0.429s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:04:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d960faa-b253-4a95-b49c-121be954956c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbd9f89-a689-442e-8e80-fc7cb83a9247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:32 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Volume volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69 (b01d9ee0-caf0-4254-bf57-ad32e92b2d69): created successfully
Nov 04 01:04:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbd9f89-a689-442e-8e80-fc7cb83a9247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Flow 'volume_create_manager' (b533e8c1-fb0d-4e36-9396-931196be0ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:04:32 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c71c9145-9d72-46ae-9155-bbbba5f3e014 tempest-TestMinimumBasicScenario-235530744 None] Created volume successfully.
Nov 04 01:04:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-40e6ba4b-b24c-47cc-9302-fde630029811 req-cbbe986b-5f1b-4ffa-b3eb-988ee0bc9b6e tempest-TestMinimumBasicScenario-235530744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-40e6ba4b-b24c-47cc-9302-fde630029811 req-cbbe986b-5f1b-4ffa-b3eb-988ee0bc9b6e tempest-TestMinimumBasicScenario-235530744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-40e6ba4b-b24c-47cc-9302-fde630029811 req-cbbe986b-5f1b-4ffa-b3eb-988ee0bc9b6e tempest-TestMinimumBasicScenario-235530744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:34 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-40e6ba4b-b24c-47cc-9302-fde630029811 req-cbbe986b-5f1b-4ffa-b3eb-988ee0bc9b6e tempest-TestMinimumBasicScenario-235530744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c2794e0-519a-45c5-a06f-846d56d0f2af', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:04:35 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-40e6ba4b-b24c-47cc-9302-fde630029811 req-cbbe986b-5f1b-4ffa-b3eb-988ee0bc9b6e tempest-TestMinimumBasicScenario-235530744 None] attachment_update completed successfully.
Nov 04 01:04:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ac0bbf32-8bb0-446b-bd39-a291bc0175b1 tempest-VolumesActionsTest-1327413969 None] Acquiring lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333" by "attach_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ac0bbf32-8bb0-446b-bd39-a291bc0175b1 tempest-VolumesActionsTest-1327413969 None] Lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333" acquired by "attach_volume" :: waited 0.058s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:40 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ac0bbf32-8bb0-446b-bd39-a291bc0175b1 tempest-VolumesActionsTest-1327413969 None] Attaching volume 11d57a42-f8ea-4ed0-bf53-f174436ae333 to instance a520b396-e303-40e6-a002-88a556ef8b98 at mountpoint /dev/vdb on host None.
Nov 04 01:04:40 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ac0bbf32-8bb0-446b-bd39-a291bc0175b1 tempest-VolumesActionsTest-1327413969 None] Attach volume completed successfully.
Nov 04 01:04:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ac0bbf32-8bb0-446b-bd39-a291bc0175b1 tempest-VolumesActionsTest-1327413969 None] Lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333" released by "attach_volume" :: held 0.210s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4efbe06b-d110-42f4-992e-77cc8b90a702 tempest-VolumesActionsTest-1327413969 None] Acquiring lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333-detach_volume" by "detach_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4efbe06b-d110-42f4-992e-77cc8b90a702 tempest-VolumesActionsTest-1327413969 None] Lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:42 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4efbe06b-d110-42f4-992e-77cc8b90a702 tempest-VolumesActionsTest-1327413969 None] Detaching volume 11d57a42-f8ea-4ed0-bf53-f174436ae333 from instance a520b396-e303-40e6-a002-88a556ef8b98.
Nov 04 01:04:42 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4efbe06b-d110-42f4-992e-77cc8b90a702 tempest-VolumesActionsTest-1327413969 None] Detach volume completed successfully.
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4efbe06b-d110-42f4-992e-77cc8b90a702 tempest-VolumesActionsTest-1327413969 None] Lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (f52417b9-7dc0-4887-a371-6fda8d8203a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8ac556-da3b-44ac-8ae5-ca95863dc9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8ac556-da3b-44ac-8ae5-ca95863dc9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-970661999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c622b2fb-e27c-4cc1-a7ff-037c1bd5d758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:42Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f491b5b-cdb8-445b-87f3-84ddffe7292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f491b5b-cdb8-445b-87f3-84ddffe7292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a517beb-5bce-491e-944c-562e20b5ac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a517beb-5bce-491e-944c-562e20b5ac8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c622b2fb-e27c-4cc1-a7ff-037c1bd5d758', 'volume_name': 'volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1358cb1b-38c4-43d2-a88f-244b0c65cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1358cb1b-38c4-43d2-a88f-244b0c65cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12107977-795b-4a8f-b9aa-741386beb76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:42 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Volume c622b2fb-e27c-4cc1-a7ff-037c1bd5d758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758', 'volume_size': 1}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-970661999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c622b2fb-e27c-4cc1-a7ff-037c1bd5d758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:42Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Creating volume c622b2fb-e27c-4cc1-a7ff-037c1bd5d758 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:04:42 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:04:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:42 devstack sudo[99180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758 1073741824
Nov 04 01:04:42 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:43 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758 1073741824" returned: 0 in 0.867s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:43 devstack sudo[99196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758
Nov 04 01:04:43 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:44 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758" returned: 0 in 0.876s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:04:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12107977-795b-4a8f-b9aa-741386beb76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aea714b-e7c1-40d4-9c10-603e24675112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:44 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Volume volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758 (c622b2fb-e27c-4cc1-a7ff-037c1bd5d758): created successfully
Nov 04 01:04:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aea714b-e7c1-40d4-9c10-603e24675112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (f52417b9-7dc0-4887-a371-6fda8d8203a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:04:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9e04cae2-63a1-4539-a1ad-8b3478c6942a tempest-VolumesActionsTest-31614866 None] Created volume successfully.
Nov 04 01:04:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-64d8ef5b-81d7-4ea6-ab30-5dcf442e5585 tempest-VolumesActionsTest-31614866 None] Acquiring lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758" by "attach_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-64d8ef5b-81d7-4ea6-ab30-5dcf442e5585 tempest-VolumesActionsTest-31614866 None] Lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758" acquired by "attach_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-64d8ef5b-81d7-4ea6-ab30-5dcf442e5585 tempest-VolumesActionsTest-31614866 None] Attaching volume c622b2fb-e27c-4cc1-a7ff-037c1bd5d758 to instance aa98ca14-2ea0-4691-8dc2-450cb3aa860e at mountpoint /dev/vdb on host None.
Nov 04 01:04:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-64d8ef5b-81d7-4ea6-ab30-5dcf442e5585 tempest-VolumesActionsTest-31614866 None] Attach volume completed successfully.
Nov 04 01:04:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-64d8ef5b-81d7-4ea6-ab30-5dcf442e5585 tempest-VolumesActionsTest-31614866 None] Lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758" released by "attach_volume" :: held 0.178s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-474d7fac-8cd7-4c78-8472-1423d5e8f34a tempest-VolumesActionsTest-1158081488 None] Terminate volume connection completed successfully.
Nov 04 01:04:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2d1e84cb-cdad-4eb0-bdba-cd0e40d3ec6d tempest-GroupsTest-1966760325 None] Group tempest-Group1-1003842841: creating
Nov 04 01:04:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2d1e84cb-cdad-4eb0-bdba-cd0e40d3ec6d tempest-GroupsTest-1966760325 None] Group tempest-Group1-1003842841: created successfully
Nov 04 01:04:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2d1e84cb-cdad-4eb0-bdba-cd0e40d3ec6d tempest-GroupsTest-1966760325 None] Create group completed successfully.
Nov 04 01:04:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-474d7fac-8cd7-4c78-8472-1423d5e8f34a tempest-VolumesActionsTest-1158081488 None] Acquiring lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758-detach_volume" by "detach_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-474d7fac-8cd7-4c78-8472-1423d5e8f34a tempest-VolumesActionsTest-1158081488 None] Lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-474d7fac-8cd7-4c78-8472-1423d5e8f34a tempest-VolumesActionsTest-1158081488 None] Detaching volume c622b2fb-e27c-4cc1-a7ff-037c1bd5d758 from instance aa98ca14-2ea0-4691-8dc2-450cb3aa860e.
Nov 04 01:04:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-474d7fac-8cd7-4c78-8472-1423d5e8f34a tempest-VolumesActionsTest-1158081488 None] Detach volume completed successfully.
Nov 04 01:04:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-474d7fac-8cd7-4c78-8472-1423d5e8f34a tempest-VolumesActionsTest-1158081488 None] Lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3449239-2eba-467d-9616-d29dbe52c15e tempest-VolumesActionsTest-31614866 None] Acquiring lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758-detach_volume" by "detach_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3449239-2eba-467d-9616-d29dbe52c15e tempest-VolumesActionsTest-31614866 None] Lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:48 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f3449239-2eba-467d-9616-d29dbe52c15e tempest-VolumesActionsTest-31614866 None] Volume detach called, but volume not attached.
Nov 04 01:04:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3449239-2eba-467d-9616-d29dbe52c15e tempest-VolumesActionsTest-31614866 None] Lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Acquiring lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Acquiring lock "cinder-quobyte-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:04:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Lock "cinder-quobyte-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758" acquired by "delete_volume" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:04:48 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf8b8e4-2229-4613-9c23-a29a23432d79]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:04:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:49 devstack sudo[99214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758
Nov 04 01:04:49 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:49 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2d3ef5f8-a55e-4e4e-8f6f-b117b6d39a06 tempest-GroupsTest-1966760325 None] Group tempest-Group2-237020558: creating
Nov 04 01:04:49 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2d3ef5f8-a55e-4e4e-8f6f-b117b6d39a06 tempest-GroupsTest-1966760325 None] Group tempest-Group2-237020558: created successfully
Nov 04 01:04:49 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2d3ef5f8-a55e-4e4e-8f6f-b117b6d39a06 tempest-GroupsTest-1966760325 None] Create group completed successfully.
Nov 04 01:04:49 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758" returned: 0 in 0.863s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:49 devstack sudo[99221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758
Nov 04 01:04:49 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:50 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758" returned: 0 in 0.511s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:50 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Lock "cinder-quobyte-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758" released by "delete_volume" :: held 1.495s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:50 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Created reservations ['0c7f86c5-bed4-434c-a4be-c49b0526f498', 'bf5a6d79-2df5-45b4-97b0-43d8af281c28', '921165c5-9d5d-4ca9-be0b-8347517cb144', '5ea39b27-dc26-49bc-8243-b9901460ea7b'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:04:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:04:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:04:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:50 devstack sudo[99225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:04:50 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:50 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.550s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:50 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:04:50 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Deleted volume successfully.
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7ac5a127-0532-4f1b-b668-a78a288d89b5 tempest-VolumesActionsTest-31614866 None] Lock "cinder-c622b2fb-e27c-4cc1-a7ff-037c1bd5d758-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[978df595-4d9e-44cc-b618-d4cd0908c523]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:51 devstack sudo[99228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333
Nov 04 01:04:51 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Flow 'volume_create_manager' (009ab5b1-6a01-46da-9970-75e5efe93730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce05b32-4d82-428f-ac58-4f2365be2fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce05b32-4d82-428f-ac58-4f2365be2fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1132943658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=46d1e14a-647d-4722-b9b1-c49574fcf98c,host='devstack@QuobyteHD#QuobyteHD',id=c6f7ce87-4929-46b6-bfa2-920061189ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d12617b42b4e31a22f22987e4785c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:51Z,use_quota=True,user_id='c255c274f854434483f0961b0ec46b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(baf2b127-0533-41e0-bdb2-34f6fc39c2f2),volume_type_id=baf2b127-0533-41e0-bdb2-34f6fc39c2f2)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45d610b-6387-4e9e-90ef-7ba20355f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45d610b-6387-4e9e-90ef-7ba20355f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001a6704-4c44-4c10-8917-213e734f8911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001a6704-4c44-4c10-8917-213e734f8911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f7ce87-4929-46b6-bfa2-920061189ebd', 'volume_name': 'volume-c6f7ce87-4929-46b6-bfa2-920061189ebd', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5f6fb3-1f81-4df0-91ae-220df947208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5f6fb3-1f81-4df0-91ae-220df947208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ae4b94-201d-4765-9f07-eb0478a72df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:51 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Volume c6f7ce87-4929-46b6-bfa2-920061189ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f7ce87-4929-46b6-bfa2-920061189ebd', 'volume_size': 1}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:51 devstack sudo[99230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:04:51 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:51 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333" returned: 0 in 0.624s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[475b2ccd-8f2c-4586-896d-48e0a237cb3d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:04:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:52 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333
Nov 04 01:04:52 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:52 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.447s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:04:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:04:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:04:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:04:52 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333" returned: 0 in 0.528s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.a6b4b530-6b15-4e36-9f49-af1fe7fe1e46o9wi9unh.img {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:52 devstack sudo[99261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.a6b4b530-6b15-4e36-9f49-af1fe7fe1e46o9wi9unh.img
Nov 04 01:04:52 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (ed375c62-c734-4fc9-a67c-6cecffbc93c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429acc99-a848-407a-a3d1-c60ced2ce1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429acc99-a848-407a-a3d1-c60ced2ce1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1159033977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c65b3fa-b032-4075-bb1e-276532152295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:56Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c7603c-35c5-49d2-8ad5-14148d9a1516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c7603c-35c5-49d2-8ad5-14148d9a1516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b11c1d-fd5a-4b3b-a267-94ba3882cd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b11c1d-fd5a-4b3b-a267-94ba3882cd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c65b3fa-b032-4075-bb1e-276532152295', 'volume_name': 'volume-3c65b3fa-b032-4075-bb1e-276532152295', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb9a931-0436-47c8-ba37-c16ff03cf39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb9a931-0436-47c8-ba37-c16ff03cf39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3610935-1642-4d28-a0f5-24fffd691842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:04:56 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Volume 3c65b3fa-b032-4075-bb1e-276532152295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c65b3fa-b032-4075-bb1e-276532152295', 'volume_size': 1}
Nov 04 01:04:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:04:59 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root
Nov 04 01:04:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.a6b4b530-6b15-4e36-9f49-af1fe7fe1e46o9wi9unh.img" returned: 0 in 7.391s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:04:59 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bdc4c8-d117-4610-8bd2-613cb469bc2f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:04:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:04:59 devstack sudo[99304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333
Nov 04 01:04:59 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:00 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333" returned: 0 in 0.482s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:00 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.a6b4b530-6b15-4e36-9f49-af1fe7fe1e46o9wi9unh.img {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:05:00 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] Converted 1024.00 MB image at 138.52 MB/s
Nov 04 01:05:00 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] a6b4b530-6b15-4e36-9f49-af1fe7fe1e46 was raw, no need to convert to raw {{(pid=86660) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 04 01:05:10 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=38,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:05:10 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=31,cinder:SELECT=34,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.260s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] Uploaded volume to glance image-id: a6b4b530-6b15-4e36-9f49-af1fe7fe1e46. {{(pid=86660) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.765s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=46d1e14a-647d-4722-b9b1-c49574fcf98c,created_at=2026-11-04T00:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1132943658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=46d1e14a-647d-4722-b9b1-c49574fcf98c,host='devstack@QuobyteHD#QuobyteHD',id=c6f7ce87-4929-46b6-bfa2-920061189ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d12617b42b4e31a22f22987e4785c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:51Z,use_quota=True,user_id='c255c274f854434483f0961b0ec46b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(baf2b127-0533-41e0-bdb2-34f6fc39c2f2),volume_type_id=baf2b127-0533-41e0-bdb2-34f6fc39c2f2)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Creating volume c6f7ce87-4929-46b6-bfa2-920061189ebd {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:05:20 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:20 devstack sudo[99401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd 1073741824
Nov 04 01:05:20 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:20 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-750dac73-a599-4306-8e61-eeeb3773dd24 tempest-VolumesActionsTest-1327413969 None] Copy volume to image completed successfully.
Nov 04 01:05:20 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd 1073741824" returned: 0 in 0.470s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:20 devstack sudo[99407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd
Nov 04 01:05:20 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:21 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd" returned: 0 in 0.262s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.854s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1159033977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c65b3fa-b032-4075-bb1e-276532152295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:04:56Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Creating volume 3c65b3fa-b032-4075-bb1e-276532152295 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:05:21 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ae4b94-201d-4765-9f07-eb0478a72df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f7ce87-4929-46b6-bfa2-920061189ebd', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c907414-19f9-4050-9ddc-cf1b149114a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:21 devstack sudo[99410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295 1073741824
Nov 04 01:05:21 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:21 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Volume volume-c6f7ce87-4929-46b6-bfa2-920061189ebd (c6f7ce87-4929-46b6-bfa2-920061189ebd): created successfully
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c907414-19f9-4050-9ddc-cf1b149114a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Flow 'volume_create_manager' (009ab5b1-6a01-46da-9970-75e5efe93730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:21 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-6515daef-36b7-4fb7-a119-d8456dce6c28 tempest-GroupsTest-1966760325 None] Created volume successfully.
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:21 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295 1073741824" returned: 0 in 0.445s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:21 devstack sudo[99415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295
Nov 04 01:05:21 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:21 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295" returned: 0 in 0.258s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.409s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3610935-1642-4d28-a0f5-24fffd691842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c65b3fa-b032-4075-bb1e-276532152295', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81050f82-74df-4a2c-844e-d223e69c2237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[630c00bf-a646-43b7-afc6-1ab4e2716071]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:21 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Volume volume-3c65b3fa-b032-4075-bb1e-276532152295 (3c65b3fa-b032-4075-bb1e-276532152295): created successfully
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81050f82-74df-4a2c-844e-d223e69c2237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (ed375c62-c734-4fc9-a67c-6cecffbc93c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:22 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e569e485-b135-44d2-858d-31ee161785f4 tempest-VolumesActionsTest-31614866 None] Created volume successfully.
Nov 04 01:05:22 devstack sudo[99418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333
Nov 04 01:05:22 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "cinder-3c65b3fa-b032-4075-bb1e-276532152295-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:22 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333" returned: 0 in 0.416s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-3c65b3fa-b032-4075-bb1e-276532152295-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b9dd0b-0cff-41a5-899e-930cc832140d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "cinder-quobyte-3c65b3fa-b032-4075-bb1e-276532152295" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-quobyte-3c65b3fa-b032-4075-bb1e-276532152295" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f94bd7-7a55-4405-9f77-c018c70a1a06]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:22 devstack sudo[99423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333
Nov 04 01:05:22 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Acquiring lock "cinder-quobyte-c6f7ce87-4929-46b6-bfa2-920061189ebd" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Lock "cinder-quobyte-c6f7ce87-4929-46b6-bfa2-920061189ebd" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:22 devstack sudo[99424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295
Nov 04 01:05:22 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c24cc0-923b-4bc1-933f-d0becdc6543c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:22 devstack sudo[99427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd
Nov 04 01:05:22 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:22 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333" returned: 0 in 0.426s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:22 devstack sudo[99432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img
Nov 04 01:05:22 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:22 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295" returned: 0 in 0.444s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:22 devstack sudo[99437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295
Nov 04 01:05:22 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:23 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd" returned: 0 in 0.432s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:23 devstack sudo[99445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd
Nov 04 01:05:23 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:23 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3c65b3fa-b032-4075-bb1e-276532152295" returned: 0 in 0.306s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-quobyte-3c65b3fa-b032-4075-bb1e-276532152295" released by "delete_volume" :: held 0.807s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Created reservations ['2798ca8b-6aa7-4ea5-a981-0d14c1839461', 'cdc7996b-cf3c-4d9e-b6b7-b69fa48ed39d', '4e21467a-3c9c-47f3-9d98-8db3a78f336c', '953a5d41-3af3-4bab-a536-d070468eb172'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:23 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6f7ce87-4929-46b6-bfa2-920061189ebd" returned: 0 in 0.350s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Lock "cinder-quobyte-c6f7ce87-4929-46b6-bfa2-920061189ebd" released by "delete_volume" :: held 0.866s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:23 devstack sudo[99456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:23 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Created reservations ['093e1364-1c54-4281-9c64-8ef759c152db'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:23 devstack cinder-volume[86660]: WARNING cinder.quota [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-185626966 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-185626966, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:05:23 devstack cinder-volume[86660]: WARNING cinder.quota [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-185626966 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-185626966, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Created reservations ['64191bf6-3a70-47b4-9c74-84c85c0864b4', '99749d6c-137d-4193-9df9-2f381bd3e817', '3809811e-9a7a-45b8-8ca3-f4c09583acbe', 'f222ee92-a98d-4285-ac58-5a51cb907a7e'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:23 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.448s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:23 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:23 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Deleted volume successfully.
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:24 devstack sudo[99459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:24 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-62428058-8bbe-4a98-a319-5778c7324ce5 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-3c65b3fa-b032-4075-bb1e-276532152295-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (08e0e429-c5ff-4a82-b71a-76a0a7b2cb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:24 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4b376b-f843-44bd-a3a4-a9aed40709a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.696s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4b376b-f843-44bd-a3a4-a9aed40709a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-72690858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11848d5e-4249-4abe-a7fc-ae23d86d33c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:24Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca83dc4-d75f-43b6-9d4d-31740ff9601b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca83dc4-d75f-43b6-9d4d-31740ff9601b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416c346b-e34f-47f7-a45b-2c2c8f7d8251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416c346b-e34f-47f7-a45b-2c2c8f7d8251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11848d5e-4249-4abe-a7fc-ae23d86d33c7', 'volume_name': 'volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65184ee8-27b7-49fc-b1ba-b6f93051545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65184ee8-27b7-49fc-b1ba-b6f93051545c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed1912d-7e85-4787-b891-bc436a35c321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:24 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Volume 11848d5e-4249-4abe-a7fc-ae23d86d33c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7', 'volume_size': 1}
Nov 04 01:05:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:24 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-995c5627-ba8b-41fb-938a-03911c861c56 tempest-GroupsTest-1966760325 None] Delete group completed successfully.
Nov 04 01:05:25 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-373cf599-a1bc-4631-b720-5b008d522f0e tempest-GroupsTest-1966760325 None] Created reservations ['cad47d78-3fc5-41fd-bbe9-c0e63a977e99'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-373cf599-a1bc-4631-b720-5b008d522f0e tempest-GroupsTest-1966760325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-373cf599-a1bc-4631-b720-5b008d522f0e tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-373cf599-a1bc-4631-b720-5b008d522f0e tempest-GroupsTest-1966760325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-373cf599-a1bc-4631-b720-5b008d522f0e tempest-GroupsTest-1966760325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-373cf599-a1bc-4631-b720-5b008d522f0e tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-373cf599-a1bc-4631-b720-5b008d522f0e tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:26 devstack sudo[99462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:26 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:26 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-373cf599-a1bc-4631-b720-5b008d522f0e tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.457s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:26 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-373cf599-a1bc-4631-b720-5b008d522f0e tempest-GroupsTest-1966760325 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:26 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-373cf599-a1bc-4631-b720-5b008d522f0e tempest-GroupsTest-1966760325 None] Delete group completed successfully.
Nov 04 01:05:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7e0bbe4c-f5cf-4a26-9faf-70dd6b773fea tempest-GroupsTest-1966760325 None] Group tempest-GroupsTest-Group-1885928263: creating
Nov 04 01:05:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7e0bbe4c-f5cf-4a26-9faf-70dd6b773fea tempest-GroupsTest-1966760325 None] Group tempest-GroupsTest-Group-1885928263: created successfully
Nov 04 01:05:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7e0bbe4c-f5cf-4a26-9faf-70dd6b773fea tempest-GroupsTest-1966760325 None] Create group completed successfully.
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Flow 'volume_create_manager' (c499c7cd-3b5f-44b0-b519-1b1cad96c2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf71f2e-b34a-4581-ad66-d3ca6c4038ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf71f2e-b34a-4581-ad66-d3ca6c4038ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-444333916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=020dbd39-08a6-4e94-ba83-daac55e9ebe7,host='devstack@QuobyteHD#QuobyteHD',id=3a627e93-adf6-4a4c-8e62-ce0af3f853d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d12617b42b4e31a22f22987e4785c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:30Z,use_quota=True,user_id='c255c274f854434483f0961b0ec46b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0869913-84c2-4ee3-a58f-94b2d1fdc5c7),volume_type_id=d0869913-84c2-4ee3-a58f-94b2d1fdc5c7)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10a4506-1a03-4d85-a0be-3c3a25b21a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10a4506-1a03-4d85-a0be-3c3a25b21a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4d39a2-dc19-4b53-939c-23dcafde5b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4d39a2-dc19-4b53-939c-23dcafde5b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a627e93-adf6-4a4c-8e62-ce0af3f853d5', 'volume_name': 'volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80dd9dd7-39e4-4dab-9a62-1a00fabce3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80dd9dd7-39e4-4dab-9a62-1a00fabce3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6649bdc-1ad2-4b89-8e63-42d5418492b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:30 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Volume 3a627e93-adf6-4a4c-8e62-ce0af3f853d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5', 'volume_size': 1}
Nov 04 01:05:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:31 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img" returned: 0 in 8.194s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:31 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[574758e9-eecc-481b-aed0-e4e5c0649697]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:31 devstack sudo[99472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333
Nov 04 01:05:31 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:31 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333" returned: 0 in 0.622s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:31 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333, size 1024.00 MB, duration 8.19 sec, destination /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:05:31 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Converted 1024.00 MB image at 124.96 MB/s
Nov 04 01:05:31 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] 21f6ab65-1bb0-4c20-826c-f4ee36359ccc was raw, converting to qcow2 {{(pid=86660) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 04 01:05:31 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba81e089-e353-46af-8181-4224d60cbe33]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:31 devstack sudo[99479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img
Nov 04 01:05:31 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:32 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img" returned: 0 in 0.366s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:32 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img
Nov 04 01:05:32 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:32 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-bc465486-f3bb-4ee3-bfe0-c9aefb0031a4 req-f91edf5e-08af-480c-bd8f-db889cdcafdc tempest-TestMinimumBasicScenario-235530744 None] Terminate volume connection completed successfully.
Nov 04 01:05:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-bc465486-f3bb-4ee3-bfe0-c9aefb0031a4 req-f91edf5e-08af-480c-bd8f-db889cdcafdc tempest-TestMinimumBasicScenario-235530744 None] Deleting attachment 0c2794e0-519a-45c5-a06f-846d56d0f2af. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:05:32 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img" returned: 1 in 0.387s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:05:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img /opt/stack/data/cinder/conversion/vol_upload_kuv9d3tl {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:32 devstack sudo[99491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img /opt/stack/data/cinder/conversion/vol_upload_kuv9d3tl
Nov 04 01:05:32 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:32 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img /opt/stack/data/cinder/conversion/vol_upload_kuv9d3tl" returned: 0 in 0.257s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:32 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Image conversion details: src /opt/stack/data/cinder/conversion/11d57a42-f8ea-4ed0-bf53-f174436ae333.temp_image.21f6ab65-1bb0-4c20-826c-f4ee36359ccc711p8bht.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kuv9d3tl {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:05:32 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 04 01:05:32 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6344638-e3f8-472c-bfb6-bfea12187278]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kuv9d3tl {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:32 devstack sudo[99497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kuv9d3tl
Nov 04 01:05:32 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:33 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kuv9d3tl" returned: 0 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Acquiring lock "cinder-b01d9ee0-caf0-4254-bf57-ad32e92b2d69-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Lock "cinder-b01d9ee0-caf0-4254-bf57-ad32e92b2d69-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Acquiring lock "cinder-quobyte-b01d9ee0-caf0-4254-bf57-ad32e92b2d69" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Lock "cinder-quobyte-b01d9ee0-caf0-4254-bf57-ad32e92b2d69" acquired by "delete_volume" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b586cf59-d41a-431b-be99-613f7cdb27bc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:33 devstack sudo[99502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69
Nov 04 01:05:33 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:33 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69" returned: 0 in 0.365s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:33 devstack sudo[99508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69
Nov 04 01:05:33 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:33 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b01d9ee0-caf0-4254-bf57-ad32e92b2d69" returned: 0 in 0.271s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Lock "cinder-quobyte-b01d9ee0-caf0-4254-bf57-ad32e92b2d69" released by "delete_volume" :: held 0.675s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:33 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Created reservations ['4430185c-7cce-4a5b-abfa-a83c28953009', '07051a72-bc6e-487e-8d72-d07eea8ef37c', '904b5d22-65f6-4e5e-8483-d780ff7e4d51', '1b981db0-1807-4077-817a-4657b37a7c42'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:34 devstack sudo[99511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:34 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:34 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.270s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:34 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Deleted volume successfully.
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-770b7f16-8cd7-4c5a-80e9-bc56f4933c51 tempest-TestMinimumBasicScenario-235530744 None] Lock "cinder-b01d9ee0-caf0-4254-bf57-ad32e92b2d69-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.480s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Uploaded volume to glance image-id: 21f6ab65-1bb0-4c20-826c-f4ee36359ccc. {{(pid=86660) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.550s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-72690858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11848d5e-4249-4abe-a7fc-ae23d86d33c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:24Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Creating volume 11848d5e-4249-4abe-a7fc-ae23d86d33c7 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:05:34 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:05:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:34 devstack sudo[99514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7 1073741824
Nov 04 01:05:34 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:34 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-039064f1-60d1-438e-807c-cd304a808788 tempest-VolumesActionsTest-1327413969 None] Copy volume to image completed successfully.
Nov 04 01:05:35 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7 1073741824" returned: 0 in 0.633s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:35 devstack sudo[99539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7
Nov 04 01:05:35 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:35 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7" returned: 0 in 0.302s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.095s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=020dbd39-08a6-4e94-ba83-daac55e9ebe7,created_at=2026-11-04T00:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-444333916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=020dbd39-08a6-4e94-ba83-daac55e9ebe7,host='devstack@QuobyteHD#QuobyteHD',id=3a627e93-adf6-4a4c-8e62-ce0af3f853d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d12617b42b4e31a22f22987e4785c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:30Z,use_quota=True,user_id='c255c274f854434483f0961b0ec46b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0869913-84c2-4ee3-a58f-94b2d1fdc5c7),volume_type_id=d0869913-84c2-4ee3-a58f-94b2d1fdc5c7)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Creating volume 3a627e93-adf6-4a4c-8e62-ce0af3f853d5 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:05:35 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed1912d-7e85-4787-b891-bc436a35c321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:35 devstack sudo[99543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5 1073741824
Nov 04 01:05:35 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc100663-7a05-47cd-b195-4f76ddcc9737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:35 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Volume volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7 (11848d5e-4249-4abe-a7fc-ae23d86d33c7): created successfully
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc100663-7a05-47cd-b195-4f76ddcc9737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (08e0e429-c5ff-4a82-b71a-76a0a7b2cb83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:35 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8cc46ff9-e8b4-4612-b703-0ea27db42740 tempest-VolumesActionsTest-31614866 None] Created volume successfully.
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Acquiring lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Acquiring lock "cinder-quobyte-11d57a42-f8ea-4ed0-bf53-f174436ae333" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Lock "cinder-quobyte-11d57a42-f8ea-4ed0-bf53-f174436ae333" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8b873b-68ea-4c61-a336-b8d63012649e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:36 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5 1073741824" returned: 0 in 0.690s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:36 devstack sudo[99550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333
Nov 04 01:05:36 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:36 devstack sudo[99551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5
Nov 04 01:05:36 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:36 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5" returned: 0 in 0.301s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6649bdc-1ad2-4b89-8e63-42d5418492b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d283a3cf-236f-4c78-9639-0cdca3efaff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:36 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333" returned: 0 in 0.433s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:36 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Volume volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5 (3a627e93-adf6-4a4c-8e62-ce0af3f853d5): created successfully
Nov 04 01:05:36 devstack sudo[99558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333
Nov 04 01:05:36 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d283a3cf-236f-4c78-9639-0cdca3efaff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Flow 'volume_create_manager' (c499c7cd-3b5f-44b0-b519-1b1cad96c2b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:36 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-209f9a19-d9d6-4e8f-9776-fbd1648b7621 tempest-GroupsTest-1966760325 None] Created volume successfully.
Nov 04 01:05:36 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11d57a42-f8ea-4ed0-bf53-f174436ae333" returned: 0 in 0.257s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Lock "cinder-quobyte-11d57a42-f8ea-4ed0-bf53-f174436ae333" released by "delete_volume" :: held 0.743s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "cinder-11848d5e-4249-4abe-a7fc-ae23d86d33c7-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Created reservations ['a0aafa33-92ad-4c11-929e-030014c97e99', '25118c48-979b-4a65-9b07-89c217c48c54', 'bbbc4a0a-4daa-4f6f-829b-acbdf5a25cd5', '7528d42b-b3fe-4a68-9595-ec7c407c4253'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-11848d5e-4249-4abe-a7fc-ae23d86d33c7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "cinder-quobyte-11848d5e-4249-4abe-a7fc-ae23d86d33c7" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-quobyte-11848d5e-4249-4abe-a7fc-ae23d86d33c7" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1452a6-df57-4e99-9241-068e305aeeef]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:36 devstack sudo[99562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:36 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:37 devstack sudo[99561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7
Nov 04 01:05:37 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:37 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.278s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:37 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:37 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Deleted volume successfully.
Nov 04 01:05:37 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18ae2f7a-abb5-49ac-9ffa-6658a45c8fbc tempest-VolumesActionsTest-1327413969 None] Lock "cinder-11d57a42-f8ea-4ed0-bf53-f174436ae333-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:37 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7" returned: 0 in 0.479s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:37 devstack sudo[99569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7
Nov 04 01:05:37 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:37 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-11848d5e-4249-4abe-a7fc-ae23d86d33c7" returned: 0 in 0.357s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:37 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-quobyte-11848d5e-4249-4abe-a7fc-ae23d86d33c7" released by "delete_volume" :: held 0.891s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:37 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Created reservations ['4a5acbeb-d3a3-4b1c-9132-86efaaa3d179', 'a0326b75-c21d-4186-aa15-4f3c74ecee16', 'f84c0d49-fe17-4888-9842-935879f925c2', 'c2149a76-1cf4-4a35-917a-3073fadef320'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:38 devstack sudo[99573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:38 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Flow 'volume_create_manager' (6f9c84dc-88ed-4bbf-98ae-77be87118671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82634c09-2579-4cad-be2e-4d65db4ab638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82634c09-2579-4cad-be2e-4d65db4ab638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-937680018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=020dbd39-08a6-4e94-ba83-daac55e9ebe7,host='devstack@QuobyteHD#QuobyteHD',id=e160e732-d207-4dfa-b510-741e2694171f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d12617b42b4e31a22f22987e4785c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:38Z,use_quota=True,user_id='c255c274f854434483f0961b0ec46b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0869913-84c2-4ee3-a58f-94b2d1fdc5c7),volume_type_id=d0869913-84c2-4ee3-a58f-94b2d1fdc5c7)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95012fc6-4165-4cd1-8bd0-f0c1bb619a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95012fc6-4165-4cd1-8bd0-f0c1bb619a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f1d57c-14e9-4f25-a2eb-386750a448ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f1d57c-14e9-4f25-a2eb-386750a448ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e160e732-d207-4dfa-b510-741e2694171f', 'volume_name': 'volume-e160e732-d207-4dfa-b510-741e2694171f', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f94b7d3-4f06-4a2f-af86-7f6395e60b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f94b7d3-4f06-4a2f-af86-7f6395e60b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c706a91-f69b-4891-82f2-2a52b347d690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:38 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Volume e160e732-d207-4dfa-b510-741e2694171f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e160e732-d207-4dfa-b510-741e2694171f', 'volume_size': 1}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=020dbd39-08a6-4e94-ba83-daac55e9ebe7,created_at=2026-11-04T00:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-937680018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=020dbd39-08a6-4e94-ba83-daac55e9ebe7,host='devstack@QuobyteHD#QuobyteHD',id=e160e732-d207-4dfa-b510-741e2694171f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d12617b42b4e31a22f22987e4785c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:38Z,use_quota=True,user_id='c255c274f854434483f0961b0ec46b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0869913-84c2-4ee3-a58f-94b2d1fdc5c7),volume_type_id=d0869913-84c2-4ee3-a58f-94b2d1fdc5c7)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Creating volume e160e732-d207-4dfa-b510-741e2694171f {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:05:38 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:38 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.394s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:38 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Deleted volume successfully.
Nov 04 01:05:38 devstack sudo[99576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f 1073741824
Nov 04 01:05:38 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0bdab030-fb6d-4925-9a56-2e4c160497c5 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-11848d5e-4249-4abe-a7fc-ae23d86d33c7-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:38 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f 1073741824" returned: 0 in 0.538s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:39 devstack sudo[99583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f
Nov 04 01:05:39 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:39 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f" returned: 0 in 0.359s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c706a91-f69b-4891-82f2-2a52b347d690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e160e732-d207-4dfa-b510-741e2694171f', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0229877e-e88c-45a4-9a5b-78cb982b5b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:39 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Volume volume-e160e732-d207-4dfa-b510-741e2694171f (e160e732-d207-4dfa-b510-741e2694171f): created successfully
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0229877e-e88c-45a4-9a5b-78cb982b5b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Flow 'volume_create_manager' (6f9c84dc-88ed-4bbf-98ae-77be87118671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:39 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-321b631a-d4c9-4428-a3d3-57574a7d1aa6 tempest-GroupsTest-1966760325 None] Created volume successfully.
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (b71fc7c8-7885-4126-bbf5-87c591a1e56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85103dd-38d3-4e5e-a297-c49f71a132df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85103dd-38d3-4e5e-a297-c49f71a132df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2048878411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6375b397-b8e0-4f87-8744-ce115c062b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:40Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d41c18-7bb1-4ea8-8c37-882182eda6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d41c18-7bb1-4ea8-8c37-882182eda6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3b7c5f-9a11-418d-9ac1-4ae1697c606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3b7c5f-9a11-418d-9ac1-4ae1697c606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6375b397-b8e0-4f87-8744-ce115c062b9c', 'volume_name': 'volume-6375b397-b8e0-4f87-8744-ce115c062b9c', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0441aaf-2fc3-477f-a915-81fbeebfac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0441aaf-2fc3-477f-a915-81fbeebfac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d952fe-72d5-4447-ab12-21bd2fd939c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:39 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Volume 6375b397-b8e0-4f87-8744-ce115c062b9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6375b397-b8e0-4f87-8744-ce115c062b9c', 'volume_size': 1}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2048878411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6375b397-b8e0-4f87-8744-ce115c062b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:40Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Creating volume 6375b397-b8e0-4f87-8744-ce115c062b9c {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:05:39 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:05:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:39 devstack sudo[99587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c 1073741824
Nov 04 01:05:39 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fbb28e44-ab59-425e-b00d-219cf00ec86e tempest-GroupsTest-1966760325 None] Update group completed successfully.
Nov 04 01:05:39 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:40 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c 1073741824" returned: 0 in 0.530s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:40 devstack sudo[99594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c
Nov 04 01:05:40 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:40 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c" returned: 0 in 0.247s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:40 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:05:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d952fe-72d5-4447-ab12-21bd2fd939c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6375b397-b8e0-4f87-8744-ce115c062b9c', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bd7ef9-25e4-41e3-ab7a-c3106a78b048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:40 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Volume volume-6375b397-b8e0-4f87-8744-ce115c062b9c (6375b397-b8e0-4f87-8744-ce115c062b9c): created successfully
Nov 04 01:05:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bd7ef9-25e4-41e3-ab7a-c3106a78b048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (b71fc7c8-7885-4126-bbf5-87c591a1e56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:40 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-92ce3814-ee01-4594-8b6b-7a64d9e9746e tempest-VolumesActionsTest-31614866 None] Created volume successfully.
Nov 04 01:05:41 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-0c640091-e3b5-452a-b9fb-898f749b9292 tempest-GroupsTest-1966760325 None] Update group completed successfully.
Nov 04 01:05:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "cinder-6375b397-b8e0-4f87-8744-ce115c062b9c-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-6375b397-b8e0-4f87-8744-ce115c062b9c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "cinder-quobyte-6375b397-b8e0-4f87-8744-ce115c062b9c" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-quobyte-6375b397-b8e0-4f87-8744-ce115c062b9c" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:42 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[06163750-82e8-446c-b775-b77d5884fa92]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:42 devstack sudo[99597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c
Nov 04 01:05:42 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:42 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c" returned: 0 in 0.492s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:42 devstack sudo[99604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c
Nov 04 01:05:42 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:42 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6375b397-b8e0-4f87-8744-ce115c062b9c" returned: 0 in 0.356s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-quobyte-6375b397-b8e0-4f87-8744-ce115c062b9c" released by "delete_volume" :: held 0.907s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Created reservations ['d3f74b7a-0a29-4ef2-b634-4b896e2ed649', '2306247f-54f7-4caf-b224-621ae5bbd411', '0d255499-9024-411f-b679-b22b42ce541c', '6e073f80-739c-495c-ae8b-434504168b7f'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Acquiring lock "cinder-quobyte-3a627e93-adf6-4a4c-8e62-ce0af3f853d5" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Lock "cinder-quobyte-3a627e93-adf6-4a4c-8e62-ce0af3f853d5" acquired by "delete_volume" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a3108b-c9cd-4cf0-bcfb-bf94cffd69e6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:43 devstack sudo[99608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:43 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:43 devstack sudo[99607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5
Nov 04 01:05:43 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:43 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.279s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:43 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Deleted volume successfully.
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-51aaf548-6869-4977-a19c-691438f7fab1 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-6375b397-b8e0-4f87-8744-ce115c062b9c-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:43 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5" returned: 0 in 0.427s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:43 devstack sudo[99615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5
Nov 04 01:05:43 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:43 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3a627e93-adf6-4a4c-8e62-ce0af3f853d5" returned: 0 in 0.287s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Lock "cinder-quobyte-3a627e93-adf6-4a4c-8e62-ce0af3f853d5" released by "delete_volume" :: held 0.813s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Acquiring lock "cinder-quobyte-e160e732-d207-4dfa-b510-741e2694171f" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Lock "cinder-quobyte-e160e732-d207-4dfa-b510-741e2694171f" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:44 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc37f0a-4d1e-4202-a3ae-2e40aa91b3fa]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:44 devstack sudo[99618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f
Nov 04 01:05:44 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:44 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f" returned: 0 in 0.482s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:44 devstack sudo[99623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f
Nov 04 01:05:44 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:44 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e160e732-d207-4dfa-b510-741e2694171f" returned: 0 in 0.297s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Lock "cinder-quobyte-e160e732-d207-4dfa-b510-741e2694171f" released by "delete_volume" :: held 0.851s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:44 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Created reservations ['e1b8148b-ec6c-433e-8ec2-32ad1f383518'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:44 devstack cinder-volume[86660]: WARNING cinder.quota [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-193890172 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-193890172, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:05:44 devstack cinder-volume[86660]: WARNING cinder.quota [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-193890172 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-193890172, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Created reservations ['55de56a6-5f2b-4d12-af42-98b2d5bf047f', '46e433b8-9c7c-49c4-92c8-d0ceffa93e76', '24e4df81-d2a5-4773-9203-c6e3a17eed3b', '0407cc6d-a739-4707-acf7-afe5d73814e0'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (8669acb0-2a87-4a42-994f-fb23e5dd99aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa93e40-fcc1-4f2d-86e1-da7cc5a54cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa93e40-fcc1-4f2d-86e1-da7cc5a54cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-911051041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34564ab0-73fa-46cf-8af4-826941e90e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:45Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470408dc-faaa-4e78-ac7c-755c83acdb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470408dc-faaa-4e78-ac7c-755c83acdb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b5b1ea-0eea-44a1-a10c-eef26d0a355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b5b1ea-0eea-44a1-a10c-eef26d0a355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34564ab0-73fa-46cf-8af4-826941e90e14', 'volume_name': 'volume-34564ab0-73fa-46cf-8af4-826941e90e14', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8308d3a2-47f1-47b3-88b5-b6a2aa66c230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8308d3a2-47f1-47b3-88b5-b6a2aa66c230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed930f72-36a1-4e34-a053-d6290cbf6b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:45 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Volume 34564ab0-73fa-46cf-8af4-826941e90e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34564ab0-73fa-46cf-8af4-826941e90e14', 'volume_size': 1}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-911051041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34564ab0-73fa-46cf-8af4-826941e90e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:45Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Creating volume 34564ab0-73fa-46cf-8af4-826941e90e14 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:05:45 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:45 devstack sudo[99627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14 1073741824
Nov 04 01:05:45 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Created reservations ['2db15658-c835-42d7-86f9-167d236e9648', '56eb3204-398c-4c38-bfed-afb52abcea5c', '67da981b-f165-4f81-b569-a284f7309e3a', 'df1e1ac7-e21c-45ae-a71d-ac95f9f1dd71'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:45 devstack sudo[99629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:45 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:45 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14 1073741824" returned: 0 in 0.567s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:45 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.364s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2e6ab980-6d72-412a-9b3c-47d9b7745d85 tempest-GroupsTest-1966760325 None] Delete group completed successfully.
Nov 04 01:05:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:45 devstack sudo[99637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14
Nov 04 01:05:45 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:46 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14" returned: 0 in 0.323s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:05:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed930f72-36a1-4e34-a053-d6290cbf6b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34564ab0-73fa-46cf-8af4-826941e90e14', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f01854-92ad-43d4-b309-f02cd691dc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:46 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Volume volume-34564ab0-73fa-46cf-8af4-826941e90e14 (34564ab0-73fa-46cf-8af4-826941e90e14): created successfully
Nov 04 01:05:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f01854-92ad-43d4-b309-f02cd691dc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (8669acb0-2a87-4a42-994f-fb23e5dd99aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:46 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-eab94c52-cbfb-4d20-83a5-e253cdecaa49 tempest-VolumesActionsTest-31614866 None] Created volume successfully.
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Flow 'volume_create_manager' (b45b0d88-62df-4ed9-b7e3-23230ec1c50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949bb532-4a46-4742-a1a9-71fd20f6deb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949bb532-4a46-4742-a1a9-71fd20f6deb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-655408530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6facef6c71624ebd9df1828e24ea8ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:47Z,use_quota=True,user_id='4831db5271504883b3f63c5aa53b13ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fa7443-62d8-4c00-8118-f6fc8e09f63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fa7443-62d8-4c00-8118-f6fc8e09f63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42e3917-1ae0-40d0-8f10-c1109951b4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.image.glance [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Creating Keystone auth plugin from conf {{(pid=86660) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "cinder-34564ab0-73fa-46cf-8af4-826941e90e14-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-34564ab0-73fa-46cf-8af4-826941e90e14-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "cinder-quobyte-34564ab0-73fa-46cf-8af4-826941e90e14" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-quobyte-34564ab0-73fa-46cf-8af4-826941e90e14" acquired by "delete_volume" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad667f9d-6e36-45e0-92c8-5691a8a3f16e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:47 devstack sudo[99640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14
Nov 04 01:05:47 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42e3917-1ae0-40d0-8f10-c1109951b4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9', 'volume_name': 'volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b5477a9340>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e54bcd-901d-43f1-8bc3-4824078e9005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e54bcd-901d-43f1-8bc3-4824078e9005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58779be-e233-40b9-95bb-dcbcc05e3b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:48 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Volume 2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b5477a9340>}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Trying to clone 2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 from image feeea883-a973-4c2d-b14e-c13d05c107a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]). {{(pid=86660) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 01:05:48 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14" returned: 0 in 0.567s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:48 devstack sudo[99645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14
Nov 04 01:05:48 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 01:05:48 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Image download 20.69 MB at 20.69 MB/s
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b29d18-2dee-4780-93fe-bb3169eb89e7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:48 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-34564ab0-73fa-46cf-8af4-826941e90e14" returned: 0 in 0.340s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-quobyte-34564ab0-73fa-46cf-8af4-826941e90e14" released by "delete_volume" :: held 0.983s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:48 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD
Nov 04 01:05:48 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Created reservations ['afb78482-71ea-4640-8eb0-beed3a3f193b', 'd7d702b7-a8f6-440e-b18c-db39ac6f6b84', '5ddd58e4-d922-4454-81da-701527d09f2f', '2170f4d7-55ac-4a94-820b-ebbb157d413e'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:48 devstack sudo[99652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:48 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:49 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD" returned: 0 in 0.455s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Temporary image feeea883-a973-4c2d-b14e-c13d05c107a4 is fetched for user 4831db5271504883b3f63c5aa53b13ec. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 01:05:49 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.307s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ed46a4-44d8-4bec-b6f4-8e5dddd2460d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:49 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Deleted volume successfully.
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-652d1544-3fbb-47f1-827f-e524bafd68b6 tempest-VolumesActionsTest-1158081488 None] Lock "cinder-34564ab0-73fa-46cf-8af4-826941e90e14-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:49 devstack sudo[99658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD
Nov 04 01:05:49 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:49 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-655408530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6facef6c71624ebd9df1828e24ea8ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:47Z,use_quota=True,user_id='4831db5271504883b3f63c5aa53b13ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Creating volume 2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:05:49 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:05:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:49 devstack sudo[99664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 1073741824
Nov 04 01:05:49 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:50 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 1073741824" returned: 0 in 0.569s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:50 devstack sudo[99671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9
Nov 04 01:05:50 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (5dfe52b6-0181-4939-9515-35b3f8512743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76b9b3c-8bc1-440a-a411-3990e16fa01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76b9b3c-8bc1-440a-a411-3990e16fa01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2115995344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53909e20-84ef-4396-a776-fad8e9a77dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:51Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de23e921-116b-4ba3-b6b5-b04181f9bdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de23e921-116b-4ba3-b6b5-b04181f9bdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcdd940-cc85-414f-a8b6-ce603524cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcdd940-cc85-414f-a8b6-ce603524cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53909e20-84ef-4396-a776-fad8e9a77dc4', 'volume_name': 'volume-53909e20-84ef-4396-a776-fad8e9a77dc4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4072bae5-81b0-407c-bf0a-3f8a790d7d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4072bae5-81b0-407c-bf0a-3f8a790d7d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:50 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef6234c-deb9-4128-956f-69114dd4278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:50 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Volume 53909e20-84ef-4396-a776-fad8e9a77dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53909e20-84ef-4396-a776-fad8e9a77dc4', 'volume_size': 1}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9" returned: 0 in 0.425s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2115995344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53909e20-84ef-4396-a776-fad8e9a77dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71fff8142d8b4f5e9abff34fb1d66eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:05:51Z,use_quota=True,user_id='ef1d8b363fe34566bd5f28dafefb565f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Creating volume 53909e20-84ef-4396-a776-fad8e9a77dc4 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:05:50 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:50 devstack sudo[99675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4 1073741824
Nov 04 01:05:50 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Attempting download of feeea883-a973-4c2d-b14e-c13d05c107a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}])) to volume 2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef330b72-47e3-4c54-a825-88e93a796604]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_t0q8b1bf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:50 devstack sudo[99677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_t0q8b1bf
Nov 04 01:05:50 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:51 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_t0q8b1bf" returned: 0 in 0.420s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_t0q8b1bf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:51 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4 1073741824" returned: 0 in 0.597s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:51 devstack sudo[99685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_t0q8b1bf
Nov 04 01:05:51 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:51 devstack sudo[99686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4
Nov 04 01:05:51 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:51 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:51 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4" returned: 0 in 0.340s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_t0q8b1bf" returned: 1 in 0.487s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_t0q8b1bf' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:51 devstack sudo[99692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[634402e0-0f00-49d9-8ae2-76edf6e04206]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:51 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef6234c-deb9-4128-956f-69114dd4278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53909e20-84ef-4396-a776-fad8e9a77dc4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0138d8-0363-4b56-9f9c-1080112bae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:51 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Volume volume-53909e20-84ef-4396-a776-fad8e9a77dc4 (53909e20-84ef-4396-a776-fad8e9a77dc4): created successfully
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0138d8-0363-4b56-9f9c-1080112bae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Flow 'volume_create_manager' (5dfe52b6-0181-4939-9515-35b3f8512743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:51 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cc50ddf0-5217-40ef-b4d5-50b9b72f665d tempest-VolumesActionsTest-31614866 None] Created volume successfully.
Nov 04 01:05:51 devstack sudo[99694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD
Nov 04 01:05:51 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:52 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.306s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:05:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:05:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:05:52 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:52 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] feeea883-a973-4c2d-b14e-c13d05c107a4 was qcow2, converting to qcow2 {{(pid=86660) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 01:05:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:52 devstack sudo[99700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9
Nov 04 01:05:52 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Acquiring lock "cinder-53909e20-84ef-4396-a776-fad8e9a77dc4-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Lock "cinder-53909e20-84ef-4396-a776-fad8e9a77dc4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Acquiring lock "cinder-quobyte-53909e20-84ef-4396-a776-fad8e9a77dc4" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Lock "cinder-quobyte-53909e20-84ef-4396-a776-fad8e9a77dc4" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:53 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f2a31e-41ab-455f-b380-5c1d7ae51748]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:53 devstack sudo[99709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4
Nov 04 01:05:53 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:54 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2da46b5f-fb09-4b7a-be85-ebe65fad8882 tempest-GroupsV320Test-1828277103 None] Group tempest-GroupsV320Test-Group-103577925: creating
Nov 04 01:05:54 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2da46b5f-fb09-4b7a-be85-ebe65fad8882 tempest-GroupsV320Test-1828277103 None] Group tempest-GroupsV320Test-Group-103577925: created successfully
Nov 04 01:05:54 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2da46b5f-fb09-4b7a-be85-ebe65fad8882 tempest-GroupsV320Test-1828277103 None] Create group completed successfully.
Nov 04 01:05:54 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4" returned: 0 in 0.582s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:54 devstack sudo[99714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4
Nov 04 01:05:54 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:54 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-53909e20-84ef-4396-a776-fad8e9a77dc4" returned: 0 in 0.302s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Lock "cinder-quobyte-53909e20-84ef-4396-a776-fad8e9a77dc4" released by "delete_volume" :: held 0.938s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Created reservations ['3965e950-822d-4c42-98cc-4b95c5e3ce7e', '9fde835d-1ebd-4fa5-861b-8df93795bcce', 'f7233ad3-49cb-4232-a4b8-0d44c25eb474', 'e582dafc-7163-4f23-9956-5ce5d9e569f4'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:54 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9" returned: 0 in 2.627s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_7yt8qfr3devstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:05:54 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Converted 112.00 MB image at 42.60 MB/s
Nov 04 01:05:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:54 devstack sudo[99717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:54 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:54 devstack sudo[99719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 1G
Nov 04 01:05:54 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:55 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.248s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Deleted volume successfully.
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0762235b-3871-419a-9761-dd5aec7ef7a8 tempest-VolumesActionsTest-31614866 None] Lock "cinder-53909e20-84ef-4396-a776-fad8e9a77dc4-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:55 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 1G" returned: 0 in 0.422s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Downloaded image feeea883-a973-4c2d-b14e-c13d05c107a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}])) to volume 2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 successfully. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Temporary image feeea883-a973-4c2d-b14e-c13d05c107a4 for user 4831db5271504883b3f63c5aa53b13ec is deleted. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Marking volume 2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 as bootable. {{(pid=86660) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Copying metadata from image feeea883-a973-4c2d-b14e-c13d05c107a4 to 2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9. {{(pid=86660) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Creating volume glance metadata for volume 2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 backed by image feeea883-a973-4c2d-b14e-c13d05c107a4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86660) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58779be-e233-40b9-95bb-dcbcc05e3b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b5477a9340>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a2122e-21ce-4b98-a135-e5d6d961b63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:05:55 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Volume volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 (2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9): created successfully
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a2122e-21ce-4b98-a135-e5d6d961b63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Flow 'volume_create_manager' (b45b0d88-62df-4ed9-b7e3-23230ec1c50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:05:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9f7d9426-5a7a-4566-88f4-902e4ee64f6b tempest-VolumesExtendTest-2097549324 None] Created volume successfully.
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-8e8362ac-629f-484e-96c6-bcc19381449b tempest-GroupsV320Test-1828277103 None] Created reservations ['3efdb42b-f193-4e7d-9972-33815b3a99da'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e8362ac-629f-484e-96c6-bcc19381449b tempest-GroupsV320Test-1828277103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e8362ac-629f-484e-96c6-bcc19381449b tempest-GroupsV320Test-1828277103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8e8362ac-629f-484e-96c6-bcc19381449b tempest-GroupsV320Test-1828277103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8e8362ac-629f-484e-96c6-bcc19381449b tempest-GroupsV320Test-1828277103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e8362ac-629f-484e-96c6-bcc19381449b tempest-GroupsV320Test-1828277103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e8362ac-629f-484e-96c6-bcc19381449b tempest-GroupsV320Test-1828277103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:55 devstack sudo[99726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:55 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:55 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e8362ac-629f-484e-96c6-bcc19381449b tempest-GroupsV320Test-1828277103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.261s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:55 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-8e8362ac-629f-484e-96c6-bcc19381449b tempest-GroupsV320Test-1828277103 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:56 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8e8362ac-629f-484e-96c6-bcc19381449b tempest-GroupsV320Test-1828277103 None] Delete group completed successfully.
Nov 04 01:05:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4d71f141-435a-48a5-8ed3-95b5adb0a849 tempest-VolumesExtendTest-2097549324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4d71f141-435a-48a5-8ed3-95b5adb0a849 tempest-VolumesExtendTest-2097549324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc84131e-2276-403f-a296-fba71af6a024]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4d71f141-435a-48a5-8ed3-95b5adb0a849 tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:56 devstack sudo[99729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9
Nov 04 01:05:56 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:56 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4d71f141-435a-48a5-8ed3-95b5adb0a849 tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9" returned: 0 in 0.495s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4d71f141-435a-48a5-8ed3-95b5adb0a849 tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 2G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4d71f141-435a-48a5-8ed3-95b5adb0a849 tempest-VolumesExtendTest-2097549324 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 2G" returned: 0 in 0.165s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4d71f141-435a-48a5-8ed3-95b5adb0a849 tempest-VolumesExtendTest-2097549324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.707s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4d71f141-435a-48a5-8ed3-95b5adb0a849 tempest-VolumesExtendTest-2097549324 None] Extend volume completed successfully.
Nov 04 01:05:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Acquiring lock "cinder-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Lock "cinder-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Acquiring lock "cinder-quobyte-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:05:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Lock "cinder-quobyte-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9" acquired by "delete_volume" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:05:58 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec762a6-1df7-4fe0-ae82-6a83e358ade5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:05:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:58 devstack sudo[99739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9
Nov 04 01:05:58 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:58 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9" returned: 0 in 0.553s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:58 devstack sudo[99744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9
Nov 04 01:05:58 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:59 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9" returned: 0 in 0.290s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Lock "cinder-quobyte-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9" released by "delete_volume" :: held 0.899s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Created reservations ['3138e5c3-4b6a-4c97-88c9-c58b4dcb519e', '61585f0d-6468-485d-9dbe-8a7961c0592c', '81123761-b8ca-4859-95f2-c74b5d03912b', 'e1aa5bc0-5e88-4404-8cbd-ae412da87800'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:05:59 devstack sudo[99747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:05:59 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:05:59 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.270s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:05:59 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Deleted volume successfully.
Nov 04 01:05:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4d8d7cc8-ee45-4155-9b1e-ca7f57591278 tempest-VolumesExtendTest-2097549324 None] Lock "cinder-2c86deb6-4c3f-4189-b1c9-f2aa00a9a9f9-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:00 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:06:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Flow 'volume_create_manager' (beef817b-d91b-4784-9183-d6210f483273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264849a1-1cd7-462b-b677-929726d979d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264849a1-1cd7-462b-b677-929726d979d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-149898732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6154ae-fe51-4f7c-88b8-0644bc1642f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6facef6c71624ebd9df1828e24ea8ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:01Z,use_quota=True,user_id='4831db5271504883b3f63c5aa53b13ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07666e4f-d1ed-4550-96b0-0ec4c96ec1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07666e4f-d1ed-4550-96b0-0ec4c96ec1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bd15ae-9de3-420e-b39f-331c16236de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bd15ae-9de3-420e-b39f-331c16236de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6154ae-fe51-4f7c-88b8-0644bc1642f8', 'volume_name': 'volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d9f980-e180-41d3-b59d-344b78b7055d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d9f980-e180-41d3-b59d-344b78b7055d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec371904-437d-4a9b-a944-d6aaa98e3a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Volume 0e6154ae-fe51-4f7c-88b8-0644bc1642f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8', 'volume_size': 1}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-149898732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6154ae-fe51-4f7c-88b8-0644bc1642f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6facef6c71624ebd9df1828e24ea8ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:01Z,use_quota=True,user_id='4831db5271504883b3f63c5aa53b13ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Creating volume 0e6154ae-fe51-4f7c-88b8-0644bc1642f8 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:06:01 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:01 devstack sudo[99752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 1073741824
Nov 04 01:06:01 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:01 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 1073741824" returned: 0 in 0.630s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:01 devstack sudo[99758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8
Nov 04 01:06:01 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:02 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" returned: 0 in 0.400s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:06:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec371904-437d-4a9b-a944-d6aaa98e3a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f721bda0-75a5-4f51-b3da-34f1a2002a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:02 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Volume volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 (0e6154ae-fe51-4f7c-88b8-0644bc1642f8): created successfully
Nov 04 01:06:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f721bda0-75a5-4f51-b3da-34f1a2002a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Flow 'volume_create_manager' (beef817b-d91b-4784-9183-d6210f483273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:02 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1f9d8633-a594-4662-b88d-cfffd4978b5c tempest-VolumesExtendTest-2097549324 None] Created volume successfully.
Nov 04 01:06:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] Creating offline snapshot b6d5dc5d-686d-4214-b31f-09eb276e2d53 of volume 0e6154ae-fe51-4f7c-88b8-0644bc1642f8 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:06:03 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b0e699-1150-4977-a33a-d25009308c83]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:03 devstack sudo[99761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8
Nov 04 01:06:03 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:03 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" returned: 0 in 0.431s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:03 devstack sudo[99766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 1G
Nov 04 01:06:03 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:04 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 1G" returned: 0 in 0.587s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:04 devstack sudo[99776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53
Nov 04 01:06:04 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:04 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53" returned: 0 in 0.394s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:04 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 is being set with open permissions: ugo+rw
Nov 04 01:06:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:04 devstack sudo[99782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53
Nov 04 01:06:04 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:05 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53" returned: 0 in 0.314s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:05 devstack sudo[99785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.info
Nov 04 01:06:05 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:05 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.info" returned: 0 in 0.345s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:05 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.info is being set with open permissions: ugo+rw
Nov 04 01:06:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:05 devstack sudo[99788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.info
Nov 04 01:06:05 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:05 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.info" returned: 0 in 0.353s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:06 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cdd9967c-8bbe-4e62-a237-14f088fb65ab tempest-VolumesExtendTest-2097549324 None] Create snapshot completed successfully
Nov 04 01:06:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5f4b40a2-a956-4412-a398-8d3bb33a8a9c tempest-VolumesExtendTest-2097549324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5f4b40a2-a956-4412-a398-8d3bb33a8a9c tempest-VolumesExtendTest-2097549324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[205f828f-6457-4c4f-bd42-5b13bdb123cb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5f4b40a2-a956-4412-a398-8d3bb33a8a9c tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:06 devstack sudo[99791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8
Nov 04 01:06:06 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:07 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5f4b40a2-a956-4412-a398-8d3bb33a8a9c tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" returned: 0 in 0.505s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5f4b40a2-a956-4412-a398-8d3bb33a8a9c tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 2G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5f4b40a2-a956-4412-a398-8d3bb33a8a9c tempest-VolumesExtendTest-2097549324 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 2G" returned: 0 in 0.194s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5f4b40a2-a956-4412-a398-8d3bb33a8a9c tempest-VolumesExtendTest-2097549324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.769s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:07 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5f4b40a2-a956-4412-a398-8d3bb33a8a9c tempest-VolumesExtendTest-2097549324 None] Extend volume completed successfully.
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Acquiring lock "cinder-b6d5dc5d-686d-4214-b31f-09eb276e2d53-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Lock "cinder-b6d5dc5d-686d-4214-b31f-09eb276e2d53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Acquiring lock "cinder-quobyte-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Lock "cinder-quobyte-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Acquiring lock "cinder-quobyte-b6d5dc5d-686d-4214-b31f-09eb276e2d53" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Lock "cinder-quobyte-b6d5dc5d-686d-4214-b31f-09eb276e2d53" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Deleting offline snapshot b6d5dc5d-686d-4214-b31f-09eb276e2d53 of volume 0e6154ae-fe51-4f7c-88b8-0644bc1642f8 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] snapshot_file for this snap is: volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4d423b-06f0-43a5-994a-a035f3fa5b6b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:08 devstack sudo[99800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53
Nov 04 01:06:08 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:08 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53" returned: 0 in 0.609s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d666ff-74cc-4840-a9c9-b168d1b22eaf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:08 devstack sudo[99805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8
Nov 04 01:06:08 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:09 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" returned: 0 in 0.407s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:09 devstack sudo[99811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53
Nov 04 01:06:09 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:09 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53" returned: 0 in 0.613s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:09 devstack sudo[99850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53
Nov 04 01:06:09 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:10 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8.b6d5dc5d-686d-4214-b31f-09eb276e2d53" returned: 0 in 0.367s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Lock "cinder-quobyte-b6d5dc5d-686d-4214-b31f-09eb276e2d53" released by "_delete_snapshot" :: held 2.187s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Lock "cinder-quobyte-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" released by "delete_snapshot" :: held 2.223s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:10 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Created reservations ['893b1204-2745-4705-aa74-b92aba0f1044', '99046266-de32-4af7-9109-a3238b99d05b', '8d3af973-c9fd-448b-9a17-68cf38b0d8af', '38b68a43-9b46-460c-9ba2-76797c3a1f66'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Delete snapshot completed successfully.
Nov 04 01:06:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5551425f-bbd8-4828-b12f-0baa03de5c5c tempest-VolumesExtendTest-2097549324 None] Lock "cinder-b6d5dc5d-686d-4214-b31f-09eb276e2d53-delete_snapshot" released by "delete_snapshot" :: held 2.432s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Acquiring lock "cinder-0e6154ae-fe51-4f7c-88b8-0644bc1642f8-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Lock "cinder-0e6154ae-fe51-4f7c-88b8-0644bc1642f8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Acquiring lock "cinder-quobyte-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Lock "cinder-quobyte-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" acquired by "delete_volume" :: waited 0.021s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:11 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[66219135-7a6a-4ea7-9c8a-2d284191793a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:11 devstack sudo[99857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8
Nov 04 01:06:11 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:12 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" returned: 0 in 0.677s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:12 devstack sudo[99863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8
Nov 04 01:06:12 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:12 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" returned: 0 in 0.423s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Lock "cinder-quobyte-0e6154ae-fe51-4f7c-88b8-0644bc1642f8" released by "delete_volume" :: held 1.180s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:12 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Created reservations ['11d304e8-a1d8-4228-a474-e216a3099908', '9d5e3b3b-786f-4424-b8c4-052044ca11ec', 'bac05d4b-e5e8-419d-9391-70202072fb0f', 'c6b0fbe6-5431-4e4f-b757-bf7ec0a9589b'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:12 devstack sudo[99872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:06:12 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:13 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.326s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:13 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:06:13 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Deleted volume successfully.
Nov 04 01:06:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9f1eb9cf-68f9-4c92-976a-a06c25aeb29a tempest-VolumesExtendTest-2097549324 None] Lock "cinder-0e6154ae-fe51-4f7c-88b8-0644bc1642f8-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=129,cinder:UPDATE=143,cinder:INSERT=39,cinder:DELETE=13 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=166,cinder:SELECT=122,cinder:INSERT=41,cinder:DELETE=7 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Flow 'volume_create_manager' (5fc48deb-a652-43f5-ad78-4421d384cd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8fea48-8dfe-4a61-ad8b-b87c12ec9566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8fea48-8dfe-4a61-ad8b-b87c12ec9566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-145674037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2565e780-6da9-4d16-922e-1634971478e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fd90bc394f4ad787566710e321306e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:23Z,use_quota=True,user_id='2a797339d44b41a9bb51becab98d4abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c13dfd5-784c-429b-8447-6717490c6343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c13dfd5-784c-429b-8447-6717490c6343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f5cdd2-2bfc-4784-a3e4-288cdf9d97db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f5cdd2-2bfc-4784-a3e4-288cdf9d97db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2565e780-6da9-4d16-922e-1634971478e4', 'volume_name': 'volume-2565e780-6da9-4d16-922e-1634971478e4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb04842-a23a-42d1-89ca-0e147fcd0d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb04842-a23a-42d1-89ca-0e147fcd0d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfc5953-6246-444a-83ff-d26da3fdf31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:22 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Volume 2565e780-6da9-4d16-922e-1634971478e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2565e780-6da9-4d16-922e-1634971478e4', 'volume_size': 1}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-145674037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2565e780-6da9-4d16-922e-1634971478e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fd90bc394f4ad787566710e321306e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:23Z,use_quota=True,user_id='2a797339d44b41a9bb51becab98d4abc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Creating volume 2565e780-6da9-4d16-922e-1634971478e4 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:06:22 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:06:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:22 devstack sudo[99878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4 1073741824
Nov 04 01:06:22 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Flow 'volume_create_manager' (2e43b87f-264d-441f-b530-88b960243f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62123bd6-cc91-4f1b-a94e-955fcfeeded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:23 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4 1073741824" returned: 0 in 0.665s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62123bd6-cc91-4f1b-a94e-955fcfeeded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-261819227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18386f21-bb27-4619-a177-f1db8e41c065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5d3234f76240b4bc66d4aa235bcc38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:23Z,use_quota=True,user_id='fda02bb3aefe43459d729b2f331bdf7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776ddff7-9bc0-4149-b2c4-123d6c880f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776ddff7-9bc0-4149-b2c4-123d6c880f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee7ad53-6d49-455d-bbb5-a2694f6b3c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee7ad53-6d49-455d-bbb5-a2694f6b3c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18386f21-bb27-4619-a177-f1db8e41c065', 'volume_name': 'volume-18386f21-bb27-4619-a177-f1db8e41c065', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997dd46d-439a-45cd-86db-4d37b33f3f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997dd46d-439a-45cd-86db-4d37b33f3f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c138d5-696c-45b4-b456-4a090b054b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:23 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Volume 18386f21-bb27-4619-a177-f1db8e41c065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18386f21-bb27-4619-a177-f1db8e41c065', 'volume_size': 1}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:23 devstack sudo[99884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4
Nov 04 01:06:23 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:23 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4" returned: 0 in 0.301s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.339s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-261819227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18386f21-bb27-4619-a177-f1db8e41c065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5d3234f76240b4bc66d4aa235bcc38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:23Z,use_quota=True,user_id='fda02bb3aefe43459d729b2f331bdf7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Creating volume 18386f21-bb27-4619-a177-f1db8e41c065 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:06:23 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:06:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:24 devstack sudo[99887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065 1073741824
Nov 04 01:06:24 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfc5953-6246-444a-83ff-d26da3fdf31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2565e780-6da9-4d16-922e-1634971478e4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c0ceae-ecab-4a8c-985c-6c60ef5aa537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Flow 'volume_create_manager' (9a450287-a80e-4e3d-86da-bf4463782d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be9cd41-b080-4635-9486-1ea9e7a24101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:24 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Volume volume-2565e780-6da9-4d16-922e-1634971478e4 (2565e780-6da9-4d16-922e-1634971478e4): created successfully
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c0ceae-ecab-4a8c-985c-6c60ef5aa537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Flow 'volume_create_manager' (5fc48deb-a652-43f5-ad78-4421d384cd1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be9cd41-b080-4635-9486-1ea9e7a24101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-153636851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c516347-0dd8-4d45-a802-a400a6ca5729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa37d0ca245249468213beb06e748053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:24Z,use_quota=True,user_id='147aadb49ddf4f318b45587b9d94424c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703c2901-a3d4-4502-845d-eef246192160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703c2901-a3d4-4502-845d-eef246192160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b6bc2b-a522-4ece-82c9-df47fd934fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b6bc2b-a522-4ece-82c9-df47fd934fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c516347-0dd8-4d45-a802-a400a6ca5729', 'volume_name': 'volume-5c516347-0dd8-4d45-a802-a400a6ca5729', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c2f50a-f49a-48de-8cff-de077d14cf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c2f50a-f49a-48de-8cff-de077d14cf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1607a2c-8aed-428f-8d50-84b84717094d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:24 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Volume 5c516347-0dd8-4d45-a802-a400a6ca5729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c516347-0dd8-4d45-a802-a400a6ca5729', 'volume_size': 1}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:24 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cbe5761a-d8bb-4f85-93ad-1b634b564273 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Created volume successfully.
Nov 04 01:06:24 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065 1073741824" returned: 0 in 0.550s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:24 devstack sudo[99892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065
Nov 04 01:06:24 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:24 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065" returned: 0 in 0.263s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-153636851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c516347-0dd8-4d45-a802-a400a6ca5729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa37d0ca245249468213beb06e748053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:24Z,use_quota=True,user_id='147aadb49ddf4f318b45587b9d94424c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Creating volume 5c516347-0dd8-4d45-a802-a400a6ca5729 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:06:24 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c138d5-696c-45b4-b456-4a090b054b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18386f21-bb27-4619-a177-f1db8e41c065', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:24 devstack sudo[99895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 1073741824
Nov 04 01:06:24 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a10635b-b84a-4c29-a4a9-12efe1859640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:24 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Volume volume-18386f21-bb27-4619-a177-f1db8e41c065 (18386f21-bb27-4619-a177-f1db8e41c065): created successfully
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a10635b-b84a-4c29-a4a9-12efe1859640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Flow 'volume_create_manager' (2e43b87f-264d-441f-b530-88b960243f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:24 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f0fca7d9-8625-4392-82f2-800a14143fb5 tempest-SnapshotMetadataTestJSON-857260443 None] Created volume successfully.
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Flow 'volume_create_manager' (7461a245-a8f6-4724-a92a-e741b096de75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6f9174-40ba-4788-ac00-996b453ac17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6f9174-40ba-4788-ac00-996b453ac17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-531949227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed682926-f5f1-4b87-bcc6-c70c3da57308,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0410dc6e0d6041caa024f366a413b8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:25Z,use_quota=True,user_id='89ce637e8d294f57ab521755044f611e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d6dbce-bf97-41bc-b70b-b81ee20bfef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d6dbce-bf97-41bc-b70b-b81ee20bfef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d728788b-f5aa-4372-8da9-b99f97a1ab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d728788b-f5aa-4372-8da9-b99f97a1ab8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed682926-f5f1-4b87-bcc6-c70c3da57308', 'volume_name': 'volume-ed682926-f5f1-4b87-bcc6-c70c3da57308', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794d2e16-947a-498a-b810-b2f854d5fcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794d2e16-947a-498a-b810-b2f854d5fcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90b891a-0a57-46ed-b586-9d0e9fd0cbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:25 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Volume ed682926-f5f1-4b87-bcc6-c70c3da57308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed682926-f5f1-4b87-bcc6-c70c3da57308', 'volume_size': 1}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:25 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 1073741824" returned: 0 in 0.731s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:25 devstack sudo[99904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729
Nov 04 01:06:25 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:25 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729" returned: 0 in 0.270s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-531949227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed682926-f5f1-4b87-bcc6-c70c3da57308,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0410dc6e0d6041caa024f366a413b8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:25Z,use_quota=True,user_id='89ce637e8d294f57ab521755044f611e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Creating volume ed682926-f5f1-4b87-bcc6-c70c3da57308 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:06:25 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1607a2c-8aed-428f-8d50-84b84717094d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c516347-0dd8-4d45-a802-a400a6ca5729', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:25 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308 1073741824
Nov 04 01:06:25 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4074068e-bce7-424b-a180-22ebd030f5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:25 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Volume volume-5c516347-0dd8-4d45-a802-a400a6ca5729 (5c516347-0dd8-4d45-a802-a400a6ca5729): created successfully
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4074068e-bce7-424b-a180-22ebd030f5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Flow 'volume_create_manager' (9a450287-a80e-4e3d-86da-bf4463782d95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:26 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-72245e15-3cb0-4f12-b1a9-c87a625d9998 tempest-TestStampPattern-669717848 None] Created volume successfully.
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Acquiring lock "cinder-2565e780-6da9-4d16-922e-1634971478e4-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Lock "cinder-2565e780-6da9-4d16-922e-1634971478e4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Acquiring lock "cinder-quobyte-2565e780-6da9-4d16-922e-1634971478e4" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:26 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308 1073741824" returned: 0 in 0.659s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Lock "cinder-quobyte-2565e780-6da9-4d16-922e-1634971478e4" acquired by "delete_volume" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4b91c3-f182-4733-b4fb-37f9500bf271]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:26 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308
Nov 04 01:06:26 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:26 devstack sudo[99913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4
Nov 04 01:06:26 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:26 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308" returned: 0 in 0.325s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.192s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] Creating offline snapshot 0754a89f-4ffd-4b25-8c7b-4dee14106e09 of volume 18386f21-bb27-4619-a177-f1db8e41c065 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90b891a-0a57-46ed-b586-9d0e9fd0cbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed682926-f5f1-4b87-bcc6-c70c3da57308', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bdd6d8-2084-4e7e-a145-d1e8df9dc401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[8171be19-38d5-4ead-87d1-3e9b969b8052]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:27 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Volume volume-ed682926-f5f1-4b87-bcc6-c70c3da57308 (ed682926-f5f1-4b87-bcc6-c70c3da57308): created successfully
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bdd6d8-2084-4e7e-a145-d1e8df9dc401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Flow 'volume_create_manager' (7461a245-a8f6-4724-a92a-e741b096de75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f4f4666b-c03a-4f1f-93cd-5e73633b0aa8 tempest-VolumesListTestJSON-2085158989 None] Created volume successfully.
Nov 04 01:06:27 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4" returned: 0 in 0.494s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:27 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4
Nov 04 01:06:27 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:27 devstack sudo[99921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065
Nov 04 01:06:27 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:27 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2565e780-6da9-4d16-922e-1634971478e4" returned: 0 in 0.355s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Lock "cinder-quobyte-2565e780-6da9-4d16-922e-1634971478e4" released by "delete_volume" :: held 0.908s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Created reservations ['7fee8157-cfce-4f12-8a1e-39e21ab531c4', '204d452f-682a-4490-927a-09757b86cefb', 'd1f67ec6-51b7-4f6a-ba9d-ea3ae57ad2b6', '3b8b8bf7-ab17-4469-8233-8e98b6e1ac38'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:27 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065" returned: 0 in 0.637s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:27 devstack sudo[99939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09 1G
Nov 04 01:06:27 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:27 devstack sudo[99941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:06:27 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:28 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.675s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:06:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Deleted volume successfully.
Nov 04 01:06:28 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-48ac88c8-d60c-4bb5-82c1-53a0b9bcb6a6 tempest-VolumeQuotasNegativeTestJSON-1401652806 None] Lock "cinder-2565e780-6da9-4d16-922e-1634971478e4-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09 1G" returned: 0 in 0.783s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18386f21-bb27-4619-a177-f1db8e41c065 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:28 devstack sudo[99953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18386f21-bb27-4619-a177-f1db8e41c065 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09
Nov 04 01:06:28 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Flow 'volume_create_manager' (40922283-dfc0-4db7-9a2b-d7b0a2073c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f30db8c-10e5-40e3-93be-59da46236985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f30db8c-10e5-40e3-93be-59da46236985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-828718101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0410dc6e0d6041caa024f366a413b8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:29Z,use_quota=True,user_id='89ce637e8d294f57ab521755044f611e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95462d6-491a-41e5-a4f6-caa3396317bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95462d6-491a-41e5-a4f6-caa3396317bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfe522c-699f-45e0-86a4-047421bfeecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfe522c-699f-45e0-86a4-047421bfeecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf', 'volume_name': 'volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef9c091-3c4f-4ed7-a219-6832be8f3d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef9c091-3c4f-4ed7-a219-6832be8f3d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820714d8-49ca-45e6-9383-fc0d1c5e5c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:28 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Volume fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf', 'volume_size': 1}
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:28 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18386f21-bb27-4619-a177-f1db8e41c065 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09" returned: 0 in 0.384s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:28 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09 is being set with open permissions: ugo+rw
Nov 04 01:06:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:28 devstack sudo[99959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09
Nov 04 01:06:28 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:29 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09" returned: 0 in 0.284s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:29 devstack sudo[99962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.info
Nov 04 01:06:29 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:29 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.info" returned: 0 in 0.331s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:29 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.info is being set with open permissions: ugo+rw
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:29 devstack sudo[99965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.info
Nov 04 01:06:29 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:29 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.info" returned: 0 in 0.305s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-828718101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0410dc6e0d6041caa024f366a413b8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:29Z,use_quota=True,user_id='89ce637e8d294f57ab521755044f611e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Creating volume fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:06:29 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:06:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:29 devstack sudo[99969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf 1073741824
Nov 04 01:06:29 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:29 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5ded914d-6dd8-4115-af1d-a217f4862d1f tempest-SnapshotMetadataTestJSON-857260443 None] Create snapshot completed successfully
Nov 04 01:06:30 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf 1073741824" returned: 0 in 0.725s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:30 devstack sudo[99976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf
Nov 04 01:06:30 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:31 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf" returned: 0 in 0.398s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820714d8-49ca-45e6-9383-fc0d1c5e5c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221f5e2f-ee49-4e5b-a345-4e3e4cd62ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:31 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Volume volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf (fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf): created successfully
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221f5e2f-ee49-4e5b-a345-4e3e4cd62ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Flow 'volume_create_manager' (40922283-dfc0-4db7-9a2b-d7b0a2073c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:31 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9464a051-e2b4-4d84-8f78-0b3a647b809c tempest-VolumesListTestJSON-2085158989 None] Created volume successfully.
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Acquiring lock "cinder-0754a89f-4ffd-4b25-8c7b-4dee14106e09-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "cinder-0754a89f-4ffd-4b25-8c7b-4dee14106e09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Acquiring lock "cinder-quobyte-18386f21-bb27-4619-a177-f1db8e41c065" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "cinder-quobyte-18386f21-bb27-4619-a177-f1db8e41c065" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Acquiring lock "cinder-quobyte-0754a89f-4ffd-4b25-8c7b-4dee14106e09" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "cinder-quobyte-0754a89f-4ffd-4b25-8c7b-4dee14106e09" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Deleting offline snapshot 0754a89f-4ffd-4b25-8c7b-4dee14106e09 of volume 18386f21-bb27-4619-a177-f1db8e41c065 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] snapshot_file for this snap is: volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f4215e-6743-4812-8edc-e98256078d99]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:32 devstack sudo[100041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09
Nov 04 01:06:32 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:32 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09" returned: 0 in 0.651s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18386f21-bb27-4619-a177-f1db8e41c065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47e8396-d4cc-41ef-8dac-c118105468b6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Flow 'volume_create_manager' (acfbd728-81c6-4418-81cc-097619017eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38c36bb-94fd-49ed-8cbc-2bb63872d1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38c36bb-94fd-49ed-8cbc-2bb63872d1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2053272567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ee4abf-666a-4b8b-8c21-bec3058d0fde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0410dc6e0d6041caa024f366a413b8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:33Z,use_quota=True,user_id='89ce637e8d294f57ab521755044f611e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e53787-9ce7-4bbf-a2fe-9a6f4e6cd74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e53787-9ce7-4bbf-a2fe-9a6f4e6cd74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7905ac32-e370-485e-baa4-89cb57cc06d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7905ac32-e370-485e-baa4-89cb57cc06d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ee4abf-666a-4b8b-8c21-bec3058d0fde', 'volume_name': 'volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af42c81-4142-43bc-9882-5f353859b5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af42c81-4142-43bc-9882-5f353859b5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b20554-0b0f-4697-87d1-39dd920620de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:32 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Volume 22ee4abf-666a-4b8b-8c21-bec3058d0fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde', 'volume_size': 1}
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:33 devstack sudo[100050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2053272567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ee4abf-666a-4b8b-8c21-bec3058d0fde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0410dc6e0d6041caa024f366a413b8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:33Z,use_quota=True,user_id='89ce637e8d294f57ab521755044f611e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:06:33 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Creating volume 22ee4abf-666a-4b8b-8c21-bec3058d0fde {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:06:33 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:33 devstack sudo[100053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde 1073741824
Nov 04 01:06:33 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:33 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065" returned: 0 in 0.830s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:33 devstack sudo[100062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09
Nov 04 01:06:33 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:33 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde 1073741824" returned: 0 in 0.858s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:33 devstack sudo[100064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde
Nov 04 01:06:33 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:34 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09" returned: 0 in 0.779s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:34 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde" returned: 0 in 0.538s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:34 devstack sudo[100070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09
Nov 04 01:06:34 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b20554-0b0f-4697-87d1-39dd920620de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257014d6-f47f-480f-b246-b03466d19125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:34 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Volume volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde (22ee4abf-666a-4b8b-8c21-bec3058d0fde): created successfully
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257014d6-f47f-480f-b246-b03466d19125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Flow 'volume_create_manager' (acfbd728-81c6-4418-81cc-097619017eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:34 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c231cd6f-beb8-4415-a8e0-af2d09b4c1af tempest-VolumesListTestJSON-2085158989 None] Created volume successfully.
Nov 04 01:06:34 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065.0754a89f-4ffd-4b25-8c7b-4dee14106e09" returned: 0 in 0.420s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "cinder-quobyte-0754a89f-4ffd-4b25-8c7b-4dee14106e09" released by "_delete_snapshot" :: held 2.901s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "cinder-quobyte-18386f21-bb27-4619-a177-f1db8e41c065" released by "delete_snapshot" :: held 2.953s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:35 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Created reservations ['7977d24f-5ca6-4454-b0fa-75f5c935c96f', '8c117689-d4e0-40b0-9f9f-86093663f2eb', 'c094c255-32f3-4cd7-acfc-28156c8a45d8', '2b1bf6f1-7991-488d-9652-efb6cfa296bb'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:35 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Delete snapshot completed successfully.
Nov 04 01:06:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec846239-c209-4c46-b894-0e4ae558d904 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "cinder-0754a89f-4ffd-4b25-8c7b-4dee14106e09-delete_snapshot" released by "delete_snapshot" :: held 3.404s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Acquiring lock "cinder-18386f21-bb27-4619-a177-f1db8e41c065-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "cinder-18386f21-bb27-4619-a177-f1db8e41c065-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Acquiring lock "cinder-quobyte-18386f21-bb27-4619-a177-f1db8e41c065" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "cinder-quobyte-18386f21-bb27-4619-a177-f1db8e41c065" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:35 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7fc607-0bd5-4cee-8679-95c2b4fd1668]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:36 devstack sudo[100074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065
Nov 04 01:06:36 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:36 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065" returned: 0 in 0.616s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:36 devstack sudo[100080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065
Nov 04 01:06:36 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:36 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18386f21-bb27-4619-a177-f1db8e41c065" returned: 0 in 0.324s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "cinder-quobyte-18386f21-bb27-4619-a177-f1db8e41c065" released by "delete_volume" :: held 1.090s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:36 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Created reservations ['110c33df-624a-4548-90c4-deb2490d9b81', '6dbe9f03-2b64-4ae2-af16-63c04b9150ef', '28167b27-4aa2-4b01-90d4-577741360ef0', '3dd6bc20-3968-4514-a55f-0fb8dd4b1b7a'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:37 devstack sudo[100083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:06:37 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:37 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.459s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:37 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:06:37 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Deleted volume successfully.
Nov 04 01:06:37 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75a39ec3-c17e-4a12-a38a-b7ab7d400ea2 tempest-SnapshotMetadataTestJSON-857260443 None] Lock "cinder-18386f21-bb27-4619-a177-f1db8e41c065-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "cinder-22ee4abf-666a-4b8b-8c21-bec3058d0fde-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-22ee4abf-666a-4b8b-8c21-bec3058d0fde-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "cinder-quobyte-22ee4abf-666a-4b8b-8c21-bec3058d0fde" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-quobyte-22ee4abf-666a-4b8b-8c21-bec3058d0fde" acquired by "delete_volume" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:39 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[22354db5-4a39-4baf-a326-fa9a980ae4b7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:39 devstack sudo[100086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde
Nov 04 01:06:39 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:39 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde" returned: 0 in 0.597s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:39 devstack sudo[100092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde
Nov 04 01:06:39 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:40 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-22ee4abf-666a-4b8b-8c21-bec3058d0fde" returned: 0 in 0.296s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-quobyte-22ee4abf-666a-4b8b-8c21-bec3058d0fde" released by "delete_volume" :: held 0.986s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Created reservations ['e74e4d50-1c99-47af-b954-a3fc424f651f', '0ee7edb5-8d88-4223-8250-4a48569e2a51', 'f22434c0-6e64-4c9d-a5df-634ccb924426', 'f9a35a24-9b17-42ed-aa04-c35f3dfa86a3'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:40 devstack sudo[100096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:06:40 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:40 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.438s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:06:40 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Deleted volume successfully.
Nov 04 01:06:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-90da7da9-2a0a-419f-ac10-5fa95540b432 tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-22ee4abf-666a-4b8b-8c21-bec3058d0fde-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "cinder-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "cinder-quobyte-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-quobyte-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:41 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae515898-257d-43b3-a095-ab838937819c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:41 devstack sudo[100101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf
Nov 04 01:06:41 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:42 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf" returned: 0 in 0.640s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:42 devstack sudo[100106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf
Nov 04 01:06:42 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:42 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf" returned: 0 in 0.412s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-quobyte-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf" released by "delete_volume" :: held 1.122s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:42 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Created reservations ['639b9851-e9d9-4839-9e28-b5d9aaec865e', '0ab6c1b2-33d3-4276-875f-9a6fd2a52c58', 'b82496d4-6cc0-452c-a33d-d7bb8f7a4c6e', '6066f936-d4ab-49c1-a652-85caa1b57cf0'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:42 devstack sudo[100109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:06:42 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:43 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.402s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:43 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:06:43 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Deleted volume successfully.
Nov 04 01:06:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fb5a59a8-24e0-45da-ad3c-7ae05005532d tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-fe71c6b1-d50d-4fb1-a2e4-1f93f473b4cf-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "cinder-ed682926-f5f1-4b87-bcc6-c70c3da57308-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-ed682926-f5f1-4b87-bcc6-c70c3da57308-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "cinder-quobyte-ed682926-f5f1-4b87-bcc6-c70c3da57308" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-quobyte-ed682926-f5f1-4b87-bcc6-c70c3da57308" acquired by "delete_volume" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d017de6-7c0c-46cb-af89-96db5c558225]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:44 devstack sudo[100112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308
Nov 04 01:06:44 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Flow 'volume_create_manager' (5cd807e9-7351-4206-a83b-92526474fb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa496bf-7d20-4cc4-a549-621fc12aa9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa496bf-7d20-4cc4-a549-621fc12aa9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-440123028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac37d96e-ac84-40cc-aae3-a146cd993c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376942128997404c865c147eadf0ee25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:44Z,use_quota=True,user_id='2acf7abc425d4c8babfc8bb1dc8712c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbccbf47-d62d-41f9-822e-3b4e55704f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbccbf47-d62d-41f9-822e-3b4e55704f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4a2e95-bbeb-4b33-b52e-9bc87a5a0ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4a2e95-bbeb-4b33-b52e-9bc87a5a0ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac37d96e-ac84-40cc-aae3-a146cd993c71', 'volume_name': 'volume-ac37d96e-ac84-40cc-aae3-a146cd993c71', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf47c993-b76f-491a-8886-6ca586ddc867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf47c993-b76f-491a-8886-6ca586ddc867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d19a028-28ba-4604-85fd-61d785ec4c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:44 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Volume ac37d96e-ac84-40cc-aae3-a146cd993c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac37d96e-ac84-40cc-aae3-a146cd993c71', 'volume_size': 1}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-440123028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac37d96e-ac84-40cc-aae3-a146cd993c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376942128997404c865c147eadf0ee25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:44Z,use_quota=True,user_id='2acf7abc425d4c8babfc8bb1dc8712c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Creating volume ac37d96e-ac84-40cc-aae3-a146cd993c71 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:06:44 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:44 devstack sudo[100114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 1073741824
Nov 04 01:06:44 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:44 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308" returned: 0 in 0.554s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:44 devstack sudo[100119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308
Nov 04 01:06:44 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:44 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed682926-f5f1-4b87-bcc6-c70c3da57308" returned: 0 in 0.296s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-quobyte-ed682926-f5f1-4b87-bcc6-c70c3da57308" released by "delete_volume" :: held 0.920s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Created reservations ['8d04a816-5ff3-46e5-a3f4-0286bac479b0', '33486c1d-d5c1-45bf-8b23-d2bb560a489a', '4292a678-467b-434f-ba5d-754d961f09d1', '43a6591e-b85a-46a9-b37b-276520e37e19'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:45 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 1073741824" returned: 0 in 0.585s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:45 devstack sudo[100126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71
Nov 04 01:06:45 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:45 devstack sudo[100128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:06:45 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:45 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71" returned: 0 in 0.343s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d19a028-28ba-4604-85fd-61d785ec4c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac37d96e-ac84-40cc-aae3-a146cd993c71', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:45 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4d7fcd-1210-4fb6-983a-0e6a1d14aec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.363s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:06:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Deleted volume successfully.
Nov 04 01:06:45 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Volume volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 (ac37d96e-ac84-40cc-aae3-a146cd993c71): created successfully
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4d7fcd-1210-4fb6-983a-0e6a1d14aec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Flow 'volume_create_manager' (5cd807e9-7351-4206-a83b-92526474fb8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7caa711a-48d4-4ca4-b71f-97a7f93c85c8 tempest-VolumesDeleteCascade-1253977966 None] Created volume successfully.
Nov 04 01:06:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-789b578d-34ee-4d10-bafe-ecc02ca98ff3 tempest-VolumesListTestJSON-2085158989 None] Lock "cinder-ed682926-f5f1-4b87-bcc6-c70c3da57308-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] Creating offline snapshot dc2890ae-0aff-4d86-ad82-9349e8f345ae of volume ac37d96e-ac84-40cc-aae3-a146cd993c71 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:06:46 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[653f3c9b-ec80-492a-b79c-022dfc4f2482]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:46 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71
Nov 04 01:06:46 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:47 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71" returned: 0 in 0.419s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:47 devstack sudo[100152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae 1G
Nov 04 01:06:47 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Flow 'volume_create_manager' (bc6dd87e-7ca7-421f-bd35-247beea2d686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddc8319-beac-49ce-adbd-4b7c2cc98969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddc8319-beac-49ce-adbd-4b7c2cc98969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2131627219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ae64a0-d913-4b4f-90f3-ee5e25304ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb880e5cc5af4d8b808e9797f7c29b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:47Z,use_quota=True,user_id='1bb4acf2e98c4ff78f78db2bbff30f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53dd641-de3e-44e0-a12b-d5b2bc4f91d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53dd641-de3e-44e0-a12b-d5b2bc4f91d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feca13d6-9aa4-4ffa-8e6d-813c3b4e4504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feca13d6-9aa4-4ffa-8e6d-813c3b4e4504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ae64a0-d913-4b4f-90f3-ee5e25304ba5', 'volume_name': 'volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83210bf-57d9-493f-8549-416a5a9d68be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83210bf-57d9-493f-8549-416a5a9d68be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d71544-e85e-4c95-bbd4-8fcdcd5dd78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:47 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Volume c8ae64a0-d913-4b4f-90f3-ee5e25304ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5', 'volume_size': 1}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:47 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae 1G" returned: 0 in 0.522s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:47 devstack sudo[100158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae
Nov 04 01:06:47 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:47 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae" returned: 0 in 0.320s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:47 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae is being set with open permissions: ugo+rw
Nov 04 01:06:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:48 devstack sudo[100164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae
Nov 04 01:06:48 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:48 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae" returned: 0 in 0.256s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:48 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.info
Nov 04 01:06:48 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:48 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.info" returned: 0 in 0.255s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:48 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.info is being set with open permissions: ugo+rw
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:48 devstack sudo[100170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.info
Nov 04 01:06:48 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:48 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.info" returned: 0 in 0.248s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.194s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2131627219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ae64a0-d913-4b4f-90f3-ee5e25304ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb880e5cc5af4d8b808e9797f7c29b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:06:47Z,use_quota=True,user_id='1bb4acf2e98c4ff78f78db2bbff30f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Creating volume c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:06:48 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:06:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:48 devstack sudo[100173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 1073741824
Nov 04 01:06:48 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:48 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8cfbfaea-e6cf-4c40-b866-e0494bbc32cf tempest-VolumesDeleteCascade-1253977966 None] Create snapshot completed successfully
Nov 04 01:06:49 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 1073741824" returned: 0 in 0.446s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:49 devstack sudo[100179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5
Nov 04 01:06:49 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:49 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5" returned: 0 in 0.286s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:06:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d71544-e85e-4c95-bbd4-8fcdcd5dd78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3ec838-cc1e-4b88-8f1f-6af93a2cd3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:06:49 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Volume volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 (c8ae64a0-d913-4b4f-90f3-ee5e25304ba5): created successfully
Nov 04 01:06:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3ec838-cc1e-4b88-8f1f-6af93a2cd3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:06:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Flow 'volume_create_manager' (bc6dd87e-7ca7-421f-bd35-247beea2d686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:06:49 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-647015ca-61ce-4ff5-b282-157c9725c192 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Created volume successfully.
Nov 04 01:06:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] Creating offline snapshot d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 of volume ac37d96e-ac84-40cc-aae3-a146cd993c71 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:06:50 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f291c2-62fa-4bea-ac98-a39c269a8bcb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:50 devstack sudo[100182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae
Nov 04 01:06:50 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:50 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae" returned: 0 in 0.422s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac37d96e-ac84-40cc-aae3-a146cd993c71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:06:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:50 devstack sudo[100188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 1G
Nov 04 01:06:50 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:51 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 1G" returned: 0 in 0.511s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:51 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0
Nov 04 01:06:51 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:51 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0" returned: 0 in 0.321s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:51 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 is being set with open permissions: ugo+rw
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:51 devstack sudo[100199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0
Nov 04 01:06:51 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:51 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0" returned: 0 in 0.267s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.635s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.810s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Creating offline snapshot b7acb271-3e08-4780-90ad-144ca229caf5 of volume c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b6ca3f-aea7-4ebb-be91-ef092179202a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:51 devstack sudo[100202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:06:51 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5c722927-9791-490e-be64-cd6281980d7c tempest-VolumesDeleteCascade-1253977966 None] Create snapshot completed successfully
Nov 04 01:06:51 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:51 devstack sudo[100203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5
Nov 04 01:06:51 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:52 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.346s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:06:52 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5" returned: 0 in 0.485s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:52 devstack sudo[100210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5 1G
Nov 04 01:06:52 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-ac37d96e-ac84-40cc-aae3-a146cd993c71-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-ac37d96e-ac84-40cc-aae3-a146cd993c71-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Performing cascade delete. {{(pid=86660) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-quobyte-ac37d96e-ac84-40cc-aae3-a146cd993c71" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-ac37d96e-ac84-40cc-aae3-a146cd993c71" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-quobyte-d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Deleting offline snapshot d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 of volume ac37d96e-ac84-40cc-aae3-a146cd993c71 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] snapshot_file for this snap is: volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a7cac0-90d3-48c4-987b-085335b445d9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:52 devstack sudo[100212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0
Nov 04 01:06:52 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:52 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5 1G" returned: 0 in 0.579s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:52 devstack sudo[100217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5
Nov 04 01:06:52 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:52 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0" returned: 0 in 0.492s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac37d96e-ac84-40cc-aae3-a146cd993c71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:06:53 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdd1be7-f460-4115-a791-74e287101b51]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:53 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5" returned: 0 in 0.420s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:53 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5 is being set with open permissions: ugo+rw
Nov 04 01:06:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:53 devstack sudo[100222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae
Nov 04 01:06:53 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:53 devstack sudo[100226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5
Nov 04 01:06:53 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:53 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae" returned: 0 in 0.444s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac37d96e-ac84-40cc-aae3-a146cd993c71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:06:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:53 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5" returned: 0 in 0.319s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:53 devstack sudo[100234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0
Nov 04 01:06:53 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:53 devstack sudo[100236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.info
Nov 04 01:06:53 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:53 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.info" returned: 0 in 0.287s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:53 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.info is being set with open permissions: ugo+rw
Nov 04 01:06:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:53 devstack sudo[100246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.info
Nov 04 01:06:53 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:54 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0" returned: 0 in 0.505s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:54 devstack sudo[100249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0
Nov 04 01:06:54 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:54 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.info" returned: 0 in 0.315s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:54 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3cfc5b05-2ba7-48a2-a586-e3489d19f7cd tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Create snapshot completed successfully
Nov 04 01:06:54 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0" returned: 0 in 0.343s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0" released by "_delete_snapshot" :: held 1.960s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-ac37d96e-ac84-40cc-aae3-a146cd993c71" released by "delete_snapshot" :: held 1.988s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Created reservations ['42167a29-ca3b-454d-9365-cdfe2ef948e8', '72bc6a29-6edb-4d41-a4a3-a4b8e1d6f427', 'cba5ed50-e681-44d4-863a-1fcc7e393ca1', 'b0df59c5-0d4e-464a-ab26-79b1a6a2cb6c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:54 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Delete snapshot completed successfully.
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-d71d998a-f5b5-42b6-b9dc-4a57ba66bcf0-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-dc2890ae-0aff-4d86-ad82-9349e8f345ae-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-dc2890ae-0aff-4d86-ad82-9349e8f345ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-quobyte-ac37d96e-ac84-40cc-aae3-a146cd993c71" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-ac37d96e-ac84-40cc-aae3-a146cd993c71" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-quobyte-dc2890ae-0aff-4d86-ad82-9349e8f345ae" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-dc2890ae-0aff-4d86-ad82-9349e8f345ae" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Deleting offline snapshot dc2890ae-0aff-4d86-ad82-9349e8f345ae of volume ac37d96e-ac84-40cc-aae3-a146cd993c71 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] snapshot_file for this snap is: volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0e6de7-9f71-42e8-b701-f63cff497af2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:54 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae
Nov 04 01:06:55 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-4eb39e1a-bdab-40e3-a9c6-7f8fbdd723c2 req-239c1048-3230-4e8d-be74-9dc1b499f1b7 tempest-TestStampPattern-669717848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-4eb39e1a-bdab-40e3-a9c6-7f8fbdd723c2 req-239c1048-3230-4e8d-be74-9dc1b499f1b7 tempest-TestStampPattern-669717848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-4eb39e1a-bdab-40e3-a9c6-7f8fbdd723c2 req-239c1048-3230-4e8d-be74-9dc1b499f1b7 tempest-TestStampPattern-669717848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-4eb39e1a-bdab-40e3-a9c6-7f8fbdd723c2 req-239c1048-3230-4e8d-be74-9dc1b499f1b7 tempest-TestStampPattern-669717848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-5c516347-0dd8-4d45-a802-a400a6ca5729', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '542a1012-b8ef-45d7-b8c5-9ef723462159', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:06:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-4eb39e1a-bdab-40e3-a9c6-7f8fbdd723c2 req-239c1048-3230-4e8d-be74-9dc1b499f1b7 tempest-TestStampPattern-669717848 None] attachment_update completed successfully.
Nov 04 01:06:55 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae" returned: 0 in 0.540s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac37d96e-ac84-40cc-aae3-a146cd993c71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[da37f9a1-9be3-4205-9726-1c10901f22bf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:55 devstack sudo[100294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71
Nov 04 01:06:55 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Acquiring lock "cinder-b7acb271-3e08-4780-90ad-144ca229caf5-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "cinder-b7acb271-3e08-4780-90ad-144ca229caf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Acquiring lock "cinder-quobyte-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "cinder-quobyte-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Acquiring lock "cinder-quobyte-b7acb271-3e08-4780-90ad-144ca229caf5" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "cinder-quobyte-b7acb271-3e08-4780-90ad-144ca229caf5" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Deleting offline snapshot b7acb271-3e08-4780-90ad-144ca229caf5 of volume c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] snapshot_file for this snap is: volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa461cbe-3292-4f42-97e5-2d69d2567d31]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:56 devstack sudo[100686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5
Nov 04 01:06:56 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:56 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71" returned: 0 in 0.765s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:56 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae
Nov 04 01:06:56 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:56 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5" returned: 0 in 0.648s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:06:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc97e3d0-6756-4676-997a-3d7aecfa35d1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:56 devstack sudo[100699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5
Nov 04 01:06:56 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:56 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae" returned: 0 in 0.615s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:56 devstack sudo[100701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae
Nov 04 01:06:56 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:57 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5" returned: 0 in 0.521s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:57 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71.dc2890ae-0aff-4d86-ad82-9349e8f345ae" returned: 0 in 0.369s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:57 devstack sudo[100712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5
Nov 04 01:06:57 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-dc2890ae-0aff-4d86-ad82-9349e8f345ae" released by "_delete_snapshot" :: held 2.478s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-ac37d96e-ac84-40cc-aae3-a146cd993c71" released by "delete_snapshot" :: held 2.519s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Created reservations ['35accee8-f780-4f3f-9fc5-217389221af0', '5782a6fb-7c60-49ec-9e97-b5825fa3c3fe', '44b4e102-44fa-41a4-a0d6-ed15d1e72474', '049045c0-9ddf-4de1-8dec-950553b49d50'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Delete snapshot completed successfully.
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-dc2890ae-0aff-4d86-ad82-9349e8f345ae-delete_snapshot" released by "delete_snapshot" :: held 2.731s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Snapshots deleted, issuing volume delete {{(pid=86660) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-quobyte-ac37d96e-ac84-40cc-aae3-a146cd993c71" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-ac37d96e-ac84-40cc-aae3-a146cd993c71" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0814475-d749-47ba-8b4d-712d5b16770c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:57 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71
Nov 04 01:06:57 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:57 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5" returned: 0 in 0.568s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:57 devstack sudo[100724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5
Nov 04 01:06:57 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:58 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5.b7acb271-3e08-4780-90ad-144ca229caf5" returned: 0 in 0.307s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "cinder-quobyte-b7acb271-3e08-4780-90ad-144ca229caf5" released by "_delete_snapshot" :: held 2.241s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "cinder-quobyte-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5" released by "delete_snapshot" :: held 2.293s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:58 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71" returned: 0 in 0.622s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:58 devstack sudo[100730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71
Nov 04 01:06:58 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Created reservations ['7ca85880-ff35-4f2a-b535-ab1f14a7dfc5', '91e398dd-30f8-4013-bab0-7ff2a52ec2bb', '009a6f53-f67b-4267-b926-df645d726905', '588dd6c3-0a41-4d3b-93fa-7da8053a5999'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:58 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Delete snapshot completed successfully.
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-945f6ba2-1d3f-4cfe-9fa1-bb0a8cc81dce tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "cinder-b7acb271-3e08-4780-90ad-144ca229caf5-delete_snapshot" released by "delete_snapshot" :: held 2.556s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:58 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ac37d96e-ac84-40cc-aae3-a146cd993c71" returned: 0 in 0.429s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-ac37d96e-ac84-40cc-aae3-a146cd993c71" released by "delete_volume" :: held 1.155s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Created reservations ['f18be432-4006-4afd-a1c1-a4ba8b1f2ca9', '38f864f1-14b9-4d96-9121-b25652d64ce1', 'aebdccce-b04d-4d4b-ad6b-3f872046e0b4', 'e34cbde0-794d-44e4-ba09-12f4a027356c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:06:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:58 devstack sudo[100733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:06:58 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:06:59 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root
Nov 04 01:06:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.293s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:06:59 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:06:59 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Deleted volume successfully.
Nov 04 01:06:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7d1e5dc6-3d58-4976-afe1-d77986858ae7 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-ac37d96e-ac84-40cc-aae3-a146cd993c71-delete_volume" released by "delete_volume" :: held 6.855s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:06:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Acquiring lock "cinder-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "cinder-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Acquiring lock "cinder-quobyte-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:06:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "cinder-quobyte-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5" acquired by "delete_volume" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:06:59 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfccf89c-d47a-404c-934c-117dc4980123]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:06:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:06:59 devstack sudo[100736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5
Nov 04 01:06:59 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:00 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5" returned: 0 in 0.573s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:00 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5
Nov 04 01:07:00 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Flow 'volume_create_manager' (ea02cf17-4305-4aa9-a9d5-b55605a9c436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ff637d-99f0-4269-bf9a-ae4fded102a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ff637d-99f0-4269-bf9a-ae4fded102a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2108686579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f8070b-03ab-4090-ae56-88a175552578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376942128997404c865c147eadf0ee25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:00Z,use_quota=True,user_id='2acf7abc425d4c8babfc8bb1dc8712c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3df2bb-84b3-4a10-99d2-34a2969090a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3df2bb-84b3-4a10-99d2-34a2969090a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae71d5a1-d9ef-44af-970a-52feb278bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae71d5a1-d9ef-44af-970a-52feb278bda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1f8070b-03ab-4090-ae56-88a175552578', 'volume_name': 'volume-b1f8070b-03ab-4090-ae56-88a175552578', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a96f58-aa58-4eb6-b648-18d1efaf2559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a96f58-aa58-4eb6-b648-18d1efaf2559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:00 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4644bf6-782a-4df3-8de9-099bcab647ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:00 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Volume b1f8070b-03ab-4090-ae56-88a175552578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1f8070b-03ab-4090-ae56-88a175552578', 'volume_size': 1}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2108686579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f8070b-03ab-4090-ae56-88a175552578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376942128997404c865c147eadf0ee25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:00Z,use_quota=True,user_id='2acf7abc425d4c8babfc8bb1dc8712c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Creating volume b1f8070b-03ab-4090-ae56-88a175552578 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:07:00 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5" returned: 0 in 0.514s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:00 devstack sudo[100755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 1073741824
Nov 04 01:07:00 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "cinder-quobyte-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5" released by "delete_volume" :: held 1.206s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Created reservations ['9d48a1a0-4c3b-4c5c-a308-e47eebfa1bf2', 'd7c3d481-b37e-452d-8f90-bc6ffad39aa7', '921d1100-154d-4954-b51d-1cbd4dc43f72', 'f694cdf1-a59e-47fb-9895-aeb9ebc7267c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:00 devstack sudo[100759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:07:00 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:01 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.315s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:07:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Deleted volume successfully.
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4bdca52a-8f01-40c9-813d-e6260302d840 tempest-VolumeSnapshotQuotasNegativeTestJSON-1968774587 None] Lock "cinder-c8ae64a0-d913-4b4f-90f3-ee5e25304ba5-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:01 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 1073741824" returned: 0 in 0.689s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:01 devstack sudo[100767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578
Nov 04 01:07:01 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-52d54615-df09-40d1-8755-d3ba16a6771f req-2a07cb7c-0356-47db-b035-e1b095d2e78b tempest-TestStampPattern-669717848 None] Terminate volume connection completed successfully.
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-52d54615-df09-40d1-8755-d3ba16a6771f req-2a07cb7c-0356-47db-b035-e1b095d2e78b tempest-TestStampPattern-669717848 None] Deleting attachment 542a1012-b8ef-45d7-b8c5-9ef723462159. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:07:01 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578" returned: 0 in 0.321s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4644bf6-782a-4df3-8de9-099bcab647ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f8070b-03ab-4090-ae56-88a175552578', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbc013c-8ab1-4911-a5c1-ca805bf6b9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Volume volume-b1f8070b-03ab-4090-ae56-88a175552578 (b1f8070b-03ab-4090-ae56-88a175552578): created successfully
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbc013c-8ab1-4911-a5c1-ca805bf6b9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Flow 'volume_create_manager' (ea02cf17-4305-4aa9-a9d5-b55605a9c436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c1c3bd81-6d69-4955-b16c-8c291d09a122 tempest-VolumesDeleteCascade-1253977966 None] Created volume successfully.
Nov 04 01:07:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] Creating offline snapshot f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f of volume b1f8070b-03ab-4090-ae56-88a175552578 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:07:02 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b48d719-cb93-4e9d-baca-5eaffcd55e7d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:02 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578
Nov 04 01:07:02 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:03 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578" returned: 0 in 0.425s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:03 devstack sudo[100803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f 1G
Nov 04 01:07:03 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:03 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f 1G" returned: 0 in 0.573s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f8070b-03ab-4090-ae56-88a175552578 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:03 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f8070b-03ab-4090-ae56-88a175552578 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f
Nov 04 01:07:03 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:04 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f8070b-03ab-4090-ae56-88a175552578 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f" returned: 0 in 0.375s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:04 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f is being set with open permissions: ugo+rw
Nov 04 01:07:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:04 devstack sudo[100816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f
Nov 04 01:07:04 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:04 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f" returned: 0 in 0.318s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:04 devstack sudo[100819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.info
Nov 04 01:07:04 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:04 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.info" returned: 0 in 0.355s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:04 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.info is being set with open permissions: ugo+rw
Nov 04 01:07:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:04 devstack sudo[100822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.info
Nov 04 01:07:04 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:05 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.info" returned: 0 in 0.321s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.457s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] Creating offline snapshot 6db4416a-3422-4fd8-9044-b9dd1a6bdab8 of volume 5c516347-0dd8-4d45-a802-a400a6ca5729 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:07:05 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1a9f2eab-9132-4e6b-ad2a-62277a6d4eba tempest-VolumesDeleteCascade-1253977966 None] Create snapshot completed successfully
Nov 04 01:07:05 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ba6ee9-219a-4ab4-9bef-33a3185fa2db]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:05 devstack sudo[100825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729
Nov 04 01:07:05 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:05 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729" returned: 0 in 0.499s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:05 devstack sudo[100830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8 1G
Nov 04 01:07:05 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:06 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8 1G" returned: 0 in 0.573s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c516347-0dd8-4d45-a802-a400a6ca5729 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:06 devstack sudo[100835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c516347-0dd8-4d45-a802-a400a6ca5729 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8
Nov 04 01:07:06 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Flow 'volume_create_manager' (75fb8e1b-8033-43c0-863e-e23738310305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783c5d82-c7aa-4a75-ae2a-d7504e9f82f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783c5d82-c7aa-4a75-ae2a-d7504e9f82f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1627586147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94429205-eda6-48c5-9880-dc9954f533a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376942128997404c865c147eadf0ee25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:06Z,use_quota=True,user_id='2acf7abc425d4c8babfc8bb1dc8712c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eada259e-51da-4af5-964e-71dea83efd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eada259e-51da-4af5-964e-71dea83efd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82202c4d-3d62-4eb2-ba26-068aede0fadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82202c4d-3d62-4eb2-ba26-068aede0fadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94429205-eda6-48c5-9880-dc9954f533a8', 'volume_name': 'volume-94429205-eda6-48c5-9880-dc9954f533a8', 'volume_size': 1, 'snapshot_id': 'f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffbec46-4035-4b3d-a141-f73545e2f61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffbec46-4035-4b3d-a141-f73545e2f61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b8feab-55f7-4137-aaf7-4d770e6e29b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:06 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Volume 94429205-eda6-48c5-9880-dc9954f533a8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94429205-eda6-48c5-9880-dc9954f533a8', 'volume_size': 1, 'snapshot_id': 'f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f'}
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:06 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c516347-0dd8-4d45-a802-a400a6ca5729 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8" returned: 0 in 0.368s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:06 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8 is being set with open permissions: ugo+rw
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:06 devstack sudo[100841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8
Nov 04 01:07:06 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:06 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8" returned: 0 in 0.277s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:07 devstack sudo[100844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.info
Nov 04 01:07:07 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:07 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.info" returned: 0 in 0.395s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:07 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.info is being set with open permissions: ugo+rw
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:07 devstack sudo[100847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.info
Nov 04 01:07:07 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:07 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.info" returned: 0 in 0.279s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.113s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-quobyte-f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f-94429205-eda6-48c5-9880-dc9954f533a8" by "_create_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f-94429205-eda6-48c5-9880-dc9954f533a8" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Creating volume 94429205-eda6-48c5-9880-dc9954f533a8 from snapshot f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f {{(pid=86660) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-quobyte-94429205-eda6-48c5-9880-dc9954f533a8" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:07 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-81f801c2-aa6e-4cac-b659-d6b54dd071a9 tempest-TestStampPattern-669717848 None] Create snapshot completed successfully
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-94429205-eda6-48c5-9880-dc9954f533a8" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] snapshot: f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f, volume: 94429205-eda6-48c5-9880-dc9954f533a8,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e619de73-6da2-476b-b51a-b09f3c6e2fd8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:08 devstack sudo[100850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f
Nov 04 01:07:08 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:08 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f" returned: 0 in 0.501s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1f8070b-03ab-4090-ae56-88a175552578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:07:08 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a0fcc4-90e5-4620-b6af-545d212c6f3e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:08 devstack sudo[100856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578
Nov 04 01:07:08 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:09 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578" returned: 0 in 0.639s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 01:07:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 01:07:09 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8 not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 01:07:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:09 devstack sudo[100862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8
Nov 04 01:07:09 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:10 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:07:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Flow 'volume_create_manager' (151fb2e5-b5f1-446c-aae8-8e9e31e4e2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a36572-8b17-4e31-96ba-6efbc0a1006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a36572-8b17-4e31-96ba-6efbc0a1006b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1537010710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13f085c-6c39-4606-b66a-b9f02874f406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c851ce67ec449eb520e3dcd1e3f1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:11Z,use_quota=True,user_id='6d51ff58ac5b49ab8ef65ceba37ba4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a0f8f18-fb88-45e9-8bcd-b21caa90d9a8),volume_type_id=9a0f8f18-fb88-45e9-8bcd-b21caa90d9a8)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ca4773-db0b-4608-ab61-2ce730eea4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ca4773-db0b-4608-ab61-2ce730eea4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f3bd1c-bef6-4cca-b739-380e6946ed8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f3bd1c-bef6-4cca-b739-380e6946ed8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13f085c-6c39-4606-b66a-b9f02874f406', 'volume_name': 'volume-f13f085c-6c39-4606-b66a-b9f02874f406', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b4d8f7-b844-4c51-8033-f173e07309c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b4d8f7-b844-4c51-8033-f173e07309c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f03a11-0561-4f3e-95c0-83afb5e311e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:11 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Volume f13f085c-6c39-4606-b66a-b9f02874f406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13f085c-6c39-4606-b66a-b9f02874f406', 'volume_size': 1}
Nov 04 01:07:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:18 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8" returned: 0 in 9.176s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578, size 1024.00 MB, duration 9.18 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:07:18 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Converted 1024.00 MB image at 111.58 MB/s
Nov 04 01:07:18 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8 is being set with open permissions: ugo+rw
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:18 devstack sudo[100952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8
Nov 04 01:07:18 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:18 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8" returned: 0 in 0.356s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-94429205-eda6-48c5-9880-dc9954f533a8" released by "_copy_volume_from_snapshot" :: held 10.859s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f-94429205-eda6-48c5-9880-dc9954f533a8" released by "_create_volume_from_snapshot" :: held 10.966s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.646s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1537010710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13f085c-6c39-4606-b66a-b9f02874f406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c851ce67ec449eb520e3dcd1e3f1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:11Z,use_quota=True,user_id='6d51ff58ac5b49ab8ef65ceba37ba4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a0f8f18-fb88-45e9-8bcd-b21caa90d9a8),volume_type_id=9a0f8f18-fb88-45e9-8bcd-b21caa90d9a8)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Creating volume f13f085c-6c39-4606-b66a-b9f02874f406 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:07:18 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:18 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406 1073741824
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b8feab-55f7-4137-aaf7-4d770e6e29b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94429205-eda6-48c5-9880-dc9954f533a8', 'volume_size': 1, 'snapshot_id': 'f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:18 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1169659b-804c-46c8-8700-cd69f583defb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:18 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Volume volume-94429205-eda6-48c5-9880-dc9954f533a8 (94429205-eda6-48c5-9880-dc9954f533a8): created successfully
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1169659b-804c-46c8-8700-cd69f583defb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Flow 'volume_create_manager' (75fb8e1b-8033-43c0-863e-e23738310305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:18 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-6f59b55f-d2e5-4f1c-961f-b06b782144b8 tempest-VolumesDeleteCascade-1253977966 None] Created volume successfully.
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-b1f8070b-03ab-4090-ae56-88a175552578-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-b1f8070b-03ab-4090-ae56-88a175552578-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Performing cascade delete. {{(pid=86660) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:19 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406 1073741824" returned: 0 in 0.772s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-quobyte-b1f8070b-03ab-4090-ae56-88a175552578" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-b1f8070b-03ab-4090-ae56-88a175552578" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-quobyte-f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Deleting offline snapshot f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f of volume b1f8070b-03ab-4090-ae56-88a175552578 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:07:19 devstack sudo[100970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406
Nov 04 01:07:19 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] snapshot_file for this snap is: volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[93da847a-33a3-4d9f-8cbb-af11267c44c1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:19 devstack sudo[100972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f
Nov 04 01:07:19 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:20 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406" returned: 0 in 0.461s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Flow 'volume_create_manager' (52dc8fb4-48d8-41c7-a8ed-2f2a4549ef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51218dfc-bcee-43bb-a6ca-e940ea754e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f03a11-0561-4f3e-95c0-83afb5e311e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13f085c-6c39-4606-b66a-b9f02874f406', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e389c48b-8f53-445d-abc8-49e48c75a7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51218dfc-bcee-43bb-a6ca-e940ea754e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1580669476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa37d0ca245249468213beb06e748053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6db4416a-3422-4fd8-9044-b9dd1a6bdab8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:20Z,use_quota=True,user_id='147aadb49ddf4f318b45587b9d94424c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f60264a-a243-4006-9631-1c872631cf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f60264a-a243-4006-9631-1c872631cf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afff65fa-fa21-45ea-8feb-4171a1f59e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afff65fa-fa21-45ea-8feb-4171a1f59e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd', 'volume_name': 'volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd', 'volume_size': 1, 'snapshot_id': '6db4416a-3422-4fd8-9044-b9dd1a6bdab8'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ddd745-c54f-44a1-80a3-5f4672fcf4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ddd745-c54f-44a1-80a3-5f4672fcf4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef4a830-c98f-4111-89c6-8970fc17347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:20 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Volume e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd', 'volume_size': 1, 'snapshot_id': '6db4416a-3422-4fd8-9044-b9dd1a6bdab8'}
Nov 04 01:07:20 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f" returned: 0 in 0.552s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1f8070b-03ab-4090-ae56-88a175552578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:07:20 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Volume volume-f13f085c-6c39-4606-b66a-b9f02874f406 (f13f085c-6c39-4606-b66a-b9f02874f406): created successfully
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e389c48b-8f53-445d-abc8-49e48c75a7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Flow 'volume_create_manager' (151fb2e5-b5f1-446c-aae8-8e9e31e4e2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Acquiring lock "cinder-quobyte-6db4416a-3422-4fd8-9044-b9dd1a6bdab8-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" by "_create_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba93e1e-a574-4a8c-8fe9-9372e9b7d44d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-6db4416a-3422-4fd8-9044-b9dd1a6bdab8-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Creating volume e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd from snapshot 6db4416a-3422-4fd8-9044-b9dd1a6bdab8 {{(pid=86660) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Acquiring lock "cinder-quobyte-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:20 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-6efd1ac1-b710-430f-a91c-bd51e031f15b tempest-VolumeTypesAccessTest-1053653926 None] Created volume successfully.
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] snapshot: 6db4416a-3422-4fd8-9044-b9dd1a6bdab8, volume: e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd2f58d-2a8c-4691-bc0e-4fe3464b2798]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:20 devstack sudo[100978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578
Nov 04 01:07:20 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:20 devstack sudo[100979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8
Nov 04 01:07:20 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:20 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8" returned: 0 in 0.468s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c516347-0dd8-4d45-a802-a400a6ca5729(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b1d777-0ef8-4944-b85b-914ac8961bb6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Acquiring lock "cinder-f13f085c-6c39-4606-b66a-b9f02874f406-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:21 devstack sudo[100990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729
Nov 04 01:07:21 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Lock "cinder-f13f085c-6c39-4606-b66a-b9f02874f406-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:21 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578" returned: 0 in 0.882s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Acquiring lock "cinder-quobyte-f13f085c-6c39-4606-b66a-b9f02874f406" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:21 devstack sudo[100993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f
Nov 04 01:07:21 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Lock "cinder-quobyte-f13f085c-6c39-4606-b66a-b9f02874f406" acquired by "delete_volume" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[68611df4-67c3-4bec-b452-88dd7a3d7664]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:21 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406
Nov 04 01:07:21 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:21 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729" returned: 0 in 0.484s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:21 devstack sudo[101004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd
Nov 04 01:07:21 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:21 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f" returned: 0 in 0.641s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:21 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406" returned: 0 in 0.576s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:21 devstack sudo[101015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f
Nov 04 01:07:21 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:21 devstack sudo[101017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406
Nov 04 01:07:21 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:22 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578.f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f" returned: 0 in 0.465s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f" released by "_delete_snapshot" :: held 2.696s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:22 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-b1f8070b-03ab-4090-ae56-88a175552578" released by "delete_snapshot" :: held 2.747s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f13f085c-6c39-4606-b66a-b9f02874f406" returned: 0 in 0.516s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Lock "cinder-quobyte-f13f085c-6c39-4606-b66a-b9f02874f406" released by "delete_volume" :: held 1.213s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:22 devstack cinder-volume[86660]: WARNING cinder.quota [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1266162354 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1266162354, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:07:22 devstack cinder-volume[86660]: WARNING cinder.quota [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1266162354 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1266162354, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:07:22 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Created reservations ['145b4c43-ba37-4cb7-b19c-559124cb02aa', 'a88a744a-2706-4ec3-b8aa-59635ea5a839', '6468ab14-dc4e-4b64-be9e-3c8fbd0e45b1', 'aad8ca32-08a4-483a-b089-317f2c22c520'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:07:22 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Created reservations ['b06b55bd-4de9-4540-95bf-296af97fda52', 'b4d1274b-34ab-4515-b135-39e677714e12', '62a2af2f-ea7b-4ffe-9b4b-9c1f591c4db7', '98b3f211-5472-490b-8f61-4901b1c6aac4'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:07:22 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=126,cinder:UPDATE=128,cinder:INSERT=31,cinder:DELETE=12 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:07:22 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Delete snapshot completed successfully.
Nov 04 01:07:22 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=115,cinder:UPDATE=136,cinder:DELETE=12,cinder:INSERT=37 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-f2a29ffb-10a9-411c-8f7e-93ac4cb44c1f-delete_snapshot" released by "delete_snapshot" :: held 3.514s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Snapshots deleted, issuing volume delete {{(pid=86660) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-quobyte-b1f8070b-03ab-4090-ae56-88a175552578" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-b1f8070b-03ab-4090-ae56-88a175552578" acquired by "delete_volume" :: waited 0.072s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:23 devstack sudo[101028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:07:23 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e844907-38b1-402f-8640-447c8eb369e7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:23 devstack sudo[101030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578
Nov 04 01:07:23 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:23 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.747s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:07:23 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Deleted volume successfully.
Nov 04 01:07:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-42c345c4-adae-4f75-bd14-b2069d78e3d6 tempest-VolumeTypesAccessTest-1053653926 None] Lock "cinder-f13f085c-6c39-4606-b66a-b9f02874f406-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:24 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578" returned: 0 in 1.108s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:24 devstack sudo[101040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578
Nov 04 01:07:24 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:24 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1f8070b-03ab-4090-ae56-88a175552578" returned: 0 in 0.536s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-b1f8070b-03ab-4090-ae56-88a175552578" released by "delete_volume" :: held 1.880s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:25 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Created reservations ['60e7b13e-d066-458e-b458-64ba49f90e4d', '51048b17-3011-4e90-a76e-6cd850ec5d4b', '5b50b93a-5893-409d-a961-582a146f7c0e', '96b8d6d1-1f3e-4157-ae1d-04569ce0b8ee'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:07:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:25 devstack sudo[101043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:07:25 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:26 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.774s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:26 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:07:26 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Deleted volume successfully.
Nov 04 01:07:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da3f2a75-753e-4494-9cd8-b62cc9dcd025 tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-b1f8070b-03ab-4090-ae56-88a175552578-delete_volume" released by "delete_volume" :: held 7.023s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-94429205-eda6-48c5-9880-dc9954f533a8-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-94429205-eda6-48c5-9880-dc9954f533a8-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "cinder-quobyte-94429205-eda6-48c5-9880-dc9954f533a8" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-94429205-eda6-48c5-9880-dc9954f533a8" acquired by "delete_volume" :: waited 0.055s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:27 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[72466e6f-0e8c-4347-8ab1-573d7597b7cc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:27 devstack sudo[101046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8
Nov 04 01:07:27 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:28 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8" returned: 0 in 1.198s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:28 devstack sudo[101055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8
Nov 04 01:07:28 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:29 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-94429205-eda6-48c5-9880-dc9954f533a8" returned: 0 in 0.866s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-quobyte-94429205-eda6-48c5-9880-dc9954f533a8" released by "delete_volume" :: held 2.227s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:29 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Created reservations ['798c434c-699e-4943-9575-1b2e4e780406', '3578f4cb-1882-49e8-8518-6b6289748aa9', 'ff7c8596-ec92-4173-9242-3de6c7308b93', '4a335807-260b-4ab3-a15b-91f6a55ce4b6'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:07:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:29 devstack sudo[101069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:07:29 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:30 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.735s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:30 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:07:30 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Deleted volume successfully.
Nov 04 01:07:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-08ab2441-a891-4529-8ec8-886e03d4de2d tempest-VolumesDeleteCascade-1253977966 None] Lock "cinder-94429205-eda6-48c5-9880-dc9954f533a8-delete_volume" released by "delete_volume" :: held 3.707s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:33 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" returned: 0 in 11.979s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:33 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729, size 1024.00 MB, duration 11.98 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:07:33 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Converted 1024.00 MB image at 85.48 MB/s
Nov 04 01:07:33 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd is being set with open permissions: ugo+rw
Nov 04 01:07:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:33 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd
Nov 04 01:07:33 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:33 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" returned: 0 in 0.250s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" released by "_copy_volume_from_snapshot" :: held 13.322s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-6db4416a-3422-4fd8-9044-b9dd1a6bdab8-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" released by "_create_volume_from_snapshot" :: held 13.420s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.461s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef4a830-c98f-4111-89c6-8970fc17347c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd', 'volume_size': 1, 'snapshot_id': '6db4416a-3422-4fd8-9044-b9dd1a6bdab8'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec94593-25fb-4d00-a79a-0547d912280e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:33 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Volume volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd (e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd): created successfully
Nov 04 01:07:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec94593-25fb-4d00-a79a-0547d912280e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Flow 'volume_create_manager' (52dc8fb4-48d8-41c7-a8ed-2f2a4549ef42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:33 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-b0f00309-a6fb-4d9c-92da-6c3dbf37ffaf tempest-TestStampPattern-669717848 None] Created volume successfully.
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Flow 'volume_create_manager' (5f8c72b2-364f-49b3-87b9-6001f9004180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4338e0c1-c7f3-4e24-a700-d190a8325cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4338e0c1-c7f3-4e24-a700-d190a8325cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1604275089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bc8459-5464-4aa7-80fd-9aed19f5d005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461ae930ada44aea8f16743c826dc5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:41Z,use_quota=True,user_id='a43d0eae11334809b93e6db1cba8677a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520ac24b-1f95-4fdb-a990-1c6f594f7498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520ac24b-1f95-4fdb-a990-1c6f594f7498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcf083f-486c-4976-99a6-5cfe49aab18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcf083f-486c-4976-99a6-5cfe49aab18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bc8459-5464-4aa7-80fd-9aed19f5d005', 'volume_name': 'volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca75ae4-290a-474c-b531-e9704a5dc035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca75ae4-290a-474c-b531-e9704a5dc035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93736b1-93f8-49bb-9cb3-c258f5fa0651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:40 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Volume e0bc8459-5464-4aa7-80fd-9aed19f5d005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005', 'volume_size': 1}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1604275089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bc8459-5464-4aa7-80fd-9aed19f5d005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461ae930ada44aea8f16743c826dc5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:41Z,use_quota=True,user_id='a43d0eae11334809b93e6db1cba8677a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Creating volume e0bc8459-5464-4aa7-80fd-9aed19f5d005 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:07:40 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:07:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:40 devstack sudo[101214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005 1073741824
Nov 04 01:07:40 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:42 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005 1073741824" returned: 0 in 1.293s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:42 devstack sudo[101220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005
Nov 04 01:07:42 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:42 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005" returned: 0 in 0.673s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:07:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93736b1-93f8-49bb-9cb3-c258f5fa0651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66039c2-6974-438c-b043-424e01816ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:43 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Volume volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005 (e0bc8459-5464-4aa7-80fd-9aed19f5d005): created successfully
Nov 04 01:07:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66039c2-6974-438c-b043-424e01816ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Flow 'volume_create_manager' (5f8c72b2-364f-49b3-87b9-6001f9004180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:43 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-52ad4f5e-19f7-468a-aebf-8e01165568fe tempest-VolumesMetadataTest-522314731 None] Created volume successfully.
Nov 04 01:07:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Acquiring lock "cinder-e0bc8459-5464-4aa7-80fd-9aed19f5d005-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Lock "cinder-e0bc8459-5464-4aa7-80fd-9aed19f5d005-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Acquiring lock "cinder-quobyte-e0bc8459-5464-4aa7-80fd-9aed19f5d005" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Lock "cinder-quobyte-e0bc8459-5464-4aa7-80fd-9aed19f5d005" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:46 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6fe6be-5c26-4123-91fe-f35cf4b94e79]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:47 devstack sudo[101227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005
Nov 04 01:07:47 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:47 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005" returned: 0 in 0.554s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:47 devstack sudo[101233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005
Nov 04 01:07:47 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:47 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e0bc8459-5464-4aa7-80fd-9aed19f5d005" returned: 0 in 0.310s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Lock "cinder-quobyte-e0bc8459-5464-4aa7-80fd-9aed19f5d005" released by "delete_volume" :: held 0.938s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:47 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Created reservations ['a20e9027-4ca5-40a9-9181-fdea207f1484', '817704b3-9c1a-44cd-a838-1f8a47b0ff2d', 'dbe7a0fb-d9ef-4c23-8e09-0e2d33f36f3c', '045e8362-6ae8-47b9-bdd9-05b3af195639'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:07:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:48 devstack sudo[101236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:07:48 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:48 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.665s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:48 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:07:48 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Deleted volume successfully.
Nov 04 01:07:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-630b3ff6-6d71-4510-afd8-a040a822d0b6 tempest-VolumesMetadataTest-522314731 None] Lock "cinder-e0bc8459-5464-4aa7-80fd-9aed19f5d005-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:07:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:51 devstack sudo[101240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:07:51 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:07:52 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Flow 'volume_create_manager' (1ea087a4-3c47-47da-aeb4-8cdfb8fb5561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78b4d37-2b24-40b7-bacb-cc155a83b54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.613s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78b4d37-2b24-40b7-bacb-cc155a83b54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1917295690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89def14d-479e-4284-9fa4-ad6ba236f4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22842b0bc62046238913d645a81337df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:52Z,use_quota=True,user_id='d94e84bde1a64fbab4753b1844224197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551c769c-3023-435a-8796-9452a9cedbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551c769c-3023-435a-8796-9452a9cedbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63594453-42cc-4917-952a-9e211dea863b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63594453-42cc-4917-952a-9e211dea863b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89def14d-479e-4284-9fa4-ad6ba236f4aa', 'volume_name': 'volume-89def14d-479e-4284-9fa4-ad6ba236f4aa', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d476fab-8142-413a-8948-fbf2b80f6bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d476fab-8142-413a-8948-fbf2b80f6bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9384f7-6dda-4386-9f9f-ebb09cc830e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:52 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Volume 89def14d-479e-4284-9fa4-ad6ba236f4aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89def14d-479e-4284-9fa4-ad6ba236f4aa', 'volume_size': 1}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1917295690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89def14d-479e-4284-9fa4-ad6ba236f4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22842b0bc62046238913d645a81337df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:52Z,use_quota=True,user_id='d94e84bde1a64fbab4753b1844224197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Creating volume 89def14d-479e-4284-9fa4-ad6ba236f4aa {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:07:52 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:07:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:52 devstack sudo[101247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa 1073741824
Nov 04 01:07:52 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:53 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa 1073741824" returned: 0 in 0.625s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:53 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa
Nov 04 01:07:53 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:53 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa" returned: 0 in 0.318s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:07:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9384f7-6dda-4386-9f9f-ebb09cc830e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89def14d-479e-4284-9fa4-ad6ba236f4aa', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e4bc9c-b0cc-464b-9ec3-f450bde224e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:53 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Volume volume-89def14d-479e-4284-9fa4-ad6ba236f4aa (89def14d-479e-4284-9fa4-ad6ba236f4aa): created successfully
Nov 04 01:07:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e4bc9c-b0cc-464b-9ec3-f450bde224e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Flow 'volume_create_manager' (1ea087a4-3c47-47da-aeb4-8cdfb8fb5561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:53 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-01a7022b-4669-4d1e-a425-ace749c18b48 tempest-AbsoluteLimitsTests-1855606027 None] Created volume successfully.
Nov 04 01:07:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Acquiring lock "cinder-89def14d-479e-4284-9fa4-ad6ba236f4aa-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Lock "cinder-89def14d-479e-4284-9fa4-ad6ba236f4aa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Acquiring lock "cinder-quobyte-89def14d-479e-4284-9fa4-ad6ba236f4aa" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Lock "cinder-quobyte-89def14d-479e-4284-9fa4-ad6ba236f4aa" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[594d420b-ec90-4a21-a6e9-e80de3874e72]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:54 devstack sudo[101277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa
Nov 04 01:07:54 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:55 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa" returned: 0 in 0.384s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:55 devstack sudo[101282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa
Nov 04 01:07:55 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Flow 'volume_create_manager' (b89206e7-dd7c-4ae9-a1e8-f14966b05dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81751aa2-174c-4eea-bd29-8b6d54482427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81751aa2-174c-4eea-bd29-8b6d54482427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1029863886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c654ec17-6e78-42d2-bac0-bf048737a178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172115dcf1f44608ae8bf0a443e30047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:55Z,use_quota=True,user_id='e5cc6150dba843a4be483859b9890c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8284aa56-762e-4651-b9e1-aab5172a177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8284aa56-762e-4651-b9e1-aab5172a177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8739400c-a359-4a71-9ffa-01d82c1dfc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8739400c-a359-4a71-9ffa-01d82c1dfc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c654ec17-6e78-42d2-bac0-bf048737a178', 'volume_name': 'volume-c654ec17-6e78-42d2-bac0-bf048737a178', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd48a6c5-3179-496d-9d42-8f74470158a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd48a6c5-3179-496d-9d42-8f74470158a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361d8103-2e8a-4edd-ab2c-f23ab1cd5869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:55 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Volume c654ec17-6e78-42d2-bac0-bf048737a178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c654ec17-6e78-42d2-bac0-bf048737a178', 'volume_size': 1}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1029863886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c654ec17-6e78-42d2-bac0-bf048737a178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172115dcf1f44608ae8bf0a443e30047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:07:55Z,use_quota=True,user_id='e5cc6150dba843a4be483859b9890c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Creating volume c654ec17-6e78-42d2-bac0-bf048737a178 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:07:55 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:55 devstack sudo[101284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178 1073741824
Nov 04 01:07:55 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:55 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-89def14d-479e-4284-9fa4-ad6ba236f4aa" returned: 0 in 0.272s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Lock "cinder-quobyte-89def14d-479e-4284-9fa4-ad6ba236f4aa" released by "delete_volume" :: held 0.701s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Created reservations ['a31d2cf4-c24f-463d-a897-7af76f488575', '3d1d539d-ac70-4fd3-bd9c-abd87e550a3f', '7e80feba-a5fe-4683-b4ea-ca672cfe7e1d', 'a53117ec-36e2-4d4f-91f1-4ee5ca325010'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:55 devstack sudo[101290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:07:55 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:55 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178 1073741824" returned: 0 in 0.447s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:55 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.263s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:07:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Deleted volume successfully.
Nov 04 01:07:55 devstack sudo[101293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178
Nov 04 01:07:55 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-918794a3-5b78-4860-a7d1-40d23ba473f7 tempest-AbsoluteLimitsTests-1855606027 None] Lock "cinder-89def14d-479e-4284-9fa4-ad6ba236f4aa-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:56 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178" returned: 0 in 0.287s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:07:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361d8103-2e8a-4edd-ab2c-f23ab1cd5869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c654ec17-6e78-42d2-bac0-bf048737a178', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654b96e2-38c7-4a1f-9980-31734faf4a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:07:56 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Volume volume-c654ec17-6e78-42d2-bac0-bf048737a178 (c654ec17-6e78-42d2-bac0-bf048737a178): created successfully
Nov 04 01:07:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654b96e2-38c7-4a1f-9980-31734faf4a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:07:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Flow 'volume_create_manager' (b89206e7-dd7c-4ae9-a1e8-f14966b05dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:07:56 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ffbd4103-1d49-40c8-aa0b-e42c721b3f83 tempest-VolumesTransfersTest-1364398739 None] Created volume successfully.
Nov 04 01:07:58 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7c80026f-f8b7-4a0a-a6d9-de01a0a85232 tempest-VolumesTransfersTest-694629704 None] Transfer volume completed successfully.
Nov 04 01:07:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Acquiring lock "cinder-c654ec17-6e78-42d2-bac0-bf048737a178-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Lock "cinder-c654ec17-6e78-42d2-bac0-bf048737a178-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Acquiring lock "cinder-quobyte-c654ec17-6e78-42d2-bac0-bf048737a178" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:07:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Lock "cinder-quobyte-c654ec17-6e78-42d2-bac0-bf048737a178" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47499c3-ee44-4356-b086-61dc8d1cad48]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:59 devstack sudo[101296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178
Nov 04 01:07:59 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:59 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178" returned: 0 in 0.443s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:59 devstack sudo[101302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178
Nov 04 01:07:59 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:07:59 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c654ec17-6e78-42d2-bac0-bf048737a178" returned: 0 in 0.304s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Lock "cinder-quobyte-c654ec17-6e78-42d2-bac0-bf048737a178" released by "delete_volume" :: held 0.797s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Created reservations ['836b0df5-71d6-4933-97bc-7d3992250037', 'b6ad15a6-0569-4878-9c4e-902e81b7ef4b', '47f58fd4-2253-4e1d-887e-e0b530ca27f4', '8fb4b448-d3b2-40fb-8498-cf8321587903'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:07:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:07:59 devstack sudo[101305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:07:59 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:00 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.340s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:00 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Deleted volume successfully.
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b615c6d-7ca4-4a4e-be65-b5be1c5aea5b tempest-VolumesTransfersTest-1057684734 None] Lock "cinder-c654ec17-6e78-42d2-bac0-bf048737a178-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Flow 'volume_create_manager' (97d02068-9abe-4cf2-96f2-3217d828f1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71877dfd-8672-4c28-aa36-54162941cea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71877dfd-8672-4c28-aa36-54162941cea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1620859407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e917f14-b1f4-44fa-882c-ef52f79fb3ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172115dcf1f44608ae8bf0a443e30047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:01Z,use_quota=True,user_id='e5cc6150dba843a4be483859b9890c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f8736f-dcf8-4886-b050-eccd747290ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f8736f-dcf8-4886-b050-eccd747290ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34cba89-2e07-4937-9f29-1ed626604785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34cba89-2e07-4937-9f29-1ed626604785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e917f14-b1f4-44fa-882c-ef52f79fb3ca', 'volume_name': 'volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e81235-65c7-4a97-963b-8ac8c7e37946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e81235-65c7-4a97-963b-8ac8c7e37946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53539cfa-a966-40a0-baf3-544f6d6219ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:00 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Volume 5e917f14-b1f4-44fa-882c-ef52f79fb3ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca', 'volume_size': 1}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1620859407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e917f14-b1f4-44fa-882c-ef52f79fb3ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172115dcf1f44608ae8bf0a443e30047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:01Z,use_quota=True,user_id='e5cc6150dba843a4be483859b9890c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Creating volume 5e917f14-b1f4-44fa-882c-ef52f79fb3ca {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:00 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:01 devstack sudo[101310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca 1073741824
Nov 04 01:08:01 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Flow 'volume_create_manager' (18754c2b-17dc-4e9f-866b-6bfa6b5f6b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97020cc9-4be6-4a58-8729-b120e2052373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97020cc9-4be6-4a58-8729-b120e2052373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2025347816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f49d26e-8266-47d1-8e5e-c16e2855ddc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420312f0bbb0414f952873b25a2bfc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:01Z,use_quota=True,user_id='29aaf9ee132e41b28b130e5ef97dba32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f4b30a-15a3-4a06-8f36-9a0762baca71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f4b30a-15a3-4a06-8f36-9a0762baca71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f9ee15-1f5f-475a-8f54-3853cf28e0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f9ee15-1f5f-475a-8f54-3853cf28e0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f49d26e-8266-47d1-8e5e-c16e2855ddc5', 'volume_name': 'volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474c5960-1be3-4084-8726-f0cdf33e15b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:01 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474c5960-1be3-4084-8726-f0cdf33e15b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedeed9b-ce73-478a-b7b6-a24df7b5fadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Volume 0f49d26e-8266-47d1-8e5e-c16e2855ddc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5', 'volume_size': 1}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca 1073741824" returned: 0 in 0.485s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:01 devstack sudo[101316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca
Nov 04 01:08:01 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:01 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca" returned: 0 in 0.248s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2025347816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f49d26e-8266-47d1-8e5e-c16e2855ddc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420312f0bbb0414f952873b25a2bfc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:01Z,use_quota=True,user_id='29aaf9ee132e41b28b130e5ef97dba32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Creating volume 0f49d26e-8266-47d1-8e5e-c16e2855ddc5 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:01 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:01 devstack sudo[101319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5 1073741824
Nov 04 01:08:01 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53539cfa-a966-40a0-baf3-544f6d6219ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2051227d-bf4c-4bbd-af28-56844eba8f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Volume volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca (5e917f14-b1f4-44fa-882c-ef52f79fb3ca): created successfully
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2051227d-bf4c-4bbd-af28-56844eba8f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Flow 'volume_create_manager' (97d02068-9abe-4cf2-96f2-3217d828f1ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4e37ee90-8100-46fc-8d2e-94c9d796495b tempest-VolumesTransfersTest-1364398739 None] Created volume successfully.
Nov 04 01:08:02 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5 1073741824" returned: 0 in 0.444s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:02 devstack sudo[101325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5
Nov 04 01:08:02 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:02 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5" returned: 0 in 0.282s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedeed9b-ce73-478a-b7b6-a24df7b5fadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cdea35-0a97-42ea-839d-f3a892e6326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:02 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Volume volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5 (0f49d26e-8266-47d1-8e5e-c16e2855ddc5): created successfully
Nov 04 01:08:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cdea35-0a97-42ea-839d-f3a892e6326a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Flow 'volume_create_manager' (18754c2b-17dc-4e9f-866b-6bfa6b5f6b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:02 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-974e1ca5-3aac-4c99-a1ec-283817cd4010 tempest-VolumesNegativeTest-1572102299 None] Created volume successfully.
Nov 04 01:08:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Acquiring lock "cinder-5e917f14-b1f4-44fa-882c-ef52f79fb3ca-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Lock "cinder-5e917f14-b1f4-44fa-882c-ef52f79fb3ca-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Acquiring lock "cinder-quobyte-5e917f14-b1f4-44fa-882c-ef52f79fb3ca" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Lock "cinder-quobyte-5e917f14-b1f4-44fa-882c-ef52f79fb3ca" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:03 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1f6425-2c2c-4aea-8400-225b3534e82a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:03 devstack sudo[101328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca
Nov 04 01:08:03 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:03 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca" returned: 0 in 0.415s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:03 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca
Nov 04 01:08:03 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:04 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5e917f14-b1f4-44fa-882c-ef52f79fb3ca" returned: 0 in 0.343s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Lock "cinder-quobyte-5e917f14-b1f4-44fa-882c-ef52f79fb3ca" released by "delete_volume" :: held 0.818s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Created reservations ['0bd57d7e-73f8-4e31-820f-bf41763a477e', '7433bea8-fec6-495f-bf4f-c1eebb7a0c66', '72a51b0a-f1f6-4aef-b222-a499dbae5ec3', '1667aee2-5109-4f2c-ab00-04db6a291636'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:04 devstack sudo[101343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:04 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:04 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.410s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:04 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Deleted volume successfully.
Nov 04 01:08:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-18e1e9bc-30dd-4790-acaf-431738d5269e tempest-VolumesTransfersTest-1057684734 None] Lock "cinder-5e917f14-b1f4-44fa-882c-ef52f79fb3ca-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:05 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Flow 'volume_create_manager' (a57afd58-3af9-4b0f-8271-f0e2019a3297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9209ae1f-025b-422e-b686-ee12a740784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9209ae1f-025b-422e-b686-ee12a740784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1669870869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc59dc20-c33f-40d4-bedb-5ec14d3f229f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421bd065a5a0411da236c26024aad6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:06Z,use_quota=True,user_id='8ead3257e1e14a609c585e81324ee598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da12d9e-3e93-48af-910d-b9ec385e4a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da12d9e-3e93-48af-910d-b9ec385e4a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd8b110-e520-485f-a577-644807c0070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd8b110-e520-485f-a577-644807c0070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc59dc20-c33f-40d4-bedb-5ec14d3f229f', 'volume_name': 'volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c10764f-b0d2-44ea-bebf-da766c67e7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c10764f-b0d2-44ea-bebf-da766c67e7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa04e078-811d-44fa-87c4-e0b4aad6abae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:06 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Volume dc59dc20-c33f-40d4-bedb-5ec14d3f229f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f', 'volume_size': 1}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1669870869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc59dc20-c33f-40d4-bedb-5ec14d3f229f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421bd065a5a0411da236c26024aad6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:06Z,use_quota=True,user_id='8ead3257e1e14a609c585e81324ee598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Creating volume dc59dc20-c33f-40d4-bedb-5ec14d3f229f {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:06 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:06 devstack sudo[101346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f 1073741824
Nov 04 01:08:06 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:06 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f 1073741824" returned: 0 in 0.599s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:06 devstack sudo[101362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f
Nov 04 01:08:06 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:07 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f" returned: 0 in 0.304s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa04e078-811d-44fa-87c4-e0b4aad6abae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5385bf5c-561d-4218-8038-aae4d82a5cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:07 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Volume volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f (dc59dc20-c33f-40d4-bedb-5ec14d3f229f): created successfully
Nov 04 01:08:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5385bf5c-561d-4218-8038-aae4d82a5cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Flow 'volume_create_manager' (a57afd58-3af9-4b0f-8271-f0e2019a3297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:07 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-427c8856-19ae-4b46-a426-df217e5c8fbb tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Created volume successfully.
Nov 04 01:08:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-20087867-4b4f-487c-8860-d2e20d069e61 req-317a1470-bb42-4aa4-8368-5ecd4d8878df tempest-TestStampPattern-669717848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-20087867-4b4f-487c-8860-d2e20d069e61 req-317a1470-bb42-4aa4-8368-5ecd4d8878df tempest-TestStampPattern-669717848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-b6c6e28b-5a69-4639-addd-c87114813b3d req-4730af1a-ecee-4f90-ba1d-71b5d73e2613 tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-20087867-4b4f-487c-8860-d2e20d069e61 req-317a1470-bb42-4aa4-8368-5ecd4d8878df tempest-TestStampPattern-669717848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-b6c6e28b-5a69-4639-addd-c87114813b3d req-4730af1a-ecee-4f90-ba1d-71b5d73e2613 tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.021s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-b6c6e28b-5a69-4639-addd-c87114813b3d req-4730af1a-ecee-4f90-ba1d-71b5d73e2613 tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-20087867-4b4f-487c-8860-d2e20d069e61 req-317a1470-bb42-4aa4-8368-5ecd4d8878df tempest-TestStampPattern-669717848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73f3c438-9ba2-49fc-8850-23febfb341a7', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:08:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-b6c6e28b-5a69-4639-addd-c87114813b3d req-4730af1a-ecee-4f90-ba1d-71b5d73e2613 tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46dd74c0-9afe-4cc1-acd2-5f99cd666f31', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:08:09 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-20087867-4b4f-487c-8860-d2e20d069e61 req-317a1470-bb42-4aa4-8368-5ecd4d8878df tempest-TestStampPattern-669717848 None] attachment_update completed successfully.
Nov 04 01:08:09 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-b6c6e28b-5a69-4639-addd-c87114813b3d req-4730af1a-ecee-4f90-ba1d-71b5d73e2613 tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] attachment_update completed successfully.
Nov 04 01:08:14 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-985ad30c-58a2-46f3-827f-4168c8622292 req-baba7514-63cd-411a-a33a-eaaf14a2d95a tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Terminate volume connection completed successfully.
Nov 04 01:08:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-985ad30c-58a2-46f3-827f-4168c8622292 req-baba7514-63cd-411a-a33a-eaaf14a2d95a tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Deleting attachment 46dd74c0-9afe-4cc1-acd2-5f99cd666f31. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:08:15 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-450a8e92-f0e0-4572-9918-536600a19812 req-d33498eb-78ee-485d-8d9c-30a1ac004ff8 tempest-TestStampPattern-669717848 None] Terminate volume connection completed successfully.
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-450a8e92-f0e0-4572-9918-536600a19812 req-d33498eb-78ee-485d-8d9c-30a1ac004ff8 tempest-TestStampPattern-669717848 None] Deleting attachment 73f3c438-9ba2-49fc-8850-23febfb341a7. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (51401f1c-8908-4d98-a701-6aaefbdbfd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea75d2f-295c-46b6-9e7e-49471f15b343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea75d2f-295c-46b6-9e7e-49471f15b343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-954223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314f90e7-9792-443c-a279-9d417ed2fd47,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:16Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d747317a-675a-4871-a837-44f5aa91cbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d747317a-675a-4871-a837-44f5aa91cbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ff97eb-9370-4901-942a-aa5378f028ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ff97eb-9370-4901-942a-aa5378f028ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '314f90e7-9792-443c-a279-9d417ed2fd47', 'volume_name': 'volume-314f90e7-9792-443c-a279-9d417ed2fd47', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565c486a-006e-46e5-a756-5630641f31aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565c486a-006e-46e5-a756-5630641f31aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98571656-772f-4fa8-a081-2e5b42e302c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:15 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Volume 314f90e7-9792-443c-a279-9d417ed2fd47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-314f90e7-9792-443c-a279-9d417ed2fd47', 'volume_size': 1}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-954223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314f90e7-9792-443c-a279-9d417ed2fd47,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:16Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Creating volume 314f90e7-9792-443c-a279-9d417ed2fd47 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:15 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Acquiring lock "cinder-dc59dc20-c33f-40d4-bedb-5ec14d3f229f-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:15 devstack sudo[101994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47 1073741824
Nov 04 01:08:15 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "cinder-dc59dc20-c33f-40d4-bedb-5ec14d3f229f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Acquiring lock "cinder-quobyte-dc59dc20-c33f-40d4-bedb-5ec14d3f229f" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "cinder-quobyte-dc59dc20-c33f-40d4-bedb-5ec14d3f229f" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4892f8-f1f3-44b7-858e-5c56b2b43723]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:16 devstack sudo[101996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f
Nov 04 01:08:16 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:16 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47 1073741824" returned: 0 in 0.581s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:16 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f" returned: 0 in 0.452s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:16 devstack sudo[102004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f
Nov 04 01:08:16 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:16 devstack sudo[102007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47
Nov 04 01:08:16 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:16 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc59dc20-c33f-40d4-bedb-5ec14d3f229f" returned: 0 in 0.399s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:16 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47" returned: 0 in 0.361s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "cinder-quobyte-dc59dc20-c33f-40d4-bedb-5ec14d3f229f" released by "delete_volume" :: held 0.912s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98571656-772f-4fa8-a081-2e5b42e302c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-314f90e7-9792-443c-a279-9d417ed2fd47', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17206ff3-6a42-417f-b88b-d8b520bfb1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:16 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Volume volume-314f90e7-9792-443c-a279-9d417ed2fd47 (314f90e7-9792-443c-a279-9d417ed2fd47): created successfully
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17206ff3-6a42-417f-b88b-d8b520bfb1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (51401f1c-8908-4d98-a701-6aaefbdbfd14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:16 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7084f6f8-2c50-452d-b6ff-7e6242b73ce7 tempest-VolumesGetTest-44887497 None] Created volume successfully.
Nov 04 01:08:16 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Created reservations ['aee362fc-026c-4ce4-b44f-2c25412bd3bd', '64c77a7a-78a2-42b0-98f3-28922da48bf2', '8df57430-fb0f-4908-8a30-f02ddaa0c934', 'cf2c411f-a71e-4534-9b47-1d282366b8c9'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:17 devstack sudo[102012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:17 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:17 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.274s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:17 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Deleted volume successfully.
Nov 04 01:08:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d67d45-506f-4001-a40b-0f904755508f tempest-TestServerVolumeAttachScenarioOldVersion-735024142 None] Lock "cinder-dc59dc20-c33f-40d4-bedb-5ec14d3f229f-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (18b19ead-d5f7-4bfc-968c-0c3f8c427bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0125670-64e2-4244-b268-91cfd5910eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0125670-64e2-4244-b268-91cfd5910eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1047539581',display_name='tempest-VolumesGetTest-Volume-275820881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97741618-b370-4e56-ba4a-ec3a47b32a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:19Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16756ca-b8c5-4fec-8780-b32ff252c0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16756ca-b8c5-4fec-8780-b32ff252c0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d02af8-8f93-4c03-aecc-a88ea73859ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d02af8-8f93-4c03-aecc-a88ea73859ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97741618-b370-4e56-ba4a-ec3a47b32a1a', 'volume_name': 'volume-97741618-b370-4e56-ba4a-ec3a47b32a1a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98134bc7-8c1a-4a5d-92eb-a446c56b3fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98134bc7-8c1a-4a5d-92eb-a446c56b3fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43de8b52-82ad-4a9f-9ac7-c5741433906a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:19 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Volume 97741618-b370-4e56-ba4a-ec3a47b32a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97741618-b370-4e56-ba4a-ec3a47b32a1a', 'volume_size': 1}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1047539581',display_name='tempest-VolumesGetTest-Volume-275820881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97741618-b370-4e56-ba4a-ec3a47b32a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:19Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Creating volume 97741618-b370-4e56-ba4a-ec3a47b32a1a {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:19 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:19 devstack sudo[102061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a 1073741824
Nov 04 01:08:19 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:20 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a 1073741824" returned: 0 in 0.806s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:20 devstack sudo[102074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a
Nov 04 01:08:20 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:20 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a" returned: 0 in 0.299s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43de8b52-82ad-4a9f-9ac7-c5741433906a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97741618-b370-4e56-ba4a-ec3a47b32a1a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a931fe-bcee-43e0-b93e-c094b2bd9724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:20 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Volume volume-97741618-b370-4e56-ba4a-ec3a47b32a1a (97741618-b370-4e56-ba4a-ec3a47b32a1a): created successfully
Nov 04 01:08:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a931fe-bcee-43e0-b93e-c094b2bd9724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (18b19ead-d5f7-4bfc-968c-0c3f8c427bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:20 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d837c7fb-c5cb-4036-9804-446d76b49e49 tempest-VolumesGetTest-44887497 None] Created volume successfully.
Nov 04 01:08:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-97741618-b370-4e56-ba4a-ec3a47b32a1a-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Lock "cinder-97741618-b370-4e56-ba4a-ec3a47b32a1a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-quobyte-97741618-b370-4e56-ba4a-ec3a47b32a1a" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-97741618-b370-4e56-ba4a-ec3a47b32a1a" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:21 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0133f2d7-02c8-4cfe-a5ed-e0774f6acf19]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:21 devstack sudo[102081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a
Nov 04 01:08:21 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:22 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a" returned: 0 in 0.456s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:22 devstack sudo[102087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a
Nov 04 01:08:22 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Acquiring lock "cinder-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Lock "cinder-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Acquiring lock "cinder-quobyte-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be79660-d93b-4d49-988e-745fabc3f840]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:22 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:22 devstack sudo[102089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd
Nov 04 01:08:22 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-97741618-b370-4e56-ba4a-ec3a47b32a1a" returned: 0 in 0.359s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-97741618-b370-4e56-ba4a-ec3a47b32a1a" released by "delete_volume" :: held 0.890s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Created reservations ['9ef69d4f-2238-4b5d-8e25-69df6d19158c', '902ca854-95b5-451d-9d8f-08553f69eee2', 'f234c7f6-c971-44ac-abb6-79e3f1098562', 'cab7515c-b058-4237-bc80-302b886ba049'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:22 devstack sudo[102094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:22 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:23 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" returned: 0 in 0.533s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:23 devstack sudo[102099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd
Nov 04 01:08:23 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:23 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.300s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:23 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Deleted volume successfully.
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-afda2904-f60e-492b-b0cd-fc9823b7527d tempest-VolumesGetTest-44887497 None] Lock "cinder-97741618-b370-4e56-ba4a-ec3a47b32a1a-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:23 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" returned: 0 in 0.271s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd" released by "delete_volume" :: held 0.873s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=100,cinder:SELECT=77,cinder:INSERT=22,cinder:DELETE=9 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:DELETE=9,cinder:SELECT=72,cinder:INSERT=19,cinder:UPDATE=94 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Created reservations ['d067ed6d-6ffd-42f4-bb1c-bc01c166040f', '885dfa53-cd9c-47ce-99f7-7a5b81abd35a', '1921730b-1c99-4417-8fc8-a9ea1c315acb', '91737a6d-5c6c-4d75-a441-ba7e2e134315'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:23 devstack sudo[102103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:23 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:23 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.260s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:23 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Deleted volume successfully.
Nov 04 01:08:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d6bd4fc7-0324-4ef6-84b7-1df16d5229c8 tempest-TestStampPattern-669717848 None] Lock "cinder-e1dcc06c-a8c5-4f56-a0d3-2c4f433679cd-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-314f90e7-9792-443c-a279-9d417ed2fd47-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Lock "cinder-314f90e7-9792-443c-a279-9d417ed2fd47-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-quobyte-314f90e7-9792-443c-a279-9d417ed2fd47" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-314f90e7-9792-443c-a279-9d417ed2fd47" acquired by "delete_volume" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:24 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[84acf8a5-0643-40fa-8908-d868e095a42d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:24 devstack sudo[102106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47
Nov 04 01:08:24 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:24 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47" returned: 0 in 0.478s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:24 devstack sudo[102111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47
Nov 04 01:08:24 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:24 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Acquiring lock "cinder-6db4416a-3422-4fd8-9044-b9dd1a6bdab8-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-314f90e7-9792-443c-a279-9d417ed2fd47" returned: 0 in 0.351s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Lock "cinder-6db4416a-3422-4fd8-9044-b9dd1a6bdab8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Acquiring lock "cinder-quobyte-5c516347-0dd8-4d45-a802-a400a6ca5729" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-314f90e7-9792-443c-a279-9d417ed2fd47" released by "delete_volume" :: held 0.905s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-5c516347-0dd8-4d45-a802-a400a6ca5729" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Acquiring lock "cinder-quobyte-6db4416a-3422-4fd8-9044-b9dd1a6bdab8" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-6db4416a-3422-4fd8-9044-b9dd1a6bdab8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Deleting offline snapshot 6db4416a-3422-4fd8-9044-b9dd1a6bdab8 of volume 5c516347-0dd8-4d45-a802-a400a6ca5729 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] snapshot_file for this snap is: volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01f62a7-0da5-4e69-aecd-7ee33031b247]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Created reservations ['f09a6a5a-0742-43f7-b365-781df1293eeb', 'bbb5d4a0-65b2-40b2-bcdf-68382c48212f', '0c385c79-d1ce-4054-aeb0-046be4b10f84', 'd3bb1267-7444-4d92-854a-4c78cdeec5bc'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:25 devstack sudo[102116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:25 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:25 devstack sudo[102114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8
Nov 04 01:08:25 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:25 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.324s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:25 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Deleted volume successfully.
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2bfad0d9-ad83-4d1f-94c3-001feafaba19 tempest-VolumesGetTest-44887497 None] Lock "cinder-314f90e7-9792-443c-a279-9d417ed2fd47-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:25 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8" returned: 0 in 0.538s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c516347-0dd8-4d45-a802-a400a6ca5729(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c862901-6740-4c15-9e97-c977be7419d4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:25 devstack sudo[102123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729
Nov 04 01:08:25 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:26 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729" returned: 0 in 0.626s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:26 devstack sudo[102129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8
Nov 04 01:08:26 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:26 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8" returned: 0 in 0.558s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:26 devstack sudo[102135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8
Nov 04 01:08:26 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:26 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (580d41da-d0ac-47c5-92eb-db891646e49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492ef33e-1840-4565-b8d1-d9273cdaa487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492ef33e-1840-4565-b8d1-d9273cdaa487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1797479336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29800ac-82a3-4c72-880f-a965931beced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:27Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2347af0-afed-4a93-953e-539c567523ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2347af0-afed-4a93-953e-539c567523ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c627aa7-3170-421a-9223-09b15526de4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c627aa7-3170-421a-9223-09b15526de4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29800ac-82a3-4c72-880f-a965931beced', 'volume_name': 'volume-c29800ac-82a3-4c72-880f-a965931beced', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ae92e7-99f6-48a7-b0a1-0e64682aa79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ae92e7-99f6-48a7-b0a1-0e64682aa79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfe49d9-d199-451f-8e8e-ed10afeca5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:27 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Volume c29800ac-82a3-4c72-880f-a965931beced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29800ac-82a3-4c72-880f-a965931beced', 'volume_size': 1}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1797479336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29800ac-82a3-4c72-880f-a965931beced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:27Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Creating volume c29800ac-82a3-4c72-880f-a965931beced {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:27 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:27 devstack sudo[102137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced 1073741824
Nov 04 01:08:27 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:27 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729.6db4416a-3422-4fd8-9044-b9dd1a6bdab8" returned: 0 in 0.310s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-6db4416a-3422-4fd8-9044-b9dd1a6bdab8" released by "_delete_snapshot" :: held 2.194s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-5c516347-0dd8-4d45-a802-a400a6ca5729" released by "delete_snapshot" :: held 2.228s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Created reservations ['cac9c48e-520b-4e1a-9b7e-525dcf884e4b', '2a220c57-04ec-4d63-b8c0-622c5a098c0c', '340e44ee-9922-46bd-9cc8-3e6f0775f8b4', '18e621f3-c520-455a-a6e0-ea4f8e7a3c88'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Acquiring lock "cinder-0f49d26e-8266-47d1-8e5e-c16e2855ddc5-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Delete snapshot completed successfully.
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Lock "cinder-0f49d26e-8266-47d1-8e5e-c16e2855ddc5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e2c92fa1-308a-4500-b566-3dab2b89b54e tempest-TestStampPattern-669717848 None] Lock "cinder-6db4416a-3422-4fd8-9044-b9dd1a6bdab8-delete_snapshot" released by "delete_snapshot" :: held 2.425s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Acquiring lock "cinder-quobyte-0f49d26e-8266-47d1-8e5e-c16e2855ddc5" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Lock "cinder-quobyte-0f49d26e-8266-47d1-8e5e-c16e2855ddc5" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[da827111-f01b-4b18-ae61-cea005f3544f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:27 devstack sudo[102143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5
Nov 04 01:08:27 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:27 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced 1073741824" returned: 0 in 0.551s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:27 devstack sudo[102146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced
Nov 04 01:08:27 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:27 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5" returned: 0 in 0.444s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:27 devstack sudo[102152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5
Nov 04 01:08:27 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:28 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced" returned: 0 in 0.396s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfe49d9-d199-451f-8e8e-ed10afeca5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29800ac-82a3-4c72-880f-a965931beced', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f414f9-21da-4514-b33c-caac7156ac03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:28 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Volume volume-c29800ac-82a3-4c72-880f-a965931beced (c29800ac-82a3-4c72-880f-a965931beced): created successfully
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f414f9-21da-4514-b33c-caac7156ac03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (580d41da-d0ac-47c5-92eb-db891646e49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f537c6c7-b2db-4e3e-9a6d-e8b9da9708f5 tempest-VolumesGetTest-44887497 None] Created volume successfully.
Nov 04 01:08:28 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0f49d26e-8266-47d1-8e5e-c16e2855ddc5" returned: 0 in 0.293s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Lock "cinder-quobyte-0f49d26e-8266-47d1-8e5e-c16e2855ddc5" released by "delete_volume" :: held 0.788s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Created reservations ['b1385b4a-a495-4b7d-bb87-ee652c6525ea', '83b2e881-d663-466b-8481-aa32086fb543', '5280ab9c-e6b3-4801-bd31-278ec30e0099', '2f1f2e19-8ba0-4e34-aaac-3878205d68e6'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:28 devstack sudo[102156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:28 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:28 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.294s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Deleted volume successfully.
Nov 04 01:08:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a4b94cdc-cadb-48af-b2ea-a2eb4cb6d38d tempest-VolumesNegativeTest-1572102299 None] Lock "cinder-0f49d26e-8266-47d1-8e5e-c16e2855ddc5-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:29 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (0a9d57d9-9dfe-4acc-b123-ca813b6653b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db7f594-c876-442f-9644-1816dcb8b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db7f594-c876-442f-9644-1816dcb8b632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1838480770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a113e72-1ccf-4f7f-b320-f87f5f63a3b8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=c29800ac-82a3-4c72-880f-a965931beced,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:30Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ad1c09-9a3e-4baa-991e-8a85526e49df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ad1c09-9a3e-4baa-991e-8a85526e49df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11533228-58d1-47d2-be18-31c20452f0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11533228-58d1-47d2-be18-31c20452f0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4a113e72-1ccf-4f7f-b320-f87f5f63a3b8', 'volume_name': 'volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8', 'volume_size': 1, 'source_volid': 'c29800ac-82a3-4c72-880f-a965931beced', 'source_volstatus': 'available'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08f92b8-6356-4655-890b-f2320fe06ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08f92b8-6356-4655-890b-f2320fe06ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:30 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec947f0-1bfc-4970-a6de-67fadbe7089c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:30 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Volume 4a113e72-1ccf-4f7f-b320-f87f5f63a3b8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8', 'volume_size': 1, 'source_volid': 'c29800ac-82a3-4c72-880f-a965931beced', 'source_volstatus': 'available'}
Nov 04 01:08:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:30 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Cloning volume c29800ac-82a3-4c72-880f-a965931beced to volume 4a113e72-1ccf-4f7f-b320-f87f5f63a3b8
Nov 04 01:08:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Creating offline snapshot beafd84d-d6f7-42db-9bed-b90b5d6a6529 of volume c29800ac-82a3-4c72-880f-a965931beced {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:08:30 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e44e54-6667-42c4-ade7-26e30ee99499]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:30 devstack sudo[102180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced
Nov 04 01:08:30 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:30 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced" returned: 0 in 0.430s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:30 devstack sudo[102192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529 1G
Nov 04 01:08:30 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:31 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529 1G" returned: 0 in 0.531s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29800ac-82a3-4c72-880f-a965931beced -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:31 devstack sudo[102199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29800ac-82a3-4c72-880f-a965931beced -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529
Nov 04 01:08:31 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:31 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29800ac-82a3-4c72-880f-a965931beced -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529" returned: 0 in 0.462s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:31 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529 is being set with open permissions: ugo+rw
Nov 04 01:08:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:31 devstack sudo[102206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529
Nov 04 01:08:31 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:31 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529" returned: 0 in 0.270s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:32 devstack sudo[102210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.info
Nov 04 01:08:32 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:32 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.info" returned: 0 in 0.391s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:32 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.info is being set with open permissions: ugo+rw
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:32 devstack sudo[102213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.info
Nov 04 01:08:32 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:32 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.info" returned: 0 in 0.386s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-quobyte-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] snapshot: beafd84d-d6f7-42db-9bed-b90b5d6a6529, volume: 4a113e72-1ccf-4f7f-b320-f87f5f63a3b8,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[921792fc-e4c8-4af4-aa40-fb739ab4d9fe]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:32 devstack sudo[102216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529
Nov 04 01:08:32 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:33 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529" returned: 0 in 0.407s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c29800ac-82a3-4c72-880f-a965931beced(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30d1544-affd-4943-817f-7ed9f709a568]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:33 devstack sudo[102221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced
Nov 04 01:08:33 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:33 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced" returned: 0 in 0.437s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8 not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:33 devstack sudo[102227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8
Nov 04 01:08:33 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Acquiring lock "cinder-5c516347-0dd8-4d45-a802-a400a6ca5729-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Lock "cinder-5c516347-0dd8-4d45-a802-a400a6ca5729-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Acquiring lock "cinder-quobyte-5c516347-0dd8-4d45-a802-a400a6ca5729" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-5c516347-0dd8-4d45-a802-a400a6ca5729" acquired by "delete_volume" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:34 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d241a67e-12ae-45b5-994c-ee06e4b5232f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:34 devstack sudo[102231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729
Nov 04 01:08:34 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:34 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729" returned: 0 in 0.757s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:34 devstack sudo[102245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729
Nov 04 01:08:34 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:35 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5c516347-0dd8-4d45-a802-a400a6ca5729" returned: 0 in 0.626s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Lock "cinder-quobyte-5c516347-0dd8-4d45-a802-a400a6ca5729" released by "delete_volume" :: held 1.509s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:35 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Created reservations ['cdcb12e0-38e9-4b19-b2e9-1fc27d5451ce', 'fa5a881b-deb7-4952-98e0-5e80de16dde4', '15d722b9-4349-4666-a502-272dde045c99', 'c3107fbc-76fd-40b8-95bd-57fee57d9286'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:35 devstack sudo[102249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:35 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:36 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.594s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:36 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:36 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Deleted volume successfully.
Nov 04 01:08:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-01bc9801-59ab-42cf-8be6-bc95174fd5ff tempest-TestStampPattern-669717848 None] Lock "cinder-5c516347-0dd8-4d45-a802-a400a6ca5729-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:42 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8" returned: 0 in 8.831s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:42 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced, size 1024.00 MB, duration 8.83 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:08:42 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Converted 1024.00 MB image at 115.94 MB/s
Nov 04 01:08:42 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8 is being set with open permissions: ugo+rw
Nov 04 01:08:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:42 devstack sudo[102254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8
Nov 04 01:08:42 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:42 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8" returned: 0 in 0.313s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8" released by "_copy_volume_from_snapshot" :: held 10.072s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-quobyte-beafd84d-d6f7-42db-9bed-b90b5d6a6529" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-beafd84d-d6f7-42db-9bed-b90b5d6a6529" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Deleting offline snapshot beafd84d-d6f7-42db-9bed-b90b5d6a6529 of volume c29800ac-82a3-4c72-880f-a965931beced {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:08:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] snapshot_file for this snap is: volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:08:42 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[372ee916-4608-48f2-8847-604c042a8274]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:43 devstack sudo[102257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529
Nov 04 01:08:43 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:43 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529" returned: 0 in 0.522s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c29800ac-82a3-4c72-880f-a965931beced(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:08:43 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[830e724c-ae7e-4fec-9b32-0305bdb633cd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:43 devstack sudo[102263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced
Nov 04 01:08:43 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:44 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced" returned: 0 in 0.761s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:44 devstack sudo[102268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529
Nov 04 01:08:44 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:44 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529" returned: 0 in 0.485s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:44 devstack sudo[102273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529
Nov 04 01:08:44 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:45 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced.beafd84d-d6f7-42db-9bed-b90b5d6a6529" returned: 0 in 0.416s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-beafd84d-d6f7-42db-9bed-b90b5d6a6529" released by "_delete_snapshot" :: held 2.331s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.298s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Flow 'volume_create_manager' (dabb4f68-a805-40a2-bd12-080922ec9d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee77eb37-cca8-48d3-8f83-0da8e03a22d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec947f0-1bfc-4970-a6de-67fadbe7089c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8', 'volume_size': 1, 'source_volid': 'c29800ac-82a3-4c72-880f-a965931beced', 'source_volstatus': 'available'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04fc4a3-3648-494e-b9e8-af7904b1c455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee77eb37-cca8-48d3-8f83-0da8e03a22d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1368195526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9df3d33-4cd6-423e-8c64-880b6160c57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7621cba2466782139c60e8bb1fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:45Z,use_quota=True,user_id='ff6887bfc1b84fe886c109713f0032bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67165a9c-9be2-4b89-bdc7-8652159c732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67165a9c-9be2-4b89-bdc7-8652159c732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603a422d-9cf5-4e6c-afb7-0e976e5c8eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603a422d-9cf5-4e6c-afb7-0e976e5c8eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9df3d33-4cd6-423e-8c64-880b6160c57b', 'volume_name': 'volume-b9df3d33-4cd6-423e-8c64-880b6160c57b', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ba39f0-6d5b-47fb-8f71-225580a16ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ba39f0-6d5b-47fb-8f71-225580a16ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6a1c0b-5fa7-4982-9454-60aef97cab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:45 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Volume b9df3d33-4cd6-423e-8c64-880b6160c57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9df3d33-4cd6-423e-8c64-880b6160c57b', 'volume_size': 1}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1368195526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9df3d33-4cd6-423e-8c64-880b6160c57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7621cba2466782139c60e8bb1fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:45Z,use_quota=True,user_id='ff6887bfc1b84fe886c109713f0032bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Creating volume b9df3d33-4cd6-423e-8c64-880b6160c57b {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:45 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:45 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Volume volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8 (4a113e72-1ccf-4f7f-b320-f87f5f63a3b8): created successfully
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04fc4a3-3648-494e-b9e8-af7904b1c455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (0a9d57d9-9dfe-4acc-b123-ca813b6653b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:45 devstack sudo[102277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b 1073741824
Nov 04 01:08:45 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-91e9c463-84ad-4c2b-b293-0b24d4d38869 tempest-VolumesGetTest-44887497 None] Created volume successfully.
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Flow 'volume_create_manager' (6115c5a6-6c68-448f-8205-278edb8efd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc6bbfc-a60c-4cdb-aac3-fef9b03bad2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc6bbfc-a60c-4cdb-aac3-fef9b03bad2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2090058397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5727f4ca-f532-4bf0-b079-5460fc908619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7621cba2466782139c60e8bb1fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:46Z,use_quota=True,user_id='ff6887bfc1b84fe886c109713f0032bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bffb42-5d45-46e0-a221-71272f815792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6bffb42-5d45-46e0-a221-71272f815792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1513c1-07a3-4e1a-8908-37e61bbf2ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1513c1-07a3-4e1a-8908-37e61bbf2ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5727f4ca-f532-4bf0-b079-5460fc908619', 'volume_name': 'volume-5727f4ca-f532-4bf0-b079-5460fc908619', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30fe7e8-d5f3-4a3a-b666-50584a4aec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30fe7e8-d5f3-4a3a-b666-50584a4aec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bbb67d-5899-40da-bedc-f1efd82e5352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:46 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Volume 5727f4ca-f532-4bf0-b079-5460fc908619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5727f4ca-f532-4bf0-b079-5460fc908619', 'volume_size': 1}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:46 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b 1073741824" returned: 0 in 0.763s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:46 devstack sudo[102283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b
Nov 04 01:08:46 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Flow 'volume_create_manager' (2c829277-382f-4e25-a9c9-28908ad965cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4a32ae-2759-4053-a0a3-ea98dc264e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4a32ae-2759-4053-a0a3-ea98dc264e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139275821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751b00c1-cd3b-4c13-b412-5e680e9d03b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7621cba2466782139c60e8bb1fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:47Z,use_quota=True,user_id='ff6887bfc1b84fe886c109713f0032bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b326cf5d-7ecd-49cf-b4e6-1ae73eda4980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b326cf5d-7ecd-49cf-b4e6-1ae73eda4980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c314716-9d51-4e5f-91a7-923644ab7a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c314716-9d51-4e5f-91a7-923644ab7a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '751b00c1-cd3b-4c13-b412-5e680e9d03b6', 'volume_name': 'volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98424cb-a84a-461d-9e92-019d0dbbe102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98424cb-a84a-461d-9e92-019d0dbbe102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4893d096-971a-427f-b5f2-fe3d5031113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:46 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:46 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Volume 751b00c1-cd3b-4c13-b412-5e680e9d03b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6', 'volume_size': 1}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b" returned: 0 in 0.455s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2090058397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5727f4ca-f532-4bf0-b079-5460fc908619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7621cba2466782139c60e8bb1fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:46Z,use_quota=True,user_id='ff6887bfc1b84fe886c109713f0032bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Creating volume 5727f4ca-f532-4bf0-b079-5460fc908619 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:46 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:46 devstack sudo[102286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619 1073741824
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6a1c0b-5fa7-4982-9454-60aef97cab6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9df3d33-4cd6-423e-8c64-880b6160c57b', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8ac8de-8948-489c-b186-a144cae636b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:46 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:46 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Volume volume-b9df3d33-4cd6-423e-8c64-880b6160c57b (b9df3d33-4cd6-423e-8c64-880b6160c57b): created successfully
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8ac8de-8948-489c-b186-a144cae636b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Flow 'volume_create_manager' (dabb4f68-a805-40a2-bd12-080922ec9d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f9a77d02-ffba-45e7-a285-0fe658ff8e62 tempest-CreateVolumesFromImageTest-135399835 None] Created volume successfully.
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Flow 'volume_create_manager' (2094028f-6ca3-4269-b492-4c21f8dcf6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954d3f0c-0086-499e-a642-215e36abed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954d3f0c-0086-499e-a642-215e36abed8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529656277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d535cff1-3c9d-440f-86d2-87dcaad01ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7621cba2466782139c60e8bb1fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:47Z,use_quota=True,user_id='ff6887bfc1b84fe886c109713f0032bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364fe6eb-8ea6-40b1-820b-600536f2f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364fe6eb-8ea6-40b1-820b-600536f2f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af975085-fff4-483f-8dc2-675458666b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af975085-fff4-483f-8dc2-675458666b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd535cff1-3c9d-440f-86d2-87dcaad01ed2', 'volume_name': 'volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd3f528-c6f2-4baf-9118-02fd2108da95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd3f528-c6f2-4baf-9118-02fd2108da95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a106a109-c648-409e-97c6-df8fae1123b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:47 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Volume d535cff1-3c9d-440f-86d2-87dcaad01ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2', 'volume_size': 1}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:47 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619 1073741824" returned: 0 in 0.859s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:47 devstack sudo[102292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619
Nov 04 01:08:47 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (c2621229-5975-4bff-91bd-c8ba59852031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:48 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7089c3-90ee-4db8-ba42-12aad85f1faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619" returned: 0 in 0.418s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139275821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751b00c1-cd3b-4c13-b412-5e680e9d03b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7621cba2466782139c60e8bb1fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:47Z,use_quota=True,user_id='ff6887bfc1b84fe886c109713f0032bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Creating volume 751b00c1-cd3b-4c13-b412-5e680e9d03b6 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:48 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:48 devstack sudo[102295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6 1073741824
Nov 04 01:08:48 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7089c3-90ee-4db8-ba42-12aad85f1faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1318722223',display_name='tempest-VolumesGetTest-Volume-1087088875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a127bfbc-ea6b-421d-b877-21a7593c8fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:48Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f8ffbc-5dab-4820-97d0-c9816d3b7884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f8ffbc-5dab-4820-97d0-c9816d3b7884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb18096f-a022-4a41-8c57-7bf8054421ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb18096f-a022-4a41-8c57-7bf8054421ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a127bfbc-ea6b-421d-b877-21a7593c8fa9', 'volume_name': 'volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5472e1e3-2dd3-4e2b-ab6f-efb7ff7572d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5472e1e3-2dd3-4e2b-ab6f-efb7ff7572d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241d89ae-2968-46ae-84f5-42aa23eb0d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:48 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Volume a127bfbc-ea6b-421d-b877-21a7593c8fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9', 'volume_size': 1}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Flow 'volume_create_manager' (136fbe6c-b39c-4ad5-8d29-f1d477421a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2501417b-5aea-4dde-ba0e-7f5ea174a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bbb67d-5899-40da-bedc-f1efd82e5352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5727f4ca-f532-4bf0-b079-5460fc908619', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a50c634-2ee9-4ed3-8f4d-80564f43cbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:48 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Volume volume-5727f4ca-f532-4bf0-b079-5460fc908619 (5727f4ca-f532-4bf0-b079-5460fc908619): created successfully
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a50c634-2ee9-4ed3-8f4d-80564f43cbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Flow 'volume_create_manager' (6115c5a6-6c68-448f-8205-278edb8efd06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2501417b-5aea-4dde-ba0e-7f5ea174a24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-242564499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efb44a6-ef3c-4116-8bce-ea0e2973cc9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7621cba2466782139c60e8bb1fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:48Z,use_quota=True,user_id='ff6887bfc1b84fe886c109713f0032bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8d3672-9c47-4e52-a784-9b314944d8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8d3672-9c47-4e52-a784-9b314944d8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da825182-db81-49af-b959-04ddb1109dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da825182-db81-49af-b959-04ddb1109dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3efb44a6-ef3c-4116-8bce-ea0e2973cc9a', 'volume_name': 'volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d68489e-342c-40a5-bdde-a70b22b23be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d68489e-342c-40a5-bdde-a70b22b23be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768158e2-d59f-4742-804b-1614b4627e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:48 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Volume 3efb44a6-ef3c-4116-8bce-ea0e2973cc9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a', 'volume_size': 1}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:48 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-23c37459-4347-4410-85d6-cec795ecff95 tempest-CreateVolumesFromImageTest-135399835 None] Created volume successfully.
Nov 04 01:08:48 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6 1073741824" returned: 0 in 0.575s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:48 devstack sudo[102302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6
Nov 04 01:08:48 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:49 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6" returned: 0 in 0.302s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.625s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529656277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d535cff1-3c9d-440f-86d2-87dcaad01ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7621cba2466782139c60e8bb1fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:47Z,use_quota=True,user_id='ff6887bfc1b84fe886c109713f0032bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Creating volume d535cff1-3c9d-440f-86d2-87dcaad01ed2 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:49 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4893d096-971a-427f-b5f2-fe3d5031113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99b0a29-68be-42d0-9358-a5e569db9c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:49 devstack sudo[102305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2 1073741824
Nov 04 01:08:49 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:49 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Volume volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6 (751b00c1-cd3b-4c13-b412-5e680e9d03b6): created successfully
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99b0a29-68be-42d0-9358-a5e569db9c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Flow 'volume_create_manager' (2c829277-382f-4e25-a9c9-28908ad965cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:49 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-629b321b-b6e7-4422-9d5d-040b5d30c130 tempest-CreateVolumesFromImageTest-135399835 None] Created volume successfully.
Nov 04 01:08:49 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2 1073741824" returned: 0 in 0.571s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:49 devstack sudo[102311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2
Nov 04 01:08:49 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:50 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2" returned: 0 in 0.261s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1318722223',display_name='tempest-VolumesGetTest-Volume-1087088875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a127bfbc-ea6b-421d-b877-21a7593c8fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:48Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Creating volume a127bfbc-ea6b-421d-b877-21a7593c8fa9 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:50 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a106a109-c648-409e-97c6-df8fae1123b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:50 devstack sudo[102314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9 1073741824
Nov 04 01:08:50 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b195c132-d53b-40a9-b707-4157bf4ea608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:50 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Volume volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2 (d535cff1-3c9d-440f-86d2-87dcaad01ed2): created successfully
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b195c132-d53b-40a9-b707-4157bf4ea608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Flow 'volume_create_manager' (2094028f-6ca3-4269-b492-4c21f8dcf6c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:50 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e9717389-f69b-4c6f-a3ae-b3eb1ed1fd14 tempest-CreateVolumesFromImageTest-135399835 None] Created volume successfully.
Nov 04 01:08:50 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9 1073741824" returned: 0 in 0.576s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:50 devstack sudo[102321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9
Nov 04 01:08:50 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:51 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9" returned: 0 in 0.352s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.566s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-242564499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efb44a6-ef3c-4116-8bce-ea0e2973cc9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7621cba2466782139c60e8bb1fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:48Z,use_quota=True,user_id='ff6887bfc1b84fe886c109713f0032bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Creating volume 3efb44a6-ef3c-4116-8bce-ea0e2973cc9a {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:51 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:51 devstack sudo[102324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a 1073741824
Nov 04 01:08:51 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241d89ae-2968-46ae-84f5-42aa23eb0d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6132299c-3d8f-4f00-8cce-23a08e461c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:51 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Volume volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9 (a127bfbc-ea6b-421d-b877-21a7593c8fa9): created successfully
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6132299c-3d8f-4f00-8cce-23a08e461c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (c2621229-5975-4bff-91bd-c8ba59852031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:51 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-0253d4b3-5f5d-42b5-8722-32f5b17b941b tempest-VolumesGetTest-44887497 None] Created volume successfully.
Nov 04 01:08:51 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a 1073741824" returned: 0 in 0.575s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:51 devstack sudo[102330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a
Nov 04 01:08:51 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:51 devstack sudo[102332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:51 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:51 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a" returned: 0 in 0.315s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768158e2-d59f-4742-804b-1614b4627e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5109899f-d5b5-41a5-84a6-36045a7d7e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:52 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Volume volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a (3efb44a6-ef3c-4116-8bce-ea0e2973cc9a): created successfully
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5109899f-d5b5-41a5-84a6-36045a7d7e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Flow 'volume_create_manager' (136fbe6c-b39c-4ad5-8d29-f1d477421a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:52 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3f7aeb33-0a47-4f6d-b319-f8475391a09c tempest-CreateVolumesFromImageTest-135399835 None] Created volume successfully.
Nov 04 01:08:52 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.411s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-a127bfbc-ea6b-421d-b877-21a7593c8fa9-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Lock "cinder-a127bfbc-ea6b-421d-b877-21a7593c8fa9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-quobyte-a127bfbc-ea6b-421d-b877-21a7593c8fa9" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-a127bfbc-ea6b-421d-b877-21a7593c8fa9" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8cc4d1-2394-4fef-b595-a9646469275c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "cinder-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:52 devstack sudo[102337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9
Nov 04 01:08:52 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "cinder-quobyte-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-quobyte-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e7b97d-5b5b-45e8-ac93-24f2a276c9f5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:52 devstack sudo[102339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a
Nov 04 01:08:52 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:53 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9" returned: 0 in 0.550s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:53 devstack sudo[102345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9
Nov 04 01:08:53 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:53 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a" returned: 0 in 0.483s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:53 devstack sudo[102352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a
Nov 04 01:08:53 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:53 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a127bfbc-ea6b-421d-b877-21a7593c8fa9" returned: 0 in 0.325s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-a127bfbc-ea6b-421d-b877-21a7593c8fa9" released by "delete_volume" :: held 0.951s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Created reservations ['8efc3cee-7087-4c34-a77b-e9aa1345987a', '8c9b55d2-b789-429a-ae9d-25f0b0810cf2', 'cc23d5bc-23ee-4242-bedd-c28c51bb359b', '1267091f-58d0-4f4d-9650-804577b7968f'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:53 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a" returned: 0 in 0.290s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-quobyte-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a" released by "delete_volume" :: held 0.862s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:53 devstack sudo[102355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:53 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Created reservations ['e1943802-39ed-42c1-83e5-76d39593faf9', 'bdc86a2a-3b1e-4e80-aa57-93ebcc4ec918', '8597fed9-df56-4cdb-adf1-66419cf1978a', '57e9cb30-dcff-4dc3-9455-bb4a080e448e'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "cinder-d535cff1-3c9d-440f-86d2-87dcaad01ed2-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:53 devstack sudo[102357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:53 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-d535cff1-3c9d-440f-86d2-87dcaad01ed2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "cinder-quobyte-d535cff1-3c9d-440f-86d2-87dcaad01ed2" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-quobyte-d535cff1-3c9d-440f-86d2-87dcaad01ed2" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:54 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.435s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:54 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Deleted volume successfully.
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e86841d-135b-40ef-b6c0-9a02600234c8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e8dcf313-d4c7-4581-8c95-1358ccd50445 tempest-VolumesGetTest-44887497 None] Lock "cinder-a127bfbc-ea6b-421d-b877-21a7593c8fa9-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:54 devstack sudo[102360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2
Nov 04 01:08:54 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:54 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.477s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:54 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Deleted volume successfully.
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-87411104-a71a-4179-a3f3-9db227f49bd0 tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-3efb44a6-ef3c-4116-8bce-ea0e2973cc9a-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:54 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2" returned: 0 in 0.464s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:54 devstack sudo[102367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2
Nov 04 01:08:54 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Lock "cinder-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-quobyte-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[8116179e-1fd5-45bc-a9eb-ab9b5df02602]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:54 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d535cff1-3c9d-440f-86d2-87dcaad01ed2" returned: 0 in 0.392s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-quobyte-d535cff1-3c9d-440f-86d2-87dcaad01ed2" released by "delete_volume" :: held 0.936s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:55 devstack sudo[102369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8
Nov 04 01:08:55 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Created reservations ['9f995c4d-0757-447a-8b78-0b3295be82b7', 'fdcfd5d0-d03f-4ebf-9b8b-0b096803449f', '5184c602-282d-4e7e-a40b-fd52a78a1b60', '555cd293-d8d4-4053-8c5a-64a890c9a129'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:55 devstack sudo[102372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:55 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:55 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8" returned: 0 in 0.504s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:55 devstack sudo[102377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8
Nov 04 01:08:55 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:55 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.348s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Deleted volume successfully.
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc3a039e-ca9c-4cf0-878f-b64537a2074e tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-d535cff1-3c9d-440f-86d2-87dcaad01ed2-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:55 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8" returned: 0 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8" released by "delete_volume" :: held 0.898s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Created reservations ['d1df9be1-01ac-42aa-89ce-5dbd39fa6bbf', '7ea78182-7b03-4a3d-b804-a9ccaa0a9f27', '1b560bf2-85bc-4cb1-b344-37974eb02634', '23f42878-03c9-4f84-ba57-f618d0da641b'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:55 devstack sudo[102381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:55 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:56 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.292s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:56 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Deleted volume successfully.
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2e313d44-3926-478b-a613-14113bdb11bd tempest-VolumesGetTest-44887497 None] Lock "cinder-4a113e72-1ccf-4f7f-b320-f87f5f63a3b8-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "cinder-751b00c1-cd3b-4c13-b412-5e680e9d03b6-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-751b00c1-cd3b-4c13-b412-5e680e9d03b6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "cinder-quobyte-751b00c1-cd3b-4c13-b412-5e680e9d03b6" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-quobyte-751b00c1-cd3b-4c13-b412-5e680e9d03b6" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3fea4a-160f-41b7-915d-4e9fc3dfb92e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (62db903f-082d-4eb8-942c-9b23f1ed2d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58201378-5953-41c0-a5d3-20f49b02c7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58201378-5953-41c0-a5d3-20f49b02c7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1414268960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0621be5-48cc-4321-b3c4-0afc2bab06b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:56Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:56 devstack sudo[102384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6
Nov 04 01:08:56 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac47154-2ac4-414d-bbb3-a435df42715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac47154-2ac4-414d-bbb3-a435df42715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb24be73-55f2-46b0-8b62-246e87b2e761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb24be73-55f2-46b0-8b62-246e87b2e761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0621be5-48cc-4321-b3c4-0afc2bab06b4', 'volume_name': 'volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed1e1b9-c245-4837-893f-7a223007cd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed1e1b9-c245-4837-893f-7a223007cd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85d87e9-8d6f-41d2-97c5-d96f16c4f72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:56 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume a0621be5-48cc-4321-b3c4-0afc2bab06b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4', 'volume_size': 1}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1414268960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0621be5-48cc-4321-b3c4-0afc2bab06b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:08:56Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Creating volume a0621be5-48cc-4321-b3c4-0afc2bab06b4 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:08:56 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:56 devstack sudo[102386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4 1073741824
Nov 04 01:08:56 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:56 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6" returned: 0 in 0.440s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:56 devstack sudo[102393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6
Nov 04 01:08:56 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-c29800ac-82a3-4c72-880f-a965931beced-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Lock "cinder-c29800ac-82a3-4c72-880f-a965931beced-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-quobyte-c29800ac-82a3-4c72-880f-a965931beced" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:57 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-751b00c1-cd3b-4c13-b412-5e680e9d03b6" returned: 0 in 0.318s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-quobyte-751b00c1-cd3b-4c13-b412-5e680e9d03b6" released by "delete_volume" :: held 0.825s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-c29800ac-82a3-4c72-880f-a965931beced" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:57 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4 1073741824" returned: 0 in 0.644s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba97964-f41e-46c0-b2ea-326a46ead582]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:57 devstack sudo[102399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4
Nov 04 01:08:57 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Created reservations ['34b94d35-2ef8-4704-9075-cf9b30c705c1', '7d53dc16-e687-42d5-a797-3aea42676718', '06d9c032-aae9-4697-8a56-3315fa1b529b', '3f89935c-0440-490c-b15c-8f69967273e1'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:57 devstack sudo[102398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced
Nov 04 01:08:57 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:57 devstack sudo[102402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:57 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:57 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4" returned: 0 in 0.375s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:57 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85d87e9-8d6f-41d2-97c5-d96f16c4f72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8150a18b-28e3-4710-80f3-96ec0d774cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced" returned: 0 in 0.450s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:57 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4 (a0621be5-48cc-4321-b3c4-0afc2bab06b4): created successfully
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8150a18b-28e3-4710-80f3-96ec0d774cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:57 devstack sudo[102409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced
Nov 04 01:08:57 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (62db903f-082d-4eb8-942c-9b23f1ed2d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-659682fc-87d1-402c-ab7a-45d38eaa598f tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created volume successfully.
Nov 04 01:08:57 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.306s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Deleted volume successfully.
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d242f095-184e-4599-bf47-21bd6ba7eb40 tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-751b00c1-cd3b-4c13-b412-5e680e9d03b6-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:57 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c29800ac-82a3-4c72-880f-a965931beced" returned: 0 in 0.274s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-c29800ac-82a3-4c72-880f-a965931beced" released by "delete_volume" :: held 0.804s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Created reservations ['a707aee5-be38-439a-929f-735dbc41fc13', '14f5154c-e9b7-432d-b0b4-eb15718099bf', 'b14dd006-7b72-4403-9bef-afdaba07ea7d', 'c657629f-c679-4de2-87c6-ee3fe9ccd1ce'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:58 devstack sudo[102413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:08:58 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "cinder-5727f4ca-f532-4bf0-b079-5460fc908619-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-5727f4ca-f532-4bf0-b079-5460fc908619-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:58 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "cinder-quobyte-5727f4ca-f532-4bf0-b079-5460fc908619" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.565s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:08:58 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Deleted volume successfully.
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-quobyte-5727f4ca-f532-4bf0-b079-5460fc908619" acquired by "delete_volume" :: waited 0.038s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfbfeb6d-0461-4c4c-816b-9ce081c2b158 tempest-VolumesGetTest-44887497 None] Lock "cinder-c29800ac-82a3-4c72-880f-a965931beced-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e24c47-1ad4-41fc-84df-86f99306c5ba]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:08:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:58 devstack sudo[102416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619
Nov 04 01:08:58 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:59 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619" returned: 0 in 0.522s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:08:59 devstack sudo[102422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619
Nov 04 01:08:59 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (93be52aa-8143-4e79-8225-6ff4e331417e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dec6a1-8261-40d0-a104-2b92a6de50c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dec6a1-8261-40d0-a104-2b92a6de50c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1387542046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc712c1-a509-45e5-bc94-d07da0a5850f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:00Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:59 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0903a729-92c1-42f8-ba73-71f1827f9359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0903a729-92c1-42f8-ba73-71f1827f9359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786b058f-c231-45f1-9c74-78871dcece19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG cinder.image.glance [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Creating Keystone auth plugin from conf {{(pid=86660) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5727f4ca-f532-4bf0-b079-5460fc908619" returned: 0 in 0.366s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-quobyte-5727f4ca-f532-4bf0-b079-5460fc908619" released by "delete_volume" :: held 0.969s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Created reservations ['8578f82b-858e-417a-ad3b-15e07ed8e0a3', 'e0a07e32-b96f-4af4-9714-7d95fff6b8d6', '1be9b934-a6a3-4d0d-bc0c-878004e87757', '95a72b05-4030-4802-9f7a-e24713c43115'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:08:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:00 devstack sudo[102426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:00 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786b058f-c231-45f1-9c74-78871dcece19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8cc712c1-a509-45e5-bc94-d07da0a5850f', 'volume_name': 'volume-8cc712c1-a509-45e5-bc94-d07da0a5850f', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547692e40>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74758699-d9cb-4f62-9d7e-1ebb5a5e3d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74758699-d9cb-4f62-9d7e-1ebb5a5e3d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd529f12-2044-4b6a-bed8-078a5738710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:00 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Volume 8cc712c1-a509-45e5-bc94-d07da0a5850f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8cc712c1-a509-45e5-bc94-d07da0a5850f', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547692e40>}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Trying to clone 8cc712c1-a509-45e5-bc94-d07da0a5850f from image feeea883-a973-4c2d-b14e-c13d05c107a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]). {{(pid=86660) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (8aade2c3-4ff7-453b-b2ef-5e7e3a661704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:00 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94000b21-680d-4f02-adf0-679ffefd651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "cinder-b9df3d33-4cd6-423e-8c64-880b6160c57b-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.472s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94000b21-680d-4f02-adf0-679ffefd651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960049529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c540b180-c0f2-4cef-8d3f-d0c273f12f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:00Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc24158-ba24-4e2e-b320-97462eb2dc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc24158-ba24-4e2e-b320-97462eb2dc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edf9628-e5f0-491b-bbfc-36551dcc672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edf9628-e5f0-491b-bbfc-36551dcc672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c540b180-c0f2-4cef-8d3f-d0c273f12f34', 'volume_name': 'volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7174b41b-56db-403f-ba7c-4291a4794c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7174b41b-56db-403f-ba7c-4291a4794c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7e7b12-fd8f-4372-ae28-d2563573f9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:00 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume c540b180-c0f2-4cef-8d3f-d0c273f12f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34', 'volume_size': 1}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960049529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c540b180-c0f2-4cef-8d3f-d0c273f12f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:00Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Creating volume c540b180-c0f2-4cef-8d3f-d0c273f12f34 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:00 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:00 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Deleted volume successfully.
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-b9df3d33-4cd6-423e-8c64-880b6160c57b-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c649696e-37d6-4779-8f38-11fe66ddebfe tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-5727f4ca-f532-4bf0-b079-5460fc908619-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:00 devstack sudo[102431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34 1073741824
Nov 04 01:09:00 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "cinder-quobyte-b9df3d33-4cd6-423e-8c64-880b6160c57b" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-quobyte-b9df3d33-4cd6-423e-8c64-880b6160c57b" acquired by "delete_volume" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (b0412a28-2eb2-48da-84bd-6242727219b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9511ba4a-69af-4f7f-8852-4e06f9954335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe6202f-d1cc-4d46-a2c9-9aecc59e99fd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9511ba4a-69af-4f7f-8852-4e06f9954335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2114181199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3797c9-e4c0-490e-8fda-d1e3181c3cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:01Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa98fab-8d07-4420-b685-22b8ad0138ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa98fab-8d07-4420-b685-22b8ad0138ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5057d6-43f3-4c9b-ac16-aca5b295443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5057d6-43f3-4c9b-ac16-aca5b295443e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb3797c9-e4c0-490e-8fda-d1e3181c3cc5', 'volume_name': 'volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1763b5ac-04d8-40d9-979e-b17a093bb3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1763b5ac-04d8-40d9-979e-b17a093bb3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07874e3-8f62-4c18-83b5-e580e3d5e428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume bb3797c9-e4c0-490e-8fda-d1e3181c3cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5', 'volume_size': 1}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:01 devstack sudo[102434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b
Nov 04 01:09:01 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (51642e8f-cbeb-4415-a90c-d5410f18f7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add079b1-f5da-43ba-b5ce-4577910648eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (23533c15-64b4-4d4d-ba81-b1ddc480c00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1452e20a-eb21-4efb-8dd6-4c916eaa3290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add079b1-f5da-43ba-b5ce-4577910648eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1948589980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ceb3496-4c43-4fb3-9bea-1e3dc4251747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:01Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797fa61f-6d43-4757-8c21-661541de8fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797fa61f-6d43-4757-8c21-661541de8fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb77d26-cba6-43e5-9499-4b933288316d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb77d26-cba6-43e5-9499-4b933288316d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ceb3496-4c43-4fb3-9bea-1e3dc4251747', 'volume_name': 'volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02890e65-f12a-4af1-8bf2-34f9012c8867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02890e65-f12a-4af1-8bf2-34f9012c8867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f5b8d6-9b0e-46e0-ada9-608878816ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume 2ceb3496-4c43-4fb3-9bea-1e3dc4251747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747', 'volume_size': 1}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1452e20a-eb21-4efb-8dd6-4c916eaa3290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1302777469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4ec397-a6fa-423f-871f-cddda722b437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:01Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f73465-d31d-483e-a86f-378258b53491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f73465-d31d-483e-a86f-378258b53491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fbddb4-2e06-4920-92af-a28405677b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fbddb4-2e06-4920-92af-a28405677b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4ec397-a6fa-423f-871f-cddda722b437', 'volume_name': 'volume-fa4ec397-a6fa-423f-871f-cddda722b437', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ff3c8b-e4d8-4175-a8d0-43002460a0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ff3c8b-e4d8-4175-a8d0-43002460a0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720ef448-8a0a-47c2-b8b6-17e99d48be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume fa4ec397-a6fa-423f-871f-cddda722b437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4ec397-a6fa-423f-871f-cddda722b437', 'volume_size': 1}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:01 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b" returned: 0 in 0.623s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:01 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD, size 20.69 MB, duration 1.16 sec {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 01:09:01 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Image download 20.69 MB at 17.80 MB/s
Nov 04 01:09:01 devstack sudo[102444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34 1073741824" returned: 0 in 0.962s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:01 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d93296-538b-4c89-b6f6-774d0481ab48]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:01 devstack sudo[102446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34
Nov 04 01:09:01 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:01 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:01 devstack sudo[102447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD
Nov 04 01:09:01 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b9df3d33-4cd6-423e-8c64-880b6160c57b" returned: 0 in 0.472s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:01 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-quobyte-b9df3d33-4cd6-423e-8c64-880b6160c57b" released by "delete_volume" :: held 1.255s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34" returned: 0 in 0.396s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2114181199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3797c9-e4c0-490e-8fda-d1e3181c3cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:01Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Creating volume bb3797c9-e4c0-490e-8fda-d1e3181c3cc5 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:02 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:02 devstack sudo[102452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5 1073741824
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7e7b12-fd8f-4372-ae28-d2563573f9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:02 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e71a00-fac0-46a4-b22f-cd78efe329e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:02 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34 (c540b180-c0f2-4cef-8d3f-d0c273f12f34): created successfully
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e71a00-fac0-46a4-b22f-cd78efe329e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (8aade2c3-4ff7-453b-b2ef-5e7e3a661704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:02 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9200af5f-d5ea-4d72-bab6-480e261c3357 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created volume successfully.
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Created reservations ['73a7a046-c951-418e-8aec-4851cea8b253', '8f9bce0f-1255-4200-b90d-9c8c6dda1388', 'bdfd4d39-063e-4368-b1c2-cb6490282500', '77254797-6f21-4733-9ebf-1dc2d0a2eb7e'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:02 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD" returned: 0 in 0.607s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Temporary image feeea883-a973-4c2d-b14e-c13d05c107a4 is fetched for user 85153ac020c6412e91e8ff6fc4fdd657. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (6e4b2e14-1c25-40fc-aee7-fc119b626329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20c97cc-12e1-4ca2-9f43-83358dadbf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20c97cc-12e1-4ca2-9f43-83358dadbf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301013891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a39553-e341-4134-8135-e44cd9590006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:02Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06adb893-cfbb-4546-9bb4-0a3ab40742c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06adb893-cfbb-4546-9bb4-0a3ab40742c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e010980-893c-47cd-83ac-817fdf5afeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e010980-893c-47cd-83ac-817fdf5afeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a39553-e341-4134-8135-e44cd9590006', 'volume_name': 'volume-69a39553-e341-4134-8135-e44cd9590006', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1acaac-136b-48bd-b4bb-032147aad970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1acaac-136b-48bd-b4bb-032147aad970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0465b296-ec8b-4f25-9109-9b1d22b7dab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:02 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume 69a39553-e341-4134-8135-e44cd9590006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a39553-e341-4134-8135-e44cd9590006', 'volume_size': 1}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[45422e4d-3603-4abc-9352-8097b47eef83]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:02 devstack sudo[102460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:02 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:02 devstack sudo[102457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD
Nov 04 01:09:02 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:02 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.279s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:02 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Deleted volume successfully.
Nov 04 01:09:02 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5 1073741824" returned: 0 in 0.722s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-75bfa85d-3d27-4f2a-a221-c573e8b5facb tempest-CreateVolumesFromImageTest-135399835 None] Lock "cinder-b9df3d33-4cd6-423e-8c64-880b6160c57b-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:02 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:02 devstack sudo[102470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5
Nov 04 01:09:02 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:03 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5" returned: 0 in 0.264s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.728s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1948589980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ceb3496-4c43-4fb3-9bea-1e3dc4251747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:01Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Creating volume 2ceb3496-4c43-4fb3-9bea-1e3dc4251747 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:03 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07874e3-8f62-4c18-83b5-e580e3d5e428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7085d4b3-0ce5-4ba9-afe6-8c6bb2ce5e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:03 devstack sudo[102473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747 1073741824
Nov 04 01:09:03 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:03 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5 (bb3797c9-e4c0-490e-8fda-d1e3181c3cc5): created successfully
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7085d4b3-0ce5-4ba9-afe6-8c6bb2ce5e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (b0412a28-2eb2-48da-84bd-6242727219b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9a6fb8d3-b2c6-4a5d-8763-a66ad3f6004b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created volume successfully.
Nov 04 01:09:03 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747 1073741824" returned: 0 in 0.552s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:03 devstack sudo[102478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747
Nov 04 01:09:03 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:04 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747" returned: 0 in 0.438s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.669s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1302777469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4ec397-a6fa-423f-871f-cddda722b437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:01Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Creating volume fa4ec397-a6fa-423f-871f-cddda722b437 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:04 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f5b8d6-9b0e-46e0-ada9-608878816ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:04 devstack sudo[102483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437 1073741824
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a9dad9-9fff-4727-8edc-3506044bf79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:04 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:04 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747 (2ceb3496-4c43-4fb3-9bea-1e3dc4251747): created successfully
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a9dad9-9fff-4727-8edc-3506044bf79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (51642e8f-cbeb-4415-a90c-d5410f18f7f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:04 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cd5576e4-44ad-4e4b-8991-72f0b88cae85 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created volume successfully.
Nov 04 01:09:04 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437 1073741824" returned: 0 in 0.546s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:04 devstack sudo[102489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437
Nov 04 01:09:04 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:04 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437" returned: 0 in 0.256s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.635s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301013891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a39553-e341-4134-8135-e44cd9590006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceaf9cb695f4233880299ec587740ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:02Z,use_quota=True,user_id='94c91836e53e494cb5a494ddac6b525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Creating volume 69a39553-e341-4134-8135-e44cd9590006 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:05 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720ef448-8a0a-47c2-b8b6-17e99d48be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4ec397-a6fa-423f-871f-cddda722b437', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:05 devstack sudo[102492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006 1073741824
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5367f490-406a-4346-b334-02bb0a283eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:05 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:05 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume volume-fa4ec397-a6fa-423f-871f-cddda722b437 (fa4ec397-a6fa-423f-871f-cddda722b437): created successfully
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5367f490-406a-4346-b334-02bb0a283eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (23533c15-64b4-4d4d-ba81-b1ddc480c00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:05 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-66601c90-cc27-4e92-9736-b22896174ffa tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created volume successfully.
Nov 04 01:09:05 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006 1073741824" returned: 0 in 0.600s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:05 devstack sudo[102498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006
Nov 04 01:09:05 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:05 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006" returned: 0 in 0.259s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.093s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1387542046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc712c1-a509-45e5-bc94-d07da0a5850f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:00Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Creating volume 8cc712c1-a509-45e5-bc94-d07da0a5850f {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:05 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0465b296-ec8b-4f25-9109-9b1d22b7dab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a39553-e341-4134-8135-e44cd9590006', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:05 devstack sudo[102501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f 1073741824
Nov 04 01:09:05 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87ffd57-d93f-4527-b1f2-0359e379ccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:05 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Volume volume-69a39553-e341-4134-8135-e44cd9590006 (69a39553-e341-4134-8135-e44cd9590006): created successfully
Nov 04 01:09:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87ffd57-d93f-4527-b1f2-0359e379ccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Flow 'volume_create_manager' (6e4b2e14-1c25-40fc-aee7-fc119b626329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:06 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5c462558-4247-401d-bbfb-0d72063e6362 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created volume successfully.
Nov 04 01:09:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-69a39553-e341-4134-8135-e44cd9590006-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-69a39553-e341-4134-8135-e44cd9590006-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:06 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f 1073741824" returned: 0 in 0.678s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-quobyte-69a39553-e341-4134-8135-e44cd9590006" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-69a39553-e341-4134-8135-e44cd9590006" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d4a6db-1d57-43dd-8b95-3d994a7290a6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:06 devstack sudo[102507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f
Nov 04 01:09:06 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:06 devstack sudo[102508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006
Nov 04 01:09:06 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:07 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f" returned: 0 in 0.358s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Attempting download of feeea883-a973-4c2d-b14e-c13d05c107a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}])) to volume 8cc712c1-a509-45e5-bc94-d07da0a5850f. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf78125b-8766-46cd-8a25-36ccadab1ad7]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_myqtfhyp {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:07 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006" returned: 0 in 0.538s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:07 devstack sudo[102516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006
Nov 04 01:09:07 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:07 devstack sudo[102515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_myqtfhyp
Nov 04 01:09:07 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:07 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_myqtfhyp" returned: 0 in 0.445s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_myqtfhyp {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:07 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-69a39553-e341-4134-8135-e44cd9590006" returned: 0 in 0.375s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-69a39553-e341-4134-8135-e44cd9590006" released by "delete_volume" :: held 0.985s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created reservations ['d874af2d-defd-4a39-914a-f22fce3a5912', '7891a3d4-72fc-4fec-b072-26d6e57e6ca8', 'ff9703d0-1ee4-438f-8e1e-11aaadb3e7c4', '27f2d6f0-4bab-4131-883b-dece9b29ee55'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:07 devstack sudo[102522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_myqtfhyp
Nov 04 01:09:07 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Flow 'volume_create_manager' (05362ea2-526e-422e-865f-ff263099e597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694915d1-4e3d-45e4-bd88-98fd5e041e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694915d1-4e3d-45e4-bd88-98fd5e041e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1060388956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b885afd2-6d36-42a7-9df3-cc55f2f1bcbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baeb03ad0fc34603981605e7d9d2e767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:08Z,use_quota=True,user_id='9eac4639e6b54ed7921555bc3ae17824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7feefc-6f0c-45ac-9132-b62ceab9b9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7feefc-6f0c-45ac-9132-b62ceab9b9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aebefdf-7c34-4265-9aea-a75b872f543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aebefdf-7c34-4265-9aea-a75b872f543c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b885afd2-6d36-42a7-9df3-cc55f2f1bcbb', 'volume_name': 'volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6b71a8-e250-45c7-9b20-78b33d36a861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6b71a8-e250-45c7-9b20-78b33d36a861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e826a6-be54-4ba8-ab0c-f79494cebd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:07 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Volume b885afd2-6d36-42a7-9df3-cc55f2f1bcbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb', 'volume_size': 1}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1060388956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b885afd2-6d36-42a7-9df3-cc55f2f1bcbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baeb03ad0fc34603981605e7d9d2e767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:08Z,use_quota=True,user_id='9eac4639e6b54ed7921555bc3ae17824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Creating volume b885afd2-6d36-42a7-9df3-cc55f2f1bcbb {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:07 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:07 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb 1073741824
Nov 04 01:09:07 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:07 devstack sudo[102526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:07 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:08 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_myqtfhyp" returned: 1 in 0.401s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_myqtfhyp' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed2c57b-82bc-4ee3-a4ea-4844c28e9242]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:08 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:08 devstack sudo[102530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD
Nov 04 01:09:08 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.322s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:08 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Deleted volume successfully.
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7c5331b0-8bd9-49bf-862a-3e4ae885372b tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-69a39553-e341-4134-8135-e44cd9590006-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Flow 'volume_create_manager' (82bb6f94-aae5-4028-b2b5-9f7bb7811b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:08 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c49c3e9-282b-4189-90c3-270630e2e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb 1073741824" returned: 0 in 0.565s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c49c3e9-282b-4189-90c3-270630e2e70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1195014741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72d1d5a-2c7d-4e14-abc2-7e5b49f55620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be5c5a7a6394224a691774f48598fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:08Z,use_quota=True,user_id='43fb8afcebca4d70a1cdbad9c92f5b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bb99bc-4a58-42bc-bfc4-b7e7f09156ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bb99bc-4a58-42bc-bfc4-b7e7f09156ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a770806-3d21-499d-8c33-d140d2068183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a770806-3d21-499d-8c33-d140d2068183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72d1d5a-2c7d-4e14-abc2-7e5b49f55620', 'volume_name': 'volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1f9cdf-4ded-44d2-968b-fba27e923bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1f9cdf-4ded-44d2-968b-fba27e923bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdd2331-cd26-43a4-914f-ef1970852c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:08 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Volume b72d1d5a-2c7d-4e14-abc2-7e5b49f55620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620', 'volume_size': 1}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:08 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD" returned: 0 in 0.545s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] feeea883-a973-4c2d-b14e-c13d05c107a4 was qcow2, converting to qcow2 {{(pid=86660) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:08 devstack sudo[102540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb
Nov 04 01:09:08 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:08 devstack sudo[102541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f
Nov 04 01:09:08 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Flow 'volume_create_manager' (4515e6cc-2791-409a-bdf4-7794d294ee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c968cc-827b-4d73-bc43-8e7fa292ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c968cc-827b-4d73-bc43-8e7fa292ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1665028746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee328ba6-3310-42b2-a43c-02b07679e2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be5c5a7a6394224a691774f48598fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:09Z,use_quota=True,user_id='43fb8afcebca4d70a1cdbad9c92f5b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb38daa7-1bfb-41b9-a421-a8012e307011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb38daa7-1bfb-41b9-a421-a8012e307011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb14022e-b4c3-41ba-98b5-16e989c93273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb14022e-b4c3-41ba-98b5-16e989c93273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee328ba6-3310-42b2-a43c-02b07679e2d8', 'volume_name': 'volume-ee328ba6-3310-42b2-a43c-02b07679e2d8', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05969ec8-7a52-4940-b512-45c56b218ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05969ec8-7a52-4940-b512-45c56b218ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d7267b-7cd2-4b35-a68a-0b8430ee625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:08 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Volume ee328ba6-3310-42b2-a43c-02b07679e2d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee328ba6-3310-42b2-a43c-02b07679e2d8', 'volume_size': 1}
Nov 04 01:09:08 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-fa4ec397-a6fa-423f-871f-cddda722b437-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb" returned: 0 in 0.388s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1195014741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72d1d5a-2c7d-4e14-abc2-7e5b49f55620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be5c5a7a6394224a691774f48598fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:08Z,use_quota=True,user_id='43fb8afcebca4d70a1cdbad9c92f5b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Creating volume b72d1d5a-2c7d-4e14-abc2-7e5b49f55620 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:08 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-fa4ec397-a6fa-423f-871f-cddda722b437-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e826a6-be54-4ba8-ab0c-f79494cebd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d117965c-28b7-402a-95a1-77373d055d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:09 devstack sudo[102549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620 1073741824
Nov 04 01:09:09 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:09 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Volume volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb (b885afd2-6d36-42a7-9df3-cc55f2f1bcbb): created successfully
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d117965c-28b7-402a-95a1-77373d055d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Flow 'volume_create_manager' (05362ea2-526e-422e-865f-ff263099e597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-quobyte-fa4ec397-a6fa-423f-871f-cddda722b437" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:09 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fbd7df97-9d2c-44df-ad97-58e4932096c3 tempest-ProjectReaderTests-489051418 None] Created volume successfully.
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-fa4ec397-a6fa-423f-871f-cddda722b437" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2951dc-b615-4ee8-8d60-510ab66e366a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:09 devstack sudo[102551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437
Nov 04 01:09:09 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:09 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620 1073741824" returned: 0 in 0.669s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:09 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437" returned: 0 in 0.520s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:09 devstack sudo[102563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437
Nov 04 01:09:09 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:09 devstack sudo[102565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620
Nov 04 01:09:09 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:10 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-fa4ec397-a6fa-423f-871f-cddda722b437" returned: 0 in 0.387s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-fa4ec397-a6fa-423f-871f-cddda722b437" released by "delete_volume" :: held 0.986s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:10 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620" returned: 0 in 0.379s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1665028746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee328ba6-3310-42b2-a43c-02b07679e2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be5c5a7a6394224a691774f48598fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:09Z,use_quota=True,user_id='43fb8afcebca4d70a1cdbad9c92f5b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Creating volume ee328ba6-3310-42b2-a43c-02b07679e2d8 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:10 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:10 devstack sudo[102569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8 1073741824
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Acquiring lock "cinder-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:10 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdd2331-cd26-43a4-914f-ef1970852c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19c9d8f-5820-4cdf-b249-289102cd96ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Lock "cinder-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:10 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Volume volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620 (b72d1d5a-2c7d-4e14-abc2-7e5b49f55620): created successfully
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19c9d8f-5820-4cdf-b249-289102cd96ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Flow 'volume_create_manager' (82bb6f94-aae5-4028-b2b5-9f7bb7811b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created reservations ['80db8bd7-30af-45d9-bc7e-c2ebb3fb4aa0', '05f97121-ed76-4abc-9f9e-c0b986e9949b', 'b614ba11-bff6-422b-8d6c-db99b1792616', '793ec885-3fff-4408-885e-a8349cdff767'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-788a0351-a2f4-47eb-9128-26115c0b8c0c tempest-TestServerVolumeAttachmentScenario-1241984157 None] Created volume successfully.
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Acquiring lock "cinder-quobyte-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Lock "cinder-quobyte-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[232b857f-6b36-49be-81f6-01a9a2071bba]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:10 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:10 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:10 devstack sudo[102574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb
Nov 04 01:09:10 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:10 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8 1073741824" returned: 0 in 0.641s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:10 devstack sudo[102582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8
Nov 04 01:09:10 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:10 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.395s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:10 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Deleted volume successfully.
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ba44630e-1217-433d-a2cc-dec6cbb6cebc tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-fa4ec397-a6fa-423f-871f-cddda722b437-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:11 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb" returned: 0 in 0.600s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:11 devstack sudo[102590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb
Nov 04 01:09:11 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:11 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8" returned: 0 in 0.316s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d7267b-7cd2-4b35-a68a-0b8430ee625c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee328ba6-3310-42b2-a43c-02b07679e2d8', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc15de4-5985-42b3-b06e-386c691f76d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:11 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Volume volume-ee328ba6-3310-42b2-a43c-02b07679e2d8 (ee328ba6-3310-42b2-a43c-02b07679e2d8): created successfully
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc15de4-5985-42b3-b06e-386c691f76d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Flow 'volume_create_manager' (4515e6cc-2791-409a-bdf4-7794d294ee47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fa3381df-273c-4314-b50d-b3d8f5a4b52d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Created volume successfully.
Nov 04 01:09:11 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-2ceb3496-4c43-4fb3-9bea-1e3dc4251747-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f" returned: 0 in 2.727s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_vkwardvkdevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:09:11 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Converted 112.00 MB image at 41.02 MB/s
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-2ceb3496-4c43-4fb3-9bea-1e3dc4251747-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:11 devstack sudo[102592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f 1G
Nov 04 01:09:11 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-quobyte-2ceb3496-4c43-4fb3-9bea-1e3dc4251747" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-2ceb3496-4c43-4fb3-9bea-1e3dc4251747" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23a2537-83a5-48be-bb18-e19e3f728e47]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:11 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb" returned: 0 in 0.385s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Lock "cinder-quobyte-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb" released by "delete_volume" :: held 1.062s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Created reservations ['bca5c6f5-b94e-4623-90d1-1947bdf255ea', '81869081-f56d-4684-b986-f5260da6b068', 'e015965f-81d1-449b-80b4-c366c2f296a6', '9221cee0-a66a-453c-94af-312e3545bf37'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:11 devstack sudo[102595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747
Nov 04 01:09:11 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:11 devstack sudo[102600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:11 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:11 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f 1G" returned: 0 in 0.456s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Downloaded image feeea883-a973-4c2d-b14e-c13d05c107a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}])) to volume 8cc712c1-a509-45e5-bc94-d07da0a5850f successfully. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Temporary image feeea883-a973-4c2d-b14e-c13d05c107a4 for user 85153ac020c6412e91e8ff6fc4fdd657 is deleted. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Marking volume 8cc712c1-a509-45e5-bc94-d07da0a5850f as bootable. {{(pid=86660) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Copying metadata from image feeea883-a973-4c2d-b14e-c13d05c107a4 to 8cc712c1-a509-45e5-bc94-d07da0a5850f. {{(pid=86660) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Creating volume glance metadata for volume 8cc712c1-a509-45e5-bc94-d07da0a5850f backed by image feeea883-a973-4c2d-b14e-c13d05c107a4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86660) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd529f12-2044-4b6a-bed8-078a5738710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc712c1-a509-45e5-bc94-d07da0a5850f', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547692e40>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9561620-6b70-49f7-a626-003170f12e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:11 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Volume volume-8cc712c1-a509-45e5-bc94-d07da0a5850f (8cc712c1-a509-45e5-bc94-d07da0a5850f): created successfully
Nov 04 01:09:11 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9561620-6b70-49f7-a626-003170f12e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (93be52aa-8143-4e79-8225-6ff4e331417e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747" returned: 0 in 0.509s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:12 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:12 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-25d3f971-7c42-4a67-943b-499b2b762732 tempest-VolumesGetTest-44887497 None] Created volume successfully.
Nov 04 01:09:12 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747
Nov 04 01:09:12 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.337s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:12 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Deleted volume successfully.
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cf97916b-8db9-43d3-9c83-684c4b9c5284 tempest-ProjectReaderTests-489051418 None] Lock "cinder-b885afd2-6d36-42a7-9df3-cc55f2f1bcbb-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:12 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2ceb3496-4c43-4fb3-9bea-1e3dc4251747" returned: 0 in 0.261s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-2ceb3496-4c43-4fb3-9bea-1e3dc4251747" released by "delete_volume" :: held 0.825s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created reservations ['f395fba2-7b37-4120-991f-f8f993a8f204', '15ea1aa3-df45-4893-902e-4b3d16d07bd4', '566116ec-169b-4456-aea2-2d7385288f73', 'c0cb39a8-3fb5-410e-90c8-a71c35803ffa'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:12 devstack sudo[102610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:12 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-quobyte-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5" acquired by "delete_volume" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e8ece-5635-4410-b9d9-da9608e3bc2c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:12 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.345s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:12 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Deleted volume successfully.
Nov 04 01:09:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6a94aa9c-5d5e-4f6a-9ca8-b76292a574a3 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-2ceb3496-4c43-4fb3-9bea-1e3dc4251747-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:12 devstack sudo[102616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5
Nov 04 01:09:12 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:13 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5" returned: 0 in 0.563s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:13 devstack sudo[102661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5
Nov 04 01:09:13 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Flow 'volume_create_manager' (b9495016-ece9-4d0e-b37e-ffed1dc9fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4dd304-3098-4d87-9dfa-33bb58c13171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4dd304-3098-4d87-9dfa-33bb58c13171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136374415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baeb03ad0fc34603981605e7d9d2e767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:13Z,use_quota=True,user_id='9eac4639e6b54ed7921555bc3ae17824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb08cc2e-2fc5-41d2-a357-cc796bf69132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb08cc2e-2fc5-41d2-a357-cc796bf69132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea193936-a71a-4f41-99be-172bf72912f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea193936-a71a-4f41-99be-172bf72912f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4', 'volume_name': 'volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510a515e-a231-41d8-8830-8b50ed06b1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510a515e-a231-41d8-8830-8b50ed06b1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e43e85-99a8-4066-b612-46e4d906840a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:13 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Volume 98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4', 'volume_size': 1}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136374415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baeb03ad0fc34603981605e7d9d2e767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:13Z,use_quota=True,user_id='9eac4639e6b54ed7921555bc3ae17824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Creating volume 98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:13 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:13 devstack sudo[102665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4 1073741824
Nov 04 01:09:13 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:13 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5" returned: 0 in 0.556s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5" released by "delete_volume" :: held 1.218s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:13 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created reservations ['d1c571ac-151b-4ae1-a3d1-b8d4c3f052b1', 'fcd631c4-6598-4b17-9511-817096a0573a', '054eeebf-62f3-4c49-bc0d-5ae2eb21a12f', 'f075ec0c-9c79-4026-b170-f8fc30b99dc7'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (d00c22be-ec6c-4b89-b10b-b3fd3fd577ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1d1485-ad34-49bf-ac3b-0f7921719f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1d1485-ad34-49bf-ac3b-0f7921719f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-787883916',display_name='tempest-VolumesGetTest-Volume-157652341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be29488f-0c32-4bf6-9e70-bf040382f0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:14Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4124fdd1-60d0-409c-9dd8-1f667f95effa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4124fdd1-60d0-409c-9dd8-1f667f95effa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1dc370d-d803-4db6-8124-a0b74ad0746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1dc370d-d803-4db6-8124-a0b74ad0746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be29488f-0c32-4bf6-9e70-bf040382f0b2', 'volume_name': 'volume-be29488f-0c32-4bf6-9e70-bf040382f0b2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aac54e5-6f03-4135-8d8e-83f9dbfefc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aac54e5-6f03-4135-8d8e-83f9dbfefc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108cdb34-9a13-47d6-b05c-b2f80f5718ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:14 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Volume be29488f-0c32-4bf6-9e70-bf040382f0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be29488f-0c32-4bf6-9e70-bf040382f0b2', 'volume_size': 1}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:14 devstack sudo[102671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:14 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:14 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4 1073741824" returned: 0 in 0.698s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:14 devstack sudo[102673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4
Nov 04 01:09:14 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:14 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.313s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:14 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Deleted volume successfully.
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-726860cb-7b74-41d4-9f8d-c00406e282f5 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-bb3797c9-e4c0-490e-8fda-d1e3181c3cc5-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:14 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4" returned: 0 in 0.306s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-787883916',display_name='tempest-VolumesGetTest-Volume-157652341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be29488f-0c32-4bf6-9e70-bf040382f0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cab48825564e10968c18141d8606e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:14Z,use_quota=True,user_id='85153ac020c6412e91e8ff6fc4fdd657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Creating volume be29488f-0c32-4bf6-9e70-bf040382f0b2 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:14 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:14 devstack sudo[102677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2 1073741824
Nov 04 01:09:14 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e43e85-99a8-4066-b612-46e4d906840a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7907e9-8fe8-4f3a-b321-6f914a264404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:14 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Volume volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4 (98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4): created successfully
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7907e9-8fe8-4f3a-b321-6f914a264404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Flow 'volume_create_manager' (b9495016-ece9-4d0e-b37e-ffed1dc9fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:14 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4cc1a70a-5450-4142-add6-3a8da4d31a12 tempest-ProjectReaderTests-489051418 None] Created volume successfully.
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-c540b180-c0f2-4cef-8d3f-d0c273f12f34-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-c540b180-c0f2-4cef-8d3f-d0c273f12f34-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-quobyte-c540b180-c0f2-4cef-8d3f-d0c273f12f34" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-c540b180-c0f2-4cef-8d3f-d0c273f12f34" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[af11a1bc-62b6-4883-a350-ee04f6a902bf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:15 devstack sudo[102682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34
Nov 04 01:09:15 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:15 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2 1073741824" returned: 0 in 0.624s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:15 devstack sudo[102686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2
Nov 04 01:09:15 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Acquiring lock "cinder-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:15 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34" returned: 0 in 0.634s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Lock "cinder-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:15 devstack sudo[102696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34
Nov 04 01:09:15 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Acquiring lock "cinder-quobyte-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Lock "cinder-quobyte-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4" acquired by "delete_volume" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e47c6bf-5adb-4fee-a51e-434584f0508a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:15 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2" returned: 0 in 0.521s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108cdb34-9a13-47d6-b05c-b2f80f5718ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be29488f-0c32-4bf6-9e70-bf040382f0b2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19effff-7fdf-4f35-a35f-b8f253527e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:15 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Volume volume-be29488f-0c32-4bf6-9e70-bf040382f0b2 (be29488f-0c32-4bf6-9e70-bf040382f0b2): created successfully
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19effff-7fdf-4f35-a35f-b8f253527e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Flow 'volume_create_manager' (d00c22be-ec6c-4b89-b10b-b3fd3fd577ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:15 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a8124f50-5fa8-4a84-a891-7e480fd57280 tempest-VolumesGetTest-44887497 None] Created volume successfully.
Nov 04 01:09:15 devstack sudo[102705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4
Nov 04 01:09:15 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:15 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c540b180-c0f2-4cef-8d3f-d0c273f12f34" returned: 0 in 0.346s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-c540b180-c0f2-4cef-8d3f-d0c273f12f34" released by "delete_volume" :: held 1.040s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created reservations ['d76c5cf1-7206-4e28-9294-bc7582e6ca3a', 'f27eca47-50b8-41ed-83c4-cb8022187f7c', '4617183a-251f-4e93-9d1a-21195bbf01d6', '8c7d1f51-c6c3-43bd-a2a6-11d4c9e67ab8'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:16 devstack sudo[102716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:16 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:16 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4" returned: 0 in 0.584s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-be29488f-0c32-4bf6-9e70-bf040382f0b2-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:16 devstack sudo[102719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4
Nov 04 01:09:16 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Lock "cinder-be29488f-0c32-4bf6-9e70-bf040382f0b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-quobyte-be29488f-0c32-4bf6-9e70-bf040382f0b2" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-be29488f-0c32-4bf6-9e70-bf040382f0b2" acquired by "delete_volume" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[99762d88-2d7d-402d-a0af-52930aca8f3a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:16 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.417s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:16 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Deleted volume successfully.
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-06123f5a-0845-457d-838d-59a7f92b96d0 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-c540b180-c0f2-4cef-8d3f-d0c273f12f34-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:16 devstack sudo[102722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2
Nov 04 01:09:16 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:16 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4" returned: 0 in 0.422s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Lock "cinder-quobyte-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4" released by "delete_volume" :: held 1.081s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Created reservations ['263e46da-c77b-4bd1-916f-5ecd9361d9fa', '04f22e7e-930c-4647-8a32-080b838bed93', 'b8a7ce63-a965-48f0-9056-b3db7fbfba55', 'd56824ff-7638-425c-86e2-fe8d3e7120cd'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:17 devstack sudo[102725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:17 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:17 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2" returned: 0 in 0.494s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:17 devstack sudo[102730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2
Nov 04 01:09:17 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-a0621be5-48cc-4321-b3c4-0afc2bab06b4-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-a0621be5-48cc-4321-b3c4-0afc2bab06b4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "cinder-quobyte-a0621be5-48cc-4321-b3c4-0afc2bab06b4" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:17 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-a0621be5-48cc-4321-b3c4-0afc2bab06b4" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.334s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Deleted volume successfully.
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6c662b-4203-479b-9e16-9ce97fc85b0d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-294faa7f-74bc-41a7-9408-624ea177d321 tempest-ProjectReaderTests-489051418 None] Lock "cinder-98350a11-f7a4-4c7b-9c9e-d2f8ad5450c4-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:17 devstack sudo[102733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4
Nov 04 01:09:17 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:17 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-be29488f-0c32-4bf6-9e70-bf040382f0b2" returned: 0 in 0.370s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-be29488f-0c32-4bf6-9e70-bf040382f0b2" released by "delete_volume" :: held 0.953s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Created reservations ['60609533-7dc4-4cc8-8e15-74a38135ed05', '198bcafd-760e-47d3-8afa-18bfd2cd9363', 'ba5f1750-ac92-493a-861e-ff4ac1c44134', '6a1b9c2b-18cd-4848-af5b-a6c63d5b6a8f'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:17 devstack sudo[102736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:17 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:17 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4" returned: 0 in 0.462s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:17 devstack sudo[102741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4
Nov 04 01:09:17 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:18 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.350s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:18 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Deleted volume successfully.
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46647a52-8f3c-4d4e-8262-3c9711761d97 tempest-VolumesGetTest-44887497 None] Lock "cinder-be29488f-0c32-4bf6-9e70-bf040382f0b2-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:18 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a0621be5-48cc-4321-b3c4-0afc2bab06b4" returned: 0 in 0.409s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-quobyte-a0621be5-48cc-4321-b3c4-0afc2bab06b4" released by "delete_volume" :: held 0.955s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Created reservations ['1c07ae13-c1eb-4eeb-9c17-3cc7e98a5da0', 'b0324a5d-a18e-4be1-ab75-e72aae670039', '1d48b73b-0dd9-403a-bbb1-38c3b1c7b1f9', '9ddf506b-309a-43ac-9eb1-6686263b8c02'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:18 devstack sudo[102746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:18 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:18 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.440s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:18 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Deleted volume successfully.
Nov 04 01:09:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-391f9430-c6a9-46f3-91f5-c3824ee9db00 tempest-CreateVolumesFromSourceVolumeTest-951113955 None] Lock "cinder-a0621be5-48cc-4321-b3c4-0afc2bab06b4-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-8cc712c1-a509-45e5-bc94-d07da0a5850f-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Lock "cinder-8cc712c1-a509-45e5-bc94-d07da0a5850f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Acquiring lock "cinder-quobyte-8cc712c1-a509-45e5-bc94-d07da0a5850f" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-8cc712c1-a509-45e5-bc94-d07da0a5850f" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:19 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4725070f-97de-4a35-9502-31e52bba8bcf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:19 devstack sudo[102790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f
Nov 04 01:09:19 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:19 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f" returned: 0 in 0.748s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:19 devstack sudo[102821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f
Nov 04 01:09:19 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:20 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8cc712c1-a509-45e5-bc94-d07da0a5850f" returned: 0 in 0.386s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Lock "cinder-quobyte-8cc712c1-a509-45e5-bc94-d07da0a5850f" released by "delete_volume" :: held 1.226s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:20 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Created reservations ['f0b088d3-0518-437a-b937-b1cc66ac2b03', '2cb8bd9b-aef3-4a29-8411-5044000e2386', 'a8eee5e0-9e36-417f-9afb-facd051f31ad', 'a977276b-8833-49ca-bccd-426910ccd215'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:20 devstack sudo[102827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:20 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:21 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.612s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:21 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:21 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Deleted volume successfully.
Nov 04 01:09:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ec7d1e3d-1974-49c6-ac22-cbc65f9f2d28 tempest-VolumesGetTest-44887497 None] Lock "cinder-8cc712c1-a509-45e5-bc94-d07da0a5850f-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:INSERT=57,cinder:UPDATE=246,cinder:SELECT=156,cinder:DELETE=22 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=173,cinder:INSERT=70,cinder:UPDATE=243,cinder:DELETE=20 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Flow 'volume_create_manager' (2633b772-4d58-4b02-b2c6-9c5078ea3c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4351bf-7e74-461a-aa5b-11e1884df676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4351bf-7e74-461a-aa5b-11e1884df676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c95c9d-5d82-4f20-88af-8be619f5d4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf04fcd2a11442892725ac9e3b4d538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:26Z,use_quota=True,user_id='ee44be3b760b453c9002cabe5d0b61cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72403000-0c7e-4733-891f-b7f7b6958483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72403000-0c7e-4733-891f-b7f7b6958483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56daee92-e48f-40af-89b1-f436a82531c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56daee92-e48f-40af-89b1-f436a82531c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18c95c9d-5d82-4f20-88af-8be619f5d4b3', 'volume_name': 'volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608a67c2-5a9b-44c4-afc0-f82a504d2826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608a67c2-5a9b-44c4-afc0-f82a504d2826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9ce3a0-3817-43dd-b8ba-a4c08f1ddb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:25 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Volume 18c95c9d-5d82-4f20-88af-8be619f5d4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3', 'volume_size': 1}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c95c9d-5d82-4f20-88af-8be619f5d4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf04fcd2a11442892725ac9e3b4d538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:26Z,use_quota=True,user_id='ee44be3b760b453c9002cabe5d0b61cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Creating volume 18c95c9d-5d82-4f20-88af-8be619f5d4b3 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:25 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:26 devstack sudo[102843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3 1073741824
Nov 04 01:09:26 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:26 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3 1073741824" returned: 0 in 0.716s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:26 devstack sudo[102849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3
Nov 04 01:09:26 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Flow 'volume_create_manager' (9cc77e0a-8eec-4452-a512-b3c20d03d683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324a85ed-8a2c-4500-8036-fb70a3084164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324a85ed-8a2c-4500-8036-fb70a3084164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-421664400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c5eb62-b8fc-4848-90e8-5af5bdf293e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a646a6ea341492a923ab7d9793b76ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:27Z,use_quota=True,user_id='0436913aad244e3aaabea6fa8f3f2ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4da04db-4e9d-421d-a17e-223d6f8983cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4da04db-4e9d-421d-a17e-223d6f8983cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d77526-e380-45e8-abdf-9246a6ee1dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d77526-e380-45e8-abdf-9246a6ee1dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c5eb62-b8fc-4848-90e8-5af5bdf293e1', 'volume_name': 'volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:27 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6453baab-f08e-4811-9343-258fbd2aca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6453baab-f08e-4811-9343-258fbd2aca48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b71f4b-4fbe-4462-9973-c828b7e1590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:27 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Volume b1c5eb62-b8fc-4848-90e8-5af5bdf293e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1', 'volume_size': 1}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3" returned: 0 in 0.370s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-421664400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c5eb62-b8fc-4848-90e8-5af5bdf293e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a646a6ea341492a923ab7d9793b76ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:27Z,use_quota=True,user_id='0436913aad244e3aaabea6fa8f3f2ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Creating volume b1c5eb62-b8fc-4848-90e8-5af5bdf293e1 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:27 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9ce3a0-3817-43dd-b8ba-a4c08f1ddb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466ea35e-5889-4131-b781-72901ff087d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:27 devstack sudo[102852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1 1073741824
Nov 04 01:09:27 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:27 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Volume volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3 (18c95c9d-5d82-4f20-88af-8be619f5d4b3): created successfully
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466ea35e-5889-4131-b781-72901ff087d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Flow 'volume_create_manager' (2633b772-4d58-4b02-b2c6-9c5078ea3c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2113629c-b346-46bd-a1b5-86f921fca164 tempest-CinderUnicodeTest-522094650 None] Created volume successfully.
Nov 04 01:09:27 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1 1073741824" returned: 0 in 0.558s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:27 devstack sudo[102858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1
Nov 04 01:09:27 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:28 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1" returned: 0 in 0.379s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b71f4b-4fbe-4462-9973-c828b7e1590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15234e5e-b225-49c7-ad72-4bbb99dd591c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:28 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Volume volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1 (b1c5eb62-b8fc-4848-90e8-5af5bdf293e1): created successfully
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15234e5e-b225-49c7-ad72-4bbb99dd591c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Flow 'volume_create_manager' (9cc77e0a-8eec-4452-a512-b3c20d03d683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-83e6f98e-c6e4-406b-882a-84b469cc458a tempest-ProjectReaderTests-1360130106 None] Created volume successfully.
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Flow 'volume_create_manager' (2238eef2-7b4e-4a9f-99c2-8ccecfecf44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8dbaae-14fc-4ddc-a7b3-678b6322209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8dbaae-14fc-4ddc-a7b3-678b6322209f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-173841109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc60a02-d57e-413b-ad82-c6ac7de1e2f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf04fcd2a11442892725ac9e3b4d538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:29Z,use_quota=True,user_id='ee44be3b760b453c9002cabe5d0b61cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd954f1-2882-409c-893e-8809afa431ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd954f1-2882-409c-893e-8809afa431ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab6eee1-9d51-4666-9d9b-e357d27c314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab6eee1-9d51-4666-9d9b-e357d27c314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc60a02-d57e-413b-ad82-c6ac7de1e2f2', 'volume_name': 'volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c44219-fa6b-44b7-b64b-96120d40ca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c44219-fa6b-44b7-b64b-96120d40ca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4414084-4431-4125-8adf-473dabaad6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:28 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Volume 1bc60a02-d57e-413b-ad82-c6ac7de1e2f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2', 'volume_size': 1}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-173841109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc60a02-d57e-413b-ad82-c6ac7de1e2f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf04fcd2a11442892725ac9e3b4d538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:29Z,use_quota=True,user_id='ee44be3b760b453c9002cabe5d0b61cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Creating volume 1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:28 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:28 devstack sudo[102861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 1073741824
Nov 04 01:09:28 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Acquiring lock "cinder-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Lock "cinder-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Acquiring lock "cinder-quobyte-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Lock "cinder-quobyte-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1" acquired by "delete_volume" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:29 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 1073741824" returned: 0 in 0.653s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e135478-42b2-4ab5-a783-d65d720dc689]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:29 devstack sudo[102868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2
Nov 04 01:09:29 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:29 devstack sudo[102867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1
Nov 04 01:09:29 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:29 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:29 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2" returned: 0 in 0.392s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1" returned: 0 in 0.436s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4414084-4431-4125-8adf-473dabaad6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eda9452-4a8e-4b84-8a89-6065bc6f0c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:29 devstack sudo[102875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1
Nov 04 01:09:29 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:29 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Volume volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 (1bc60a02-d57e-413b-ad82-c6ac7de1e2f2): created successfully
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eda9452-4a8e-4b84-8a89-6065bc6f0c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Flow 'volume_create_manager' (2238eef2-7b4e-4a9f-99c2-8ccecfecf44e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:29 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2689e6aa-f283-4473-9474-d00e005c5b7f tempest-CinderUnicodeTest-522094650 None] Created volume successfully.
Nov 04 01:09:30 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1" returned: 0 in 0.280s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Lock "cinder-quobyte-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1" released by "delete_volume" :: held 0.782s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Created reservations ['a37c8c29-c197-4064-b8a3-533820c4a7dc', '0bc2fea8-8aa3-4d6e-9b8c-8b34e489f2b6', 'd6ff786a-c014-46ed-8644-fd9bf5f092f9', 'c3a9c6cc-ac4a-4354-b2d0-5a8b00bb9d0d'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:30 devstack sudo[102878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:30 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:30 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.385s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:30 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Deleted volume successfully.
Nov 04 01:09:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3f42d7f9-8da7-4e59-bfec-67bb50689e1c tempest-ProjectReaderTests-1360130106 None] Lock "cinder-b1c5eb62-b8fc-4848-90e8-5af5bdf293e1-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] Creating offline snapshot 949dcefd-89c1-4843-b1a9-fe4ac40c1f7e of volume 1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Flow 'volume_create_manager' (f2203360-0f22-4e0a-8806-bf81d37e74bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0484d764-bc60-42e1-87f7-fd2606a6248c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb554817-560c-43de-89df-cb55740194ab]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0484d764-bc60-42e1-87f7-fd2606a6248c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-861551637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d341074-a0ea-438d-b163-c48886ea997e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a646a6ea341492a923ab7d9793b76ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:31Z,use_quota=True,user_id='0436913aad244e3aaabea6fa8f3f2ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490154a7-5ffa-48eb-af14-e0ccd9a8e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490154a7-5ffa-48eb-af14-e0ccd9a8e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac3ed4d-8993-4813-ae97-cfadd5ca2715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac3ed4d-8993-4813-ae97-cfadd5ca2715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d341074-a0ea-438d-b163-c48886ea997e', 'volume_name': 'volume-9d341074-a0ea-438d-b163-c48886ea997e', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eec8fc1-3ef1-46f3-8e86-8093bd4dd7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eec8fc1-3ef1-46f3-8e86-8093bd4dd7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ec1de7-169a-4fd0-b8b0-e3114a74efb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:31 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Volume 9d341074-a0ea-438d-b163-c48886ea997e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d341074-a0ea-438d-b163-c48886ea997e', 'volume_size': 1}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:31 devstack sudo[102882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2
Nov 04 01:09:31 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:31 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2" returned: 0 in 0.408s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:32 devstack sudo[102887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e 1G
Nov 04 01:09:32 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:32 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e 1G" returned: 0 in 0.679s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:32 devstack sudo[102904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e
Nov 04 01:09:32 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:33 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e" returned: 0 in 0.403s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:33 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e is being set with open permissions: ugo+rw
Nov 04 01:09:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:33 devstack sudo[102921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e
Nov 04 01:09:33 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:33 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e" returned: 0 in 0.338s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:33 devstack sudo[102924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.info
Nov 04 01:09:33 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:33 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.info" returned: 0 in 0.320s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:33 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.info is being set with open permissions: ugo+rw
Nov 04 01:09:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:33 devstack sudo[102928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.info
Nov 04 01:09:33 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:34 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.info" returned: 0 in 0.351s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.528s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-861551637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d341074-a0ea-438d-b163-c48886ea997e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a646a6ea341492a923ab7d9793b76ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:31Z,use_quota=True,user_id='0436913aad244e3aaabea6fa8f3f2ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Creating volume 9d341074-a0ea-438d-b163-c48886ea997e {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:34 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:34 devstack sudo[102931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e 1073741824
Nov 04 01:09:34 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:34 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-40e96a21-173e-44b5-8e84-271a6254a0ee tempest-CinderUnicodeTest-522094650 None] Create snapshot completed successfully
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Acquiring lock "cinder-949dcefd-89c1-4843-b1a9-fe4ac40c1f7e-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Lock "cinder-949dcefd-89c1-4843-b1a9-fe4ac40c1f7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Acquiring lock "cinder-quobyte-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Lock "cinder-quobyte-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Acquiring lock "cinder-quobyte-949dcefd-89c1-4843-b1a9-fe4ac40c1f7e" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Lock "cinder-quobyte-949dcefd-89c1-4843-b1a9-fe4ac40c1f7e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Deleting offline snapshot 949dcefd-89c1-4843-b1a9-fe4ac40c1f7e of volume 1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:09:34 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] snapshot_file for this snap is: volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e 1073741824" returned: 0 in 0.613s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f19f81e-8f8c-4c4e-a948-147e0ea550cb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:34 devstack sudo[102938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e
Nov 04 01:09:34 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:34 devstack sudo[102937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e
Nov 04 01:09:34 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:35 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e" returned: 0 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ec1de7-169a-4fd0-b8b0-e3114a74efb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d341074-a0ea-438d-b163-c48886ea997e', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13703c6e-6b7a-4753-ac24-d4c9c4d4db7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:35 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Volume volume-9d341074-a0ea-438d-b163-c48886ea997e (9d341074-a0ea-438d-b163-c48886ea997e): created successfully
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13703c6e-6b7a-4753-ac24-d4c9c4d4db7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Flow 'volume_create_manager' (f2203360-0f22-4e0a-8806-bf81d37e74bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:35 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-be12ae6f-5cde-4a2f-9360-3f651578c5a9 tempest-ProjectReaderTests-1360130106 None] Created volume successfully.
Nov 04 01:09:35 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e" returned: 0 in 0.473s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9fa411-e362-4d72-932f-0957a0bf505a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:35 devstack sudo[102945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2
Nov 04 01:09:35 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:35 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2" returned: 0 in 0.445s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:35 devstack sudo[102951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e
Nov 04 01:09:35 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "cinder-9d341074-a0ea-438d-b163-c48886ea997e-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Lock "cinder-9d341074-a0ea-438d-b163-c48886ea997e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "cinder-quobyte-9d341074-a0ea-438d-b163-c48886ea997e" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Lock "cinder-quobyte-9d341074-a0ea-438d-b163-c48886ea997e" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82143e3-f9c5-4f51-96d4-50411c5f2e3e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:36 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e" returned: 0 in 0.412s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:36 devstack sudo[102956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e
Nov 04 01:09:36 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:36 devstack sudo[102958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e
Nov 04 01:09:36 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:36 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2.949dcefd-89c1-4843-b1a9-fe4ac40c1f7e" returned: 0 in 0.286s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:36 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e" returned: 0 in 0.458s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Lock "cinder-quobyte-949dcefd-89c1-4843-b1a9-fe4ac40c1f7e" released by "_delete_snapshot" :: held 1.800s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Lock "cinder-quobyte-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2" released by "delete_snapshot" :: held 1.830s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:36 devstack sudo[102965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e
Nov 04 01:09:36 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Created reservations ['289f6f80-11a8-4f05-898f-5302cb940de1', '512bfab1-f5b9-4433-a343-c42d4642ac93', '025d76a7-484f-4924-a244-8ca01123b467', 'fac5a5fb-06f8-4834-adb5-3ce2e89da6a0'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:36 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Delete snapshot completed successfully.
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-649f4e61-1089-4545-9aa3-18591aaa8530 tempest-CinderUnicodeTest-522094650 None] Lock "cinder-949dcefd-89c1-4843-b1a9-fe4ac40c1f7e-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:36 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9d341074-a0ea-438d-b163-c48886ea997e" returned: 0 in 0.321s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Lock "cinder-quobyte-9d341074-a0ea-438d-b163-c48886ea997e" released by "delete_volume" :: held 0.846s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Acquiring lock "cinder-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Lock "cinder-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Created reservations ['01f6c7d6-0116-47e3-8006-9109d6fbb8cc', '8b17a623-3650-47e8-a2ea-2e51799958fa', 'f97e0d3a-0537-4f1e-8a0a-ce5286108e1a', 'd156f2d2-3043-439b-8766-532c3d9ab034'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Acquiring lock "cinder-quobyte-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Lock "cinder-quobyte-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64dd809-0bdc-4b9f-812b-2db6359f4bd1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:37 devstack sudo[102969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:37 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:37 devstack sudo[102968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2
Nov 04 01:09:37 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:37 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.302s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:37 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Deleted volume successfully.
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6dd85bd-361e-4a50-8b73-b2d9783f3235 tempest-ProjectReaderTests-1360130106 None] Lock "cinder-9d341074-a0ea-438d-b163-c48886ea997e-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:37 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2" returned: 0 in 0.484s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:37 devstack sudo[102976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2
Nov 04 01:09:37 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:37 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2" returned: 0 in 0.290s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Lock "cinder-quobyte-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2" released by "delete_volume" :: held 0.861s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:37 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Created reservations ['5d813e1b-91e7-41aa-bd11-627acc334180', '288c752d-09d4-4e57-a74c-8b97e744e20c', '5456bc33-25d3-459e-bcd4-170ebefaad6b', 'bc290077-0a35-4429-9369-e59b8b0fa438'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:38 devstack sudo[102979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:38 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Acquiring lock "cinder-18c95c9d-5d82-4f20-88af-8be619f5d4b3-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Lock "cinder-18c95c9d-5d82-4f20-88af-8be619f5d4b3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Acquiring lock "cinder-quobyte-18c95c9d-5d82-4f20-88af-8be619f5d4b3" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Lock "cinder-quobyte-18c95c9d-5d82-4f20-88af-8be619f5d4b3" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d723d5-616a-4cf4-bd00-7fb06843b097]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:38 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.256s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:38 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Deleted volume successfully.
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-bf6db4fd-3bc7-4994-a1ad-48aa8fa5502c tempest-CinderUnicodeTest-522094650 None] Lock "cinder-1bc60a02-d57e-413b-ad82-c6ac7de1e2f2-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:38 devstack sudo[102982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3
Nov 04 01:09:38 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:38 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3" returned: 0 in 0.443s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:38 devstack sudo[102987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3
Nov 04 01:09:38 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Flow 'volume_create_manager' (d6b328f2-613d-44d4-897c-efc3e0e78cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fb876e-a339-4ff9-ab6f-50a764a17f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:39 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fb876e-a339-4ff9-ab6f-50a764a17f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1478493710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dcf998-cf36-4946-b7f6-de42b9e9567e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0fcf26b7da4b979a7509284f60c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:39Z,use_quota=True,user_id='f2009f1993e04ab795b89afd456f1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1212bd3-5aff-4a72-9a7f-03bb75064b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1212bd3-5aff-4a72-9a7f-03bb75064b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b981cfe-4506-4ec6-829f-756cff1485e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b981cfe-4506-4ec6-829f-756cff1485e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3dcf998-cf36-4946-b7f6-de42b9e9567e', 'volume_name': 'volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb051740-6aa3-470d-bc2b-3255a2da00af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb051740-6aa3-470d-bc2b-3255a2da00af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d41730-8bf5-479f-a1fb-2593acf327cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:39 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Volume b3dcf998-cf36-4946-b7f6-de42b9e9567e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e', 'volume_size': 1}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1478493710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dcf998-cf36-4946-b7f6-de42b9e9567e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0fcf26b7da4b979a7509284f60c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:39Z,use_quota=True,user_id='f2009f1993e04ab795b89afd456f1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Creating volume b3dcf998-cf36-4946-b7f6-de42b9e9567e {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:39 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-18c95c9d-5d82-4f20-88af-8be619f5d4b3" returned: 0 in 0.334s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:39 devstack sudo[102990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e 1073741824
Nov 04 01:09:39 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Lock "cinder-quobyte-18c95c9d-5d82-4f20-88af-8be619f5d4b3" released by "delete_volume" :: held 0.851s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Flow 'volume_create_manager' (7fdd7f51-b61a-4476-8383-6847ed3d359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53a37c7-2a9e-40e9-bdc5-f7c315840fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53a37c7-2a9e-40e9-bdc5-f7c315840fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236727287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90aa70c-10ca-44ee-a79f-d9bd4bda00ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a646a6ea341492a923ab7d9793b76ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:39Z,use_quota=True,user_id='0436913aad244e3aaabea6fa8f3f2ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1853beea-c618-49e3-a201-d9d8e4f07a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1853beea-c618-49e3-a201-d9d8e4f07a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632f9034-b629-443f-827f-7c8c4839933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632f9034-b629-443f-827f-7c8c4839933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b90aa70c-10ca-44ee-a79f-d9bd4bda00ed', 'volume_name': 'volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90769764-54a9-4b8d-99fd-207191da2468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90769764-54a9-4b8d-99fd-207191da2468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3920b4eb-8e20-4725-81c9-cef37ad039b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:39 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Volume b90aa70c-10ca-44ee-a79f-d9bd4bda00ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed', 'volume_size': 1}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Created reservations ['dfe72db2-35a7-4118-ac10-7e66975a3a1b', '8aebe659-a156-4ef1-8e28-dfdb3d928962', '460b528a-b090-40bb-b592-d963c7f87b6a', '6bedeacc-4663-4f76-80a0-4262b2a96715'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:39 devstack sudo[102995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:39 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:39 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e 1073741824" returned: 0 in 0.518s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:39 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.299s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:39 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Deleted volume successfully.
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e6e4c5dc-7ff1-45ab-bbaa-e0ee48a501f3 tempest-CinderUnicodeTest-522094650 None] Lock "cinder-18c95c9d-5d82-4f20-88af-8be619f5d4b3-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:39 devstack sudo[102999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e
Nov 04 01:09:39 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:39 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e" returned: 0 in 0.309s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.758s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236727287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90aa70c-10ca-44ee-a79f-d9bd4bda00ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a646a6ea341492a923ab7d9793b76ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:39Z,use_quota=True,user_id='0436913aad244e3aaabea6fa8f3f2ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Creating volume b90aa70c-10ca-44ee-a79f-d9bd4bda00ed {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:39 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d41730-8bf5-479f-a1fb-2593acf327cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:40 devstack sudo[103002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed 1073741824
Nov 04 01:09:40 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ba562c-9def-42bb-ad40-9ca5a178ea63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:40 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Volume volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e (b3dcf998-cf36-4946-b7f6-de42b9e9567e): created successfully
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ba562c-9def-42bb-ad40-9ca5a178ea63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Flow 'volume_create_manager' (d6b328f2-613d-44d4-897c-efc3e0e78cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:40 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2919564b-00c9-4656-a4fb-0490c92b09c9 tempest-VolumesSnapshotTestJSON-912620109 None] Created volume successfully.
Nov 04 01:09:40 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed 1073741824" returned: 0 in 0.576s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:40 devstack sudo[103008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed
Nov 04 01:09:40 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:40 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed" returned: 0 in 0.302s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3920b4eb-8e20-4725-81c9-cef37ad039b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d5594d-a216-4874-bee7-4d0a941f179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:40 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Volume volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed (b90aa70c-10ca-44ee-a79f-d9bd4bda00ed): created successfully
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d5594d-a216-4874-bee7-4d0a941f179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:40 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Flow 'volume_create_manager' (7fdd7f51-b61a-4476-8383-6847ed3d359f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:40 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-65a4aec6-8b9a-4f94-b871-13a92e9ff234 tempest-ProjectReaderTests-1360130106 None] Created volume successfully.
Nov 04 01:09:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:41 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] Creating offline snapshot 398f01ad-bb90-4e35-ad22-fcfbc81e2a70 of volume b3dcf998-cf36-4946-b7f6-de42b9e9567e {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:09:41 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc8baf9-59a2-40a7-b97a-bb1dafed6a28]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:41 devstack sudo[103012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e
Nov 04 01:09:41 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:41 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e" returned: 0 in 0.362s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:41 devstack sudo[103018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70 1G
Nov 04 01:09:41 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "cinder-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Lock "cinder-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "cinder-quobyte-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Lock "cinder-quobyte-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb2ee9a-0ec6-4966-b1a5-394ba360b304]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:42 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70 1G" returned: 0 in 0.441s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:42 devstack sudo[103023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed
Nov 04 01:09:42 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:42 devstack sudo[103025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70
Nov 04 01:09:42 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:42 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed" returned: 0 in 0.380s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:42 devstack sudo[103034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed
Nov 04 01:09:42 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:42 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70" returned: 0 in 0.324s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:42 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70 is being set with open permissions: ugo+rw
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:42 devstack sudo[103036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70
Nov 04 01:09:42 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:42 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed" returned: 0 in 0.256s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:42 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Lock "cinder-quobyte-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed" released by "delete_volume" :: held 0.685s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70" returned: 0 in 0.249s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:42 devstack sudo[103040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.info
Nov 04 01:09:42 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:42 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Created reservations ['4fd8c032-3093-47c6-b40f-e4846826872a', '21884936-b842-4f05-8ef3-522fe4ab820b', '95944e0f-43c9-4892-90a3-95f8b82d370f', 'c5161f08-4383-4f4e-8411-e4672281da51'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:43 devstack sudo[103042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:43 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:43 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.info" returned: 0 in 0.261s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:43 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.info is being set with open permissions: ugo+rw
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:43 devstack sudo[103045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.info
Nov 04 01:09:43 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:43 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.273s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:43 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Deleted volume successfully.
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8b300b91-ea6c-4a9e-8be3-009cdb1e91e3 tempest-ProjectReaderTests-1360130106 None] Lock "cinder-b90aa70c-10ca-44ee-a79f-d9bd4bda00ed-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:43 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.info" returned: 0 in 0.268s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:43 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5fcf3957-17bc-4777-b0d8-9e2f875c0b0d tempest-VolumesSnapshotTestJSON-912620109 None] Create snapshot completed successfully
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Flow 'volume_create_manager' (299e66ff-a1d7-44ed-87c3-d84c04402616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a599caf-4e7b-4ae7-9562-2c922da38b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a599caf-4e7b-4ae7-9562-2c922da38b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-550731799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4484961-1209-4031-b0d4-19fe86701060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a646a6ea341492a923ab7d9793b76ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:44Z,use_quota=True,user_id='0436913aad244e3aaabea6fa8f3f2ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9722c7d9-a340-43a0-ad42-6addbe33493e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9722c7d9-a340-43a0-ad42-6addbe33493e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97fc3813-7e8d-4e4d-92ad-6c9e418ec255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97fc3813-7e8d-4e4d-92ad-6c9e418ec255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4484961-1209-4031-b0d4-19fe86701060', 'volume_name': 'volume-d4484961-1209-4031-b0d4-19fe86701060', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d351fe37-9d84-442d-b7a2-bebac69e4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d351fe37-9d84-442d-b7a2-bebac69e4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e19ea8-d1be-49a9-8561-10a014864d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:43 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Volume d4484961-1209-4031-b0d4-19fe86701060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4484961-1209-4031-b0d4-19fe86701060', 'volume_size': 1}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-550731799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4484961-1209-4031-b0d4-19fe86701060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a646a6ea341492a923ab7d9793b76ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:44Z,use_quota=True,user_id='0436913aad244e3aaabea6fa8f3f2ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Creating volume d4484961-1209-4031-b0d4-19fe86701060 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:43 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:43 devstack sudo[103051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060 1073741824
Nov 04 01:09:43 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:44 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060 1073741824" returned: 0 in 0.508s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:44 devstack sudo[103057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060
Nov 04 01:09:44 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:44 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060" returned: 0 in 0.307s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e19ea8-d1be-49a9-8561-10a014864d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4484961-1209-4031-b0d4-19fe86701060', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52961f42-8104-40bb-92a7-14c81f95921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:44 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Volume volume-d4484961-1209-4031-b0d4-19fe86701060 (d4484961-1209-4031-b0d4-19fe86701060): created successfully
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52961f42-8104-40bb-92a7-14c81f95921a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Flow 'volume_create_manager' (299e66ff-a1d7-44ed-87c3-d84c04402616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-68e54aba-cbfc-4ce5-b0e4-c5ffc22fd275 tempest-ProjectReaderTests-1360130106 None] Created volume successfully.
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-398f01ad-bb90-4e35-ad22-fcfbc81e2a70-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-398f01ad-bb90-4e35-ad22-fcfbc81e2a70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-b3dcf998-cf36-4946-b7f6-de42b9e9567e" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-b3dcf998-cf36-4946-b7f6-de42b9e9567e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-398f01ad-bb90-4e35-ad22-fcfbc81e2a70" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-398f01ad-bb90-4e35-ad22-fcfbc81e2a70" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Deleting offline snapshot 398f01ad-bb90-4e35-ad22-fcfbc81e2a70 of volume b3dcf998-cf36-4946-b7f6-de42b9e9567e {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] snapshot_file for this snap is: volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ad2918-1ff8-4b37-aa0a-0a11e3896956]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:45 devstack sudo[103063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70
Nov 04 01:09:45 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-649622b8-9084-4505-ba27-30f0f6ffc303 req-5f3ad81c-3429-453a-97a7-2956b5a8cc2d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-649622b8-9084-4505-ba27-30f0f6ffc303 req-5f3ad81c-3429-453a-97a7-2956b5a8cc2d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-649622b8-9084-4505-ba27-30f0f6ffc303 req-5f3ad81c-3429-453a-97a7-2956b5a8cc2d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-649622b8-9084-4505-ba27-30f0f6ffc303 req-5f3ad81c-3429-453a-97a7-2956b5a8cc2d tempest-TestServerVolumeAttachmentScenario-1241984157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f276df48-2230-49b9-b3c8-291d6e19b806', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:09:45 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70" returned: 0 in 0.407s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:09:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-649622b8-9084-4505-ba27-30f0f6ffc303 req-5f3ad81c-3429-453a-97a7-2956b5a8cc2d tempest-TestServerVolumeAttachmentScenario-1241984157 None] attachment_update completed successfully.
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[949e9592-8a47-4169-a15e-1ec7891439e4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:45 devstack sudo[103076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e
Nov 04 01:09:45 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:45 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e" returned: 0 in 0.463s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Acquiring lock "cinder-d4484961-1209-4031-b0d4-19fe86701060-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:45 devstack sudo[103496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70
Nov 04 01:09:45 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Lock "cinder-d4484961-1209-4031-b0d4-19fe86701060-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Acquiring lock "cinder-quobyte-d4484961-1209-4031-b0d4-19fe86701060" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Lock "cinder-quobyte-d4484961-1209-4031-b0d4-19fe86701060" acquired by "delete_volume" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca15d1d8-b0cd-4003-842f-4c8f736b3faf]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:46 devstack sudo[103498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060
Nov 04 01:09:46 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:46 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70" returned: 0 in 0.479s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:46 devstack sudo[103503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70
Nov 04 01:09:46 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:46 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060" returned: 0 in 0.434s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:46 devstack sudo[103508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060
Nov 04 01:09:46 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:46 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e.398f01ad-bb90-4e35-ad22-fcfbc81e2a70" returned: 0 in 0.286s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-398f01ad-bb90-4e35-ad22-fcfbc81e2a70" released by "_delete_snapshot" :: held 1.774s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-b3dcf998-cf36-4946-b7f6-de42b9e9567e" released by "delete_snapshot" :: held 1.800s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Created reservations ['ed1c60f2-0f54-4d3d-9df7-202b7a812224', '66608a54-584d-4b22-92fe-5793ecfea7b0', '0c343542-2dd3-43ed-8e41-2d334ad89d75', '6003fc7a-9e6c-4db3-ae13-7716dbe050ba'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:46 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d4484961-1209-4031-b0d4-19fe86701060" returned: 0 in 0.280s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Lock "cinder-quobyte-d4484961-1209-4031-b0d4-19fe86701060" released by "delete_volume" :: held 0.789s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:46 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Delete snapshot completed successfully.
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e7ab2301-5f63-4020-b213-f54f7b96ceed tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-398f01ad-bb90-4e35-ad22-fcfbc81e2a70-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Created reservations ['4c5496f3-5667-4bb4-a434-4de31e03495d', 'c2c6b8c7-3174-4c7f-aebb-39d29e00d500', 'a28b17ef-dbb6-4115-ad89-45bcf43b7064', '5f9ae45d-ebab-4a79-8511-b0b2919258cb'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:47 devstack sudo[103512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:47 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:47 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.298s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Deleted volume successfully.
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a840575-327b-446f-9ad3-bf9bba991e7f tempest-ProjectReaderTests-1360130106 None] Lock "cinder-d4484961-1209-4031-b0d4-19fe86701060-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Flow 'volume_create_manager' (1ffaf047-96cc-491d-8897-75985b355668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb758824-ffef-4126-be69-a589697a879b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb758824-ffef-4126-be69-a589697a879b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2146274100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19052bcb-84fd-491b-b63d-15670cae9a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0fcf26b7da4b979a7509284f60c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:48Z,use_quota=True,user_id='f2009f1993e04ab795b89afd456f1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e21ebea-3cc3-44d2-a05f-3173968285ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e21ebea-3cc3-44d2-a05f-3173968285ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a9fdab-b430-4bf0-ae65-7d99643b2f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a9fdab-b430-4bf0-ae65-7d99643b2f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19052bcb-84fd-491b-b63d-15670cae9a18', 'volume_name': 'volume-19052bcb-84fd-491b-b63d-15670cae9a18', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bf646a-83b4-4fe0-a851-d7314ec5d5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bf646a-83b4-4fe0-a851-d7314ec5d5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8670eaf8-c465-4e71-aa2e-fe1328cae106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:47 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Volume 19052bcb-84fd-491b-b63d-15670cae9a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19052bcb-84fd-491b-b63d-15670cae9a18', 'volume_size': 1}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2146274100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19052bcb-84fd-491b-b63d-15670cae9a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0fcf26b7da4b979a7509284f60c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:48Z,use_quota=True,user_id='f2009f1993e04ab795b89afd456f1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Creating volume 19052bcb-84fd-491b-b63d-15670cae9a18 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:47 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:09:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:47 devstack sudo[103515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 1073741824
Nov 04 01:09:47 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:48 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 1073741824" returned: 0 in 0.525s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:48 devstack sudo[103521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18
Nov 04 01:09:48 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:48 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18" returned: 0 in 0.355s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:09:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8670eaf8-c465-4e71-aa2e-fe1328cae106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19052bcb-84fd-491b-b63d-15670cae9a18', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd622072-a4d1-4bdc-bacd-3e491479d61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:48 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Volume volume-19052bcb-84fd-491b-b63d-15670cae9a18 (19052bcb-84fd-491b-b63d-15670cae9a18): created successfully
Nov 04 01:09:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd622072-a4d1-4bdc-bacd-3e491479d61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Flow 'volume_create_manager' (1ffaf047-96cc-491d-8897-75985b355668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:48 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a8031677-c0a1-4303-a4b6-90eb558f4321 tempest-VolumesSnapshotTestJSON-912620109 None] Created volume successfully.
Nov 04 01:09:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] Creating offline snapshot 6d37a92a-d336-4dc0-9427-fd2991312fde of volume 19052bcb-84fd-491b-b63d-15670cae9a18 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:09:50 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[86efab52-f9cc-447a-a017-c2165116cf07]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:50 devstack sudo[103527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18
Nov 04 01:09:50 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:50 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18" returned: 0 in 0.437s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:50 devstack sudo[103532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde 1G
Nov 04 01:09:50 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:51 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde 1G" returned: 0 in 0.539s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19052bcb-84fd-491b-b63d-15670cae9a18 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:51 devstack sudo[103542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19052bcb-84fd-491b-b63d-15670cae9a18 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde
Nov 04 01:09:51 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:51 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19052bcb-84fd-491b-b63d-15670cae9a18 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde" returned: 0 in 0.432s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:51 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde is being set with open permissions: ugo+rw
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:51 devstack sudo[103555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde
Nov 04 01:09:51 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-0e526dcf-60a3-496b-b2d5-dd01653564a1 req-f0ec04f2-3341-41c6-96dd-d0a158036caa tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:51 devstack sudo[103557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:09:51 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:51 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde" returned: 0 in 0.271s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:51 devstack sudo[103560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.info
Nov 04 01:09:51 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:52 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.296s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:09:52 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.info" returned: 0 in 0.288s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:52 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.info is being set with open permissions: ugo+rw
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:52 devstack sudo[103564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.info
Nov 04 01:09:52 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:52 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.info" returned: 0 in 0.262s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-0e526dcf-60a3-496b-b2d5-dd01653564a1 req-f0ec04f2-3341-41c6-96dd-d0a158036caa tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.841s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-0e526dcf-60a3-496b-b2d5-dd01653564a1 req-f0ec04f2-3341-41c6-96dd-d0a158036caa tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:52 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-56999202-906a-49f9-92ea-f78a95fb0f0b tempest-VolumesSnapshotTestJSON-912620109 None] Create snapshot completed successfully
Nov 04 01:09:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-0e526dcf-60a3-496b-b2d5-dd01653564a1 req-f0ec04f2-3341-41c6-96dd-d0a158036caa tempest-TestServerVolumeAttachmentScenario-1241984157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-ee328ba6-3310-42b2-a43c-02b07679e2d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02a0a8bc-2565-495e-a818-53daa7c65bda', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:09:52 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-0e526dcf-60a3-496b-b2d5-dd01653564a1 req-f0ec04f2-3341-41c6-96dd-d0a158036caa tempest-TestServerVolumeAttachmentScenario-1241984157 None] attachment_update completed successfully.
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Flow 'volume_create_manager' (ac7ba0e6-d487-47a7-a97a-121ce2d2a831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a60dd87-5b5d-4a28-9363-834746f2f368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a60dd87-5b5d-4a28-9363-834746f2f368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-59831437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd67caeb-5708-4ad7-ab83-53078b6fed54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0fcf26b7da4b979a7509284f60c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:09:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6d37a92a-d336-4dc0-9427-fd2991312fde,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:09:54Z,use_quota=True,user_id='f2009f1993e04ab795b89afd456f1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f359a478-54ed-49dc-b795-6f6f373969ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f359a478-54ed-49dc-b795-6f6f373969ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a214f8-2c54-4390-997d-dacb35ae06e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a214f8-2c54-4390-997d-dacb35ae06e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bd67caeb-5708-4ad7-ab83-53078b6fed54', 'volume_name': 'volume-bd67caeb-5708-4ad7-ab83-53078b6fed54', 'volume_size': 2, 'snapshot_id': '6d37a92a-d336-4dc0-9427-fd2991312fde'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b3fa54-b421-4f61-b0ad-7aab7f57a2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b3fa54-b421-4f61-b0ad-7aab7f57a2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07dfc70b-8c78-458f-ba14-fd3f345418c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:09:53 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Volume bd67caeb-5708-4ad7-ab83-53078b6fed54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bd67caeb-5708-4ad7-ab83-53078b6fed54', 'volume_size': 2, 'snapshot_id': '6d37a92a-d336-4dc0-9427-fd2991312fde'}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-6d37a92a-d336-4dc0-9427-fd2991312fde-bd67caeb-5708-4ad7-ab83-53078b6fed54" by "_create_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-6d37a92a-d336-4dc0-9427-fd2991312fde-bd67caeb-5708-4ad7-ab83-53078b6fed54" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Creating volume bd67caeb-5708-4ad7-ab83-53078b6fed54 from snapshot 6d37a92a-d336-4dc0-9427-fd2991312fde {{(pid=86660) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-bd67caeb-5708-4ad7-ab83-53078b6fed54" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-bd67caeb-5708-4ad7-ab83-53078b6fed54" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] snapshot: 6d37a92a-d336-4dc0-9427-fd2991312fde, volume: bd67caeb-5708-4ad7-ab83-53078b6fed54,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[21236a7c-3572-43e4-ac65-8efa35a92e31]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:54 devstack sudo[103569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde
Nov 04 01:09:54 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:54 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-022d0707-d2f5-47e0-b265-3892411461df req-53b3bf2c-42cf-4c62-bf33-9433c115e757 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Terminate volume connection completed successfully.
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-022d0707-d2f5-47e0-b265-3892411461df req-53b3bf2c-42cf-4c62-bf33-9433c115e757 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Deleting attachment 02a0a8bc-2565-495e-a818-53daa7c65bda. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:09:54 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde" returned: 0 in 0.472s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19052bcb-84fd-491b-b63d-15670cae9a18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9b6a5a-4c16-4dd4-b3e3-1fad232a6fe8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:09:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:54 devstack sudo[103576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18
Nov 04 01:09:54 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:55 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root
Nov 04 01:09:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18" returned: 0 in 0.423s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:09:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 01:09:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 01:09:55 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54 not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 01:09:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:09:55 devstack sudo[103581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54
Nov 04 01:09:55 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:09:56 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-9327e06c-4345-42a6-8fa8-83608a2ce2cd req-d19124d8-99d4-4075-864a-74cbf6bdd302 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Terminate volume connection completed successfully.
Nov 04 01:09:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-9327e06c-4345-42a6-8fa8-83608a2ce2cd req-d19124d8-99d4-4075-864a-74cbf6bdd302 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Deleting attachment f276df48-2230-49b9-b3c8-291d6e19b806. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:10:03 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54" returned: 0 in 8.809s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:03 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18, size 1024.00 MB, duration 8.81 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:10:03 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Converted 1024.00 MB image at 116.22 MB/s
Nov 04 01:10:03 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54 is being set with open permissions: ugo+rw
Nov 04 01:10:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:03 devstack sudo[103650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54
Nov 04 01:10:03 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:04 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54" returned: 0 in 0.272s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-bd67caeb-5708-4ad7-ab83-53078b6fed54" released by "_copy_volume_from_snapshot" :: held 10.114s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-6d37a92a-d336-4dc0-9427-fd2991312fde-bd67caeb-5708-4ad7-ab83-53078b6fed54" released by "_create_volume_from_snapshot" :: held 10.207s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.225s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07dfc70b-8c78-458f-ba14-fd3f345418c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd67caeb-5708-4ad7-ab83-53078b6fed54', 'volume_size': 2, 'snapshot_id': '6d37a92a-d336-4dc0-9427-fd2991312fde'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdffa7f-2e22-4ed6-8e01-eb06bb58ea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:04 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Volume volume-bd67caeb-5708-4ad7-ab83-53078b6fed54 (bd67caeb-5708-4ad7-ab83-53078b6fed54): created successfully
Nov 04 01:10:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdffa7f-2e22-4ed6-8e01-eb06bb58ea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Flow 'volume_create_manager' (ac7ba0e6-d487-47a7-a97a-121ce2d2a831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:10:04 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7dc015d8-d92e-43e0-b191-5fbf5eb55699 tempest-VolumesSnapshotTestJSON-912620109 None] Created volume successfully.
Nov 04 01:10:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-bd67caeb-5708-4ad7-ab83-53078b6fed54-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-bd67caeb-5708-4ad7-ab83-53078b6fed54-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-bd67caeb-5708-4ad7-ab83-53078b6fed54" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-bd67caeb-5708-4ad7-ab83-53078b6fed54" acquired by "delete_volume" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:05 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f8f07c-75da-4613-9123-f10e803506ee]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:05 devstack sudo[103655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54
Nov 04 01:10:05 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:05 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54" returned: 0 in 0.452s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:05 devstack sudo[103660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54
Nov 04 01:10:05 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:06 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-bd67caeb-5708-4ad7-ab83-53078b6fed54" returned: 0 in 0.296s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-bd67caeb-5708-4ad7-ab83-53078b6fed54" released by "delete_volume" :: held 0.812s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "cinder-ee328ba6-3310-42b2-a43c-02b07679e2d8-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Created reservations ['ed3e4116-1050-42dd-ac67-b198b9c7a0b3', 'ec380e22-5447-4340-9b84-6872624bc791', 'bfd4ce67-825d-4ce2-ac05-1ac2b39ad30b', '676f6f8e-2de3-4c20-b423-05509c87f863'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "cinder-ee328ba6-3310-42b2-a43c-02b07679e2d8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "cinder-quobyte-ee328ba6-3310-42b2-a43c-02b07679e2d8" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "cinder-quobyte-ee328ba6-3310-42b2-a43c-02b07679e2d8" acquired by "delete_volume" :: waited 0.062s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c64b016-17e0-4b22-8f57-44b7919cc837]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:06 devstack sudo[103663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:10:06 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-6d37a92a-d336-4dc0-9427-fd2991312fde-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-6d37a92a-d336-4dc0-9427-fd2991312fde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-19052bcb-84fd-491b-b63d-15670cae9a18" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-19052bcb-84fd-491b-b63d-15670cae9a18" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-6d37a92a-d336-4dc0-9427-fd2991312fde" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-6d37a92a-d336-4dc0-9427-fd2991312fde" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Deleting offline snapshot 6d37a92a-d336-4dc0-9427-fd2991312fde of volume 19052bcb-84fd-491b-b63d-15670cae9a18 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:10:06 devstack sudo[103665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] snapshot_file for this snap is: volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:10:06 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b3cf6f-f4bc-4aca-95c4-a67fe5850c5b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:06 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.364s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:10:06 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Deleted volume successfully.
Nov 04 01:10:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-caf04884-a7ed-4ac7-ad4c-2d3affb6daa6 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-bd67caeb-5708-4ad7-ab83-53078b6fed54-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:06 devstack sudo[103668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde
Nov 04 01:10:06 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:07 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8" returned: 0 in 0.668s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:07 devstack sudo[103675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8
Nov 04 01:10:07 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:07 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde" returned: 0 in 0.512s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19052bcb-84fd-491b-b63d-15670cae9a18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d29de9-cbde-4d10-881b-f05d68ad2b83]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:07 devstack sudo[103679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18
Nov 04 01:10:07 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:07 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ee328ba6-3310-42b2-a43c-02b07679e2d8" returned: 0 in 0.385s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "cinder-quobyte-ee328ba6-3310-42b2-a43c-02b07679e2d8" released by "delete_volume" :: held 1.158s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Created reservations ['1a7d4f2a-ad52-42ef-876f-e706e97e5134', '042a56ef-9e9c-4a3a-b84b-1391bdae6b37', 'c3b13fa3-34c6-48ad-a3cb-f2064a453009', '4f08716f-a7df-41de-9f48-12be1310d36e'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:07 devstack sudo[103684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:10:07 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:08 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18" returned: 0 in 0.663s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:08 devstack sudo[103688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde
Nov 04 01:10:08 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:08 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.302s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:10:08 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Deleted volume successfully.
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8e6bab05-760f-47cb-8271-75446be2ebe8 tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "cinder-ee328ba6-3310-42b2-a43c-02b07679e2d8-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:08 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde" returned: 0 in 0.433s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:08 devstack sudo[103694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde
Nov 04 01:10:08 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "cinder-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "cinder-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "cinder-quobyte-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "cinder-quobyte-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6776b95-3403-4a1f-9c3d-222470e6d4bc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:08 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18.6d37a92a-d336-4dc0-9427-fd2991312fde" returned: 0 in 0.295s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-6d37a92a-d336-4dc0-9427-fd2991312fde" released by "_delete_snapshot" :: held 2.074s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-19052bcb-84fd-491b-b63d-15670cae9a18" released by "delete_snapshot" :: held 2.115s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:08 devstack sudo[103697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620
Nov 04 01:10:08 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Created reservations ['e5b0aa03-6f91-4ffa-9ee3-7c3996851d60', '20230a32-ffb0-4448-ab8a-652135ed84b6', 'c4cb785b-dd19-4eb8-b218-2caabfaa6c0c', '5ee0748d-5e37-4c75-ac3b-380cea643946'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:08 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Delete snapshot completed successfully.
Nov 04 01:10:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-813e0ad6-bcc1-4a78-8988-854aecc57f96 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-6d37a92a-d336-4dc0-9427-fd2991312fde-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:09 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620" returned: 0 in 0.433s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:09 devstack sudo[103702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620
Nov 04 01:10:09 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:09 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620" returned: 0 in 0.266s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "cinder-quobyte-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620" released by "delete_volume" :: held 0.758s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Created reservations ['d8a81fa4-92b7-4e43-b86d-ad91a531b45f', '80473687-6307-4de5-81a2-e1c40242df6f', 'a4c62ec7-0389-44d4-82fa-262ca7351d9a', '522314a8-0893-418e-a63c-0e9d20dd571e'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:09 devstack sudo[103705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:10:09 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:09 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.346s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:10:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-19052bcb-84fd-491b-b63d-15670cae9a18-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Deleted volume successfully.
Nov 04 01:10:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-19052bcb-84fd-491b-b63d-15670cae9a18-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-699833dd-5f6a-42dc-9f17-0072456b421a tempest-TestServerVolumeAttachmentScenario-1241984157 None] Lock "cinder-b72d1d5a-2c7d-4e14-abc2-7e5b49f55620-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-19052bcb-84fd-491b-b63d-15670cae9a18" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-19052bcb-84fd-491b-b63d-15670cae9a18" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:10 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d85dcae-049d-48a6-8435-ed9dbe718766]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:10 devstack sudo[103708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18
Nov 04 01:10:10 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:10 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18" returned: 0 in 0.414s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:10 devstack sudo[103713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18
Nov 04 01:10:10 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:10 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-19052bcb-84fd-491b-b63d-15670cae9a18" returned: 0 in 0.292s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-19052bcb-84fd-491b-b63d-15670cae9a18" released by "delete_volume" :: held 0.794s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:10 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Created reservations ['16b2c833-4b42-4eb4-aee6-583a4b6e681b', 'ce2800a6-1472-4760-8853-c89fa7d81776', '0b5838e5-1061-4716-b07f-9c436b6f9e7b', 'dd59f0b1-d8eb-4482-9b17-093358019cc5'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:11 devstack sudo[103717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:10:11 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:11 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.392s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:11 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:10:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Deleted volume successfully.
Nov 04 01:10:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c2f60e6b-b306-434a-a238-98c3ef8beeb4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-19052bcb-84fd-491b-b63d-15670cae9a18-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Flow 'volume_create_manager' (7993d02d-8b41-4d73-9452-d6ba00a581d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1641db-258f-4f45-886d-f85e9609484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1641db-258f-4f45-886d-f85e9609484d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2078923284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9562b27f-29de-42b1-9bb2-bdb9cfe32d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0fcf26b7da4b979a7509284f60c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:10:12Z,use_quota=True,user_id='f2009f1993e04ab795b89afd456f1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4080285e-60f7-4f82-9217-b4a7bed74305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4080285e-60f7-4f82-9217-b4a7bed74305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ac56fb-21c5-44fb-ad25-f83d160bdd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ac56fb-21c5-44fb-ad25-f83d160bdd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9562b27f-29de-42b1-9bb2-bdb9cfe32d94', 'volume_name': 'volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6be04f-6bdd-44e3-bdd5-9011b40fd137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6be04f-6bdd-44e3-bdd5-9011b40fd137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab8eb98-401e-493a-b3dc-fb6616de4010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:12 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Volume 9562b27f-29de-42b1-9bb2-bdb9cfe32d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94', 'volume_size': 1}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2078923284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9562b27f-29de-42b1-9bb2-bdb9cfe32d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0fcf26b7da4b979a7509284f60c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:10:12Z,use_quota=True,user_id='f2009f1993e04ab795b89afd456f1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Creating volume 9562b27f-29de-42b1-9bb2-bdb9cfe32d94 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:10:12 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:12 devstack sudo[103721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 1073741824
Nov 04 01:10:12 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:12 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 1073741824" returned: 0 in 0.527s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:12 devstack sudo[103727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94
Nov 04 01:10:12 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:13 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" returned: 0 in 0.458s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:10:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab8eb98-401e-493a-b3dc-fb6616de4010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e262bdc-327b-460f-9856-f1a86e90a3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:13 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Volume volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 (9562b27f-29de-42b1-9bb2-bdb9cfe32d94): created successfully
Nov 04 01:10:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e262bdc-327b-460f-9856-f1a86e90a3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Flow 'volume_create_manager' (7993d02d-8b41-4d73-9452-d6ba00a581d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:10:13 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7c63befe-e11e-4585-ad95-78fdc3e90ca2 tempest-VolumesSnapshotTestJSON-912620109 None] Created volume successfully.
Nov 04 01:10:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] Creating offline snapshot 2e913ca5-8538-48d3-880f-0fdc6fe99566 of volume 9562b27f-29de-42b1-9bb2-bdb9cfe32d94 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:10:14 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f3cfab-b7de-4542-b7a0-e3b2885b3053]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:14 devstack sudo[103772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94
Nov 04 01:10:14 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:15 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" returned: 0 in 0.439s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:15 devstack sudo[103777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566 1G
Nov 04 01:10:15 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:15 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566 1G" returned: 0 in 0.589s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:15 devstack sudo[103783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566
Nov 04 01:10:15 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:15 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566" returned: 0 in 0.355s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:15 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566 is being set with open permissions: ugo+rw
Nov 04 01:10:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:16 devstack sudo[103788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566
Nov 04 01:10:16 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:16 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566" returned: 0 in 0.339s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:16 devstack sudo[103791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.info
Nov 04 01:10:16 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:16 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.info" returned: 0 in 0.332s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:16 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.info is being set with open permissions: ugo+rw
Nov 04 01:10:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:16 devstack sudo[103794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.info
Nov 04 01:10:16 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:16 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.info" returned: 0 in 0.297s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-14666066-bc4b-42b7-905a-297fc6d33fc9 tempest-VolumesSnapshotTestJSON-912620109 None] Create snapshot completed successfully
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Flow 'volume_create_manager' (edafaa7e-5d20-47ca-b3f9-56a55433541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc61dcd9-3f13-4b06-9e0e-29ab6e257a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc61dcd9-3f13-4b06-9e0e-29ab6e257a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-727296254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468297a4-ffd9-42bc-9b74-cfb5733949ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e0fcf26b7da4b979a7509284f60c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2e913ca5-8538-48d3-880f-0fdc6fe99566,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:10:18Z,use_quota=True,user_id='f2009f1993e04ab795b89afd456f1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fc3aa6-fc22-4ee4-8066-2d3018b9fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fc3aa6-fc22-4ee4-8066-2d3018b9fb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b5e086-fc8e-4184-992a-4e9f57291fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b5e086-fc8e-4184-992a-4e9f57291fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '468297a4-ffd9-42bc-9b74-cfb5733949ae', 'volume_name': 'volume-468297a4-ffd9-42bc-9b74-cfb5733949ae', 'volume_size': 1, 'snapshot_id': '2e913ca5-8538-48d3-880f-0fdc6fe99566'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8250b885-67cc-40e1-87c8-2bf4b9c1384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8250b885-67cc-40e1-87c8-2bf4b9c1384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea03d92f-2161-496a-8a40-614a7d528999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:18 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Volume 468297a4-ffd9-42bc-9b74-cfb5733949ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-468297a4-ffd9-42bc-9b74-cfb5733949ae', 'volume_size': 1, 'snapshot_id': '2e913ca5-8538-48d3-880f-0fdc6fe99566'}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-2e913ca5-8538-48d3-880f-0fdc6fe99566-468297a4-ffd9-42bc-9b74-cfb5733949ae" by "_create_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-2e913ca5-8538-48d3-880f-0fdc6fe99566-468297a4-ffd9-42bc-9b74-cfb5733949ae" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Creating volume 468297a4-ffd9-42bc-9b74-cfb5733949ae from snapshot 2e913ca5-8538-48d3-880f-0fdc6fe99566 {{(pid=86660) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-468297a4-ffd9-42bc-9b74-cfb5733949ae" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-468297a4-ffd9-42bc-9b74-cfb5733949ae" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] snapshot: 2e913ca5-8538-48d3-880f-0fdc6fe99566, volume: 468297a4-ffd9-42bc-9b74-cfb5733949ae,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb8ca77-3071-40c1-a2d2-ce9d49e6b99f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:18 devstack sudo[103798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566
Nov 04 01:10:18 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:18 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566" returned: 0 in 0.442s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a097cd2-cb85-4dfe-b303-8eb6393256bd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:19 devstack sudo[103803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94
Nov 04 01:10:19 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:19 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" returned: 0 in 0.453s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 01:10:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 01:10:19 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 01:10:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:19 devstack sudo[103808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae
Nov 04 01:10:19 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Flow 'volume_create_manager' (2c9a3512-a8cf-4e36-91bf-9599f34fdeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a0a3b7-b0a3-40f1-8ec9-d748d297ff8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a0a3b7-b0a3-40f1-8ec9-d748d297ff8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-538140319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1585ef3-a154-435d-9cd3-f7b41db97a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7d481da1f84d759902eac841db15d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:10:23Z,use_quota=True,user_id='b7d33d8cfda546e4b069be66cdb28e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ca4d45-2d67-4a7c-9a8f-3d7877f67df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ca4d45-2d67-4a7c-9a8f-3d7877f67df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f1d3ee-7062-4ab9-9485-af585c3606a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f1d3ee-7062-4ab9-9485-af585c3606a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1585ef3-a154-435d-9cd3-f7b41db97a57', 'volume_name': 'volume-c1585ef3-a154-435d-9cd3-f7b41db97a57', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e49bb6-77b1-4902-99fd-fa08c19e0b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e49bb6-77b1-4902-99fd-fa08c19e0b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f3869a-ac11-4b04-995c-a84cbd58b362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:23 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Volume c1585ef3-a154-435d-9cd3-f7b41db97a57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1585ef3-a154-435d-9cd3-f7b41db97a57', 'volume_size': 1}
Nov 04 01:10:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:27 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae" returned: 0 in 8.035s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94, size 1024.00 MB, duration 8.04 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:10:27 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Converted 1024.00 MB image at 127.43 MB/s
Nov 04 01:10:27 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae is being set with open permissions: ugo+rw
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:27 devstack sudo[103825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae
Nov 04 01:10:27 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:27 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae" returned: 0 in 0.243s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-468297a4-ffd9-42bc-9b74-cfb5733949ae" released by "_copy_volume_from_snapshot" :: held 9.292s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=140,cinder:INSERT=33,cinder:SELECT=126,cinder:DELETE=10 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=127,cinder:UPDATE=135,cinder:DELETE=14,cinder:INSERT=33 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-2e913ca5-8538-48d3-880f-0fdc6fe99566-468297a4-ffd9-42bc-9b74-cfb5733949ae" released by "_create_volume_from_snapshot" :: held 9.371s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.390s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.045s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-538140319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1585ef3-a154-435d-9cd3-f7b41db97a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7d481da1f84d759902eac841db15d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:10:23Z,use_quota=True,user_id='b7d33d8cfda546e4b069be66cdb28e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Creating volume c1585ef3-a154-435d-9cd3-f7b41db97a57 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:10:27 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:27 devstack sudo[103828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 1073741824
Nov 04 01:10:27 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea03d92f-2161-496a-8a40-614a7d528999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468297a4-ffd9-42bc-9b74-cfb5733949ae', 'volume_size': 1, 'snapshot_id': '2e913ca5-8538-48d3-880f-0fdc6fe99566'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18bdd91-b0a8-4721-b978-a598bfab829c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:27 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Volume volume-468297a4-ffd9-42bc-9b74-cfb5733949ae (468297a4-ffd9-42bc-9b74-cfb5733949ae): created successfully
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18bdd91-b0a8-4721-b978-a598bfab829c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Flow 'volume_create_manager' (edafaa7e-5d20-47ca-b3f9-56a55433541a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:10:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-0c9136b0-a72f-4513-8793-0eb95b7e5bcd tempest-VolumesSnapshotTestJSON-912620109 None] Created volume successfully.
Nov 04 01:10:28 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 1073741824" returned: 0 in 0.464s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:28 devstack sudo[103834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57
Nov 04 01:10:28 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-468297a4-ffd9-42bc-9b74-cfb5733949ae-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-468297a4-ffd9-42bc-9b74-cfb5733949ae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-468297a4-ffd9-42bc-9b74-cfb5733949ae" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-468297a4-ffd9-42bc-9b74-cfb5733949ae" acquired by "delete_volume" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e0f27b-0c7e-4dd9-8e20-96c57a2993b0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:28 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57" returned: 0 in 0.289s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f3869a-ac11-4b04-995c-a84cbd58b362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1585ef3-a154-435d-9cd3-f7b41db97a57', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80bb8fe-76ed-4923-a379-0393aabe63fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:28 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Volume volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 (c1585ef3-a154-435d-9cd3-f7b41db97a57): created successfully
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80bb8fe-76ed-4923-a379-0393aabe63fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Flow 'volume_create_manager' (2c9a3512-a8cf-4e36-91bf-9599f34fdeb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:10:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9b85617c-7d6d-4ee3-aea6-3b53a0ee0a2d tempest-SnapshotDependencyTests-1767087560 None] Created volume successfully.
Nov 04 01:10:28 devstack sudo[103837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae
Nov 04 01:10:28 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:28 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae" returned: 0 in 0.427s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:29 devstack sudo[103842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae
Nov 04 01:10:29 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] Creating offline snapshot 32d01b78-a0a9-4a7e-9068-77c1fe8f1922 of volume c1585ef3-a154-435d-9cd3-f7b41db97a57 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef60b76-e548-40e4-83d9-b77fdc13cb19]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:29 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-468297a4-ffd9-42bc-9b74-cfb5733949ae" returned: 0 in 0.308s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-468297a4-ffd9-42bc-9b74-cfb5733949ae" released by "delete_volume" :: held 0.788s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:29 devstack sudo[103844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57
Nov 04 01:10:29 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Created reservations ['57fefe1f-3a57-4579-9391-31de42faa773', 'd3a5b714-0cbb-4628-b0b8-d3d2d500b811', 'f3ec5151-3e58-4c09-af88-bfe95064e022', '21abeda4-adf9-4415-962f-3943c58e8abf'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:29 devstack sudo[103847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:10:29 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:29 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57" returned: 0 in 0.447s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:29 devstack sudo[103852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922 1G
Nov 04 01:10:29 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-2e913ca5-8538-48d3-880f-0fdc6fe99566-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-2e913ca5-8538-48d3-880f-0fdc6fe99566-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-2e913ca5-8538-48d3-880f-0fdc6fe99566" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-2e913ca5-8538-48d3-880f-0fdc6fe99566" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Deleting offline snapshot 2e913ca5-8538-48d3-880f-0fdc6fe99566 of volume 9562b27f-29de-42b1-9bb2-bdb9cfe32d94 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] snapshot_file for this snap is: volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e30d0b-a1fc-49b5-b775-b3b12a5960ea]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:29 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.370s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:10:29 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Deleted volume successfully.
Nov 04 01:10:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a1fa261d-08c0-4b0c-9a88-a8eb3e99402e tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-468297a4-ffd9-42bc-9b74-cfb5733949ae-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:30 devstack sudo[103855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566
Nov 04 01:10:30 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:30 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922 1G" returned: 0 in 0.591s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:30 devstack sudo[103864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922
Nov 04 01:10:30 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:30 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566" returned: 0 in 0.482s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3caa30-e8ad-4d1f-a29b-277810b0734e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:30 devstack sudo[103866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94
Nov 04 01:10:30 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:30 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922" returned: 0 in 0.349s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:30 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922 is being set with open permissions: ugo+rw
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:30 devstack sudo[103871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922
Nov 04 01:10:30 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:30 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922" returned: 0 in 0.281s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:30 devstack sudo[103878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.info
Nov 04 01:10:30 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:30 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" returned: 0 in 0.621s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:31 devstack sudo[103880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566
Nov 04 01:10:31 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:31 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.info" returned: 0 in 0.337s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:31 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.info is being set with open permissions: ugo+rw
Nov 04 01:10:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:31 devstack sudo[103885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.info
Nov 04 01:10:31 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:31 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566" returned: 0 in 0.420s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:31 devstack sudo[103889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566
Nov 04 01:10:31 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:31 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.info" returned: 0 in 0.284s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:31 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a68e7f2e-db9d-444b-b9de-3a18251a0521 tempest-SnapshotDependencyTests-1767087560 None] Create snapshot completed successfully
Nov 04 01:10:31 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94.2e913ca5-8538-48d3-880f-0fdc6fe99566" returned: 0 in 0.272s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-2e913ca5-8538-48d3-880f-0fdc6fe99566" released by "_delete_snapshot" :: held 1.911s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" released by "delete_snapshot" :: held 1.941s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:31 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Created reservations ['192161cb-9e24-4ff1-bfe4-ae584f68cd9b', 'fc8203c7-95df-41dd-bb83-e8acc5b687d8', 'e8cbc1c7-d06c-4d95-be40-2b82d2ba68c1', 'b4ec180c-6647-442b-8eff-68f746d8f2a8'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:31 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Delete snapshot completed successfully.
Nov 04 01:10:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d527c48-a474-4991-a927-5c0acb1c28f4 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-2e913ca5-8538-48d3-880f-0fdc6fe99566-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-9562b27f-29de-42b1-9bb2-bdb9cfe32d94-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-9562b27f-29de-42b1-9bb2-bdb9cfe32d94-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:32 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c35b83-c3d3-4cc8-a8ef-0a66e6dad839]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:32 devstack sudo[103893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94
Nov 04 01:10:32 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:32 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" returned: 0 in 0.535s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:32 devstack sudo[103899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94
Nov 04 01:10:32 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:32 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" returned: 0 in 0.297s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-9562b27f-29de-42b1-9bb2-bdb9cfe32d94" released by "delete_volume" :: held 0.926s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Created reservations ['00bbb003-9b9d-4e07-a2e0-bdfccfaf9bcf', '7d7dfc06-21c6-4f76-88b8-cf410f4886f5', '3940785f-15c6-44ed-9e89-55a7c1be0cc2', '72042167-b3ed-4d16-b004-0b7ade7678f5'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:33 devstack sudo[103902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:10:33 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Flow 'volume_create_manager' (7991cc8b-cb14-4fe7-b2e9-39b6468d2581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf7f681-26f0-4e69-adab-2921938ebc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf7f681-26f0-4e69-adab-2921938ebc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be511c7-701f-47b3-93bf-59cf2bffefc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7d481da1f84d759902eac841db15d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=32d01b78-a0a9-4a7e-9068-77c1fe8f1922,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:10:33Z,use_quota=True,user_id='b7d33d8cfda546e4b069be66cdb28e55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee1aeef-ff68-40ae-a785-6b50d377ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee1aeef-ff68-40ae-a785-6b50d377ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249c1446-e091-4878-87d3-10cb2fba47e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249c1446-e091-4878-87d3-10cb2fba47e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3be511c7-701f-47b3-93bf-59cf2bffefc3', 'volume_name': 'volume-3be511c7-701f-47b3-93bf-59cf2bffefc3', 'volume_size': 1, 'snapshot_id': '32d01b78-a0a9-4a7e-9068-77c1fe8f1922'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2292be-35bf-4c7a-8bc5-1b3f5c9804cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2292be-35bf-4c7a-8bc5-1b3f5c9804cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6432735-da4a-4a59-b7b6-6993cfade445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:33 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Volume 3be511c7-701f-47b3-93bf-59cf2bffefc3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3be511c7-701f-47b3-93bf-59cf2bffefc3', 'volume_size': 1, 'snapshot_id': '32d01b78-a0a9-4a7e-9068-77c1fe8f1922'}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-b3dcf998-cf36-4946-b7f6-de42b9e9567e-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "cinder-quobyte-32d01b78-a0a9-4a7e-9068-77c1fe8f1922-3be511c7-701f-47b3-93bf-59cf2bffefc3" by "_create_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-b3dcf998-cf36-4946-b7f6-de42b9e9567e-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-32d01b78-a0a9-4a7e-9068-77c1fe8f1922-3be511c7-701f-47b3-93bf-59cf2bffefc3" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Creating volume 3be511c7-701f-47b3-93bf-59cf2bffefc3 from snapshot 32d01b78-a0a9-4a7e-9068-77c1fe8f1922 {{(pid=86660) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "cinder-quobyte-3be511c7-701f-47b3-93bf-59cf2bffefc3" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:33 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.337s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-3be511c7-701f-47b3-93bf-59cf2bffefc3" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] snapshot: 32d01b78-a0a9-4a7e-9068-77c1fe8f1922, volume: 3be511c7-701f-47b3-93bf-59cf2bffefc3,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 01:10:33 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Deleted volume successfully.
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "cinder-quobyte-b3dcf998-cf36-4946-b7f6-de42b9e9567e" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-78c90781-2807-42a1-b6a7-a9ed42a1f4f3 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-9562b27f-29de-42b1-9bb2-bdb9cfe32d94-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6951c1-fced-493e-ae78-b0427cd7fa10]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-b3dcf998-cf36-4946-b7f6-de42b9e9567e" acquired by "delete_volume" :: waited 0.065s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[368e5d40-a04b-45e2-9f55-c94bc2512c2c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:33 devstack sudo[103906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922
Nov 04 01:10:33 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:33 devstack sudo[103907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e
Nov 04 01:10:33 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:34 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922" returned: 0 in 0.505s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1585ef3-a154-435d-9cd3-f7b41db97a57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ccdeee-ffa8-423b-9bde-272c81d21ec9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:34 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e" returned: 0 in 0.476s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:34 devstack sudo[103917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e
Nov 04 01:10:34 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:34 devstack sudo[103916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57
Nov 04 01:10:34 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:34 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b3dcf998-cf36-4946-b7f6-de42b9e9567e" returned: 0 in 0.332s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-quobyte-b3dcf998-cf36-4946-b7f6-de42b9e9567e" released by "delete_volume" :: held 0.898s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Created reservations ['48b5fe61-3c44-4653-80be-bbe1dbdb9fd7', '61ab4003-5de3-485a-a53b-d0e9942fcf59', 'c7463010-4fbb-4016-8a89-4eda8398450f', 'cc49427c-dcb1-4e07-9edc-c093296c308f'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:34 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57" returned: 0 in 0.449s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3 not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:34 devstack sudo[103924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3
Nov 04 01:10:34 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:34 devstack sudo[103926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:10:34 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:34 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.262s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:10:34 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Deleted volume successfully.
Nov 04 01:10:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3e60a22-6847-44e0-be5f-eddd76b686b9 tempest-VolumesSnapshotTestJSON-912620109 None] Lock "cinder-b3dcf998-cf36-4946-b7f6-de42b9e9567e-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:42 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3" returned: 0 in 8.126s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:42 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57, size 1024.00 MB, duration 8.13 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:10:42 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Converted 1024.00 MB image at 126.00 MB/s
Nov 04 01:10:42 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3 is being set with open permissions: ugo+rw
Nov 04 01:10:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:42 devstack sudo[103942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3
Nov 04 01:10:42 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:43 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3" returned: 0 in 0.304s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-3be511c7-701f-47b3-93bf-59cf2bffefc3" released by "_copy_volume_from_snapshot" :: held 9.509s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-32d01b78-a0a9-4a7e-9068-77c1fe8f1922-3be511c7-701f-47b3-93bf-59cf2bffefc3" released by "_create_volume_from_snapshot" :: held 9.596s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.621s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6432735-da4a-4a59-b7b6-6993cfade445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be511c7-701f-47b3-93bf-59cf2bffefc3', 'volume_size': 1, 'snapshot_id': '32d01b78-a0a9-4a7e-9068-77c1fe8f1922'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcb3d47-8565-475b-87eb-0854ad398713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:43 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Volume volume-3be511c7-701f-47b3-93bf-59cf2bffefc3 (3be511c7-701f-47b3-93bf-59cf2bffefc3): created successfully
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcb3d47-8565-475b-87eb-0854ad398713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Flow 'volume_create_manager' (7991cc8b-cb14-4fe7-b2e9-39b6468d2581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:10:43 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2b0fb1f8-4e13-4945-bd10-6a3cbfffe466 tempest-SnapshotDependencyTests-1767087560 None] Created volume successfully.
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "cinder-32d01b78-a0a9-4a7e-9068-77c1fe8f1922-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-32d01b78-a0a9-4a7e-9068-77c1fe8f1922-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "cinder-quobyte-c1585ef3-a154-435d-9cd3-f7b41db97a57" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-c1585ef3-a154-435d-9cd3-f7b41db97a57" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "cinder-quobyte-32d01b78-a0a9-4a7e-9068-77c1fe8f1922" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-32d01b78-a0a9-4a7e-9068-77c1fe8f1922" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Deleting offline snapshot 32d01b78-a0a9-4a7e-9068-77c1fe8f1922 of volume c1585ef3-a154-435d-9cd3-f7b41db97a57 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] snapshot_file for this snap is: volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb6de0b-3258-41aa-b171-e5b12c51ed90]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:43 devstack sudo[103945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922
Nov 04 01:10:43 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:44 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922" returned: 0 in 0.446s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1585ef3-a154-435d-9cd3-f7b41db97a57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:10:44 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aa5e48-bb68-4dde-9f91-4d81878baff3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:44 devstack sudo[103951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57
Nov 04 01:10:44 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:44 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57" returned: 0 in 0.672s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:44 devstack sudo[103956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922
Nov 04 01:10:44 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:45 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922" returned: 0 in 0.427s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:45 devstack sudo[103961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922
Nov 04 01:10:45 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:45 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57.32d01b78-a0a9-4a7e-9068-77c1fe8f1922" returned: 0 in 0.365s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-32d01b78-a0a9-4a7e-9068-77c1fe8f1922" released by "_delete_snapshot" :: held 2.059s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-c1585ef3-a154-435d-9cd3-f7b41db97a57" released by "delete_snapshot" :: held 2.099s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:45 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Created reservations ['69a6a51b-9ff5-47d1-bd93-8061d4c0e7a5', '7d38c920-3a7a-4396-be45-f35caa35d4f4', 'bf31985f-d016-40ee-a321-35527dd95846', '9c1251ce-a2e3-483f-90c3-df4e7bd242d2'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:45 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Delete snapshot completed successfully.
Nov 04 01:10:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ae599339-8659-4253-887f-93820b16b6c0 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-32d01b78-a0a9-4a7e-9068-77c1fe8f1922-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "cinder-c1585ef3-a154-435d-9cd3-f7b41db97a57-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-c1585ef3-a154-435d-9cd3-f7b41db97a57-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "cinder-quobyte-c1585ef3-a154-435d-9cd3-f7b41db97a57" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-c1585ef3-a154-435d-9cd3-f7b41db97a57" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:46 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b5b5c7-6533-409e-822e-e22318ac4102]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:47 devstack sudo[103964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57
Nov 04 01:10:47 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:47 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57" returned: 0 in 0.413s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:47 devstack sudo[103969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57
Nov 04 01:10:47 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:47 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c1585ef3-a154-435d-9cd3-f7b41db97a57" returned: 0 in 0.283s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-c1585ef3-a154-435d-9cd3-f7b41db97a57" released by "delete_volume" :: held 0.777s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Flow 'volume_create_manager' (2307e678-5570-4d86-be29-9fab0e69eee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c71244-b4bc-40f5-a7a0-fa8d966c76c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c71244-b4bc-40f5-a7a0-fa8d966c76c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-957881906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcfdc91-eab5-4029-9d94-9d8ea99f51c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d4c664aa16459283d8d75188356b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:10:48Z,use_quota=True,user_id='58555cd9a6b5440bba85a28a2a2e6f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118d246b-9eba-46fa-8c9d-b5a44741ba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118d246b-9eba-46fa-8c9d-b5a44741ba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759e78e4-3916-4676-8714-c525b79d11d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759e78e4-3916-4676-8714-c525b79d11d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcfdc91-eab5-4029-9d94-9d8ea99f51c7', 'volume_name': 'volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb56d42-8c00-4512-beb4-dc265e154a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb56d42-8c00-4512-beb4-dc265e154a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683abfa8-e71e-439d-88b1-aba87d70a6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:47 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Volume 5dcfdc91-eab5-4029-9d94-9d8ea99f51c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7', 'volume_size': 1}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-957881906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcfdc91-eab5-4029-9d94-9d8ea99f51c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d4c664aa16459283d8d75188356b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:10:48Z,use_quota=True,user_id='58555cd9a6b5440bba85a28a2a2e6f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Creating volume 5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:10:47 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:47 devstack sudo[103972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 1073741824
Nov 04 01:10:47 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Created reservations ['c483b8b6-6964-4151-b965-4e96d1573b9e', 'fcfb4f89-c868-4880-8758-2501d3cbc525', '23ef21b9-f5b3-4853-8ae2-24327a62aa35', 'd3afc75e-c20c-44da-afca-a431ac36fde1'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:47 devstack sudo[103974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:10:47 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:47 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "cinder-3be511c7-701f-47b3-93bf-59cf2bffefc3-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-3be511c7-701f-47b3-93bf-59cf2bffefc3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "cinder-quobyte-3be511c7-701f-47b3-93bf-59cf2bffefc3" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-3be511c7-701f-47b3-93bf-59cf2bffefc3" acquired by "delete_volume" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf3d995-b01b-4dca-ad3a-96a9a855f6b3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:48 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.323s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:10:48 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Deleted volume successfully.
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2ef51d9b-949d-4a0b-bb4d-e542faf2f4c5 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-c1585ef3-a154-435d-9cd3-f7b41db97a57-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:48 devstack sudo[103979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3
Nov 04 01:10:48 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:48 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 1073741824" returned: 0 in 0.583s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:48 devstack sudo[103983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7
Nov 04 01:10:48 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:48 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3" returned: 0 in 0.455s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:48 devstack sudo[103988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3
Nov 04 01:10:48 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:48 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" returned: 0 in 0.335s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683abfa8-e71e-439d-88b1-aba87d70a6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1d9edf-e53d-4d90-97c6-45a57ef280a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:10:48 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Volume volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 (5dcfdc91-eab5-4029-9d94-9d8ea99f51c7): created successfully
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1d9edf-e53d-4d90-97c6-45a57ef280a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Flow 'volume_create_manager' (2307e678-5570-4d86-be29-9fab0e69eee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:10:48 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a642c4e6-16e0-4891-b4c2-34b9347cf350 tempest-VolumesSnapshotListTestJSON-1417563829 None] Created volume successfully.
Nov 04 01:10:48 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3be511c7-701f-47b3-93bf-59cf2bffefc3" returned: 0 in 0.266s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-quobyte-3be511c7-701f-47b3-93bf-59cf2bffefc3" released by "delete_volume" :: held 0.778s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:48 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Created reservations ['f16e2f13-f7d7-4a71-86fa-6d9cbbeffabd', 'ff1a1f51-6f1f-4496-a5c1-acd6db6f4006', '72e22ee2-a8eb-4625-9590-8a0f910356a4', 'f7932f7d-b890-4ebb-bfbe-b2a115ebbba9'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:49 devstack sudo[103992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:10:49 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:49 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.354s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:10:49 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Deleted volume successfully.
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-db402d2a-cad3-4815-a5b5-be42ccc8bb03 tempest-SnapshotDependencyTests-1767087560 None] Lock "cinder-3be511c7-701f-47b3-93bf-59cf2bffefc3-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] Creating offline snapshot a5311d50-2cb7-4710-857c-1160390eca05 of volume 5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe0e4a3-4286-488e-9b4c-a2720a01dd80]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:50 devstack sudo[103995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7
Nov 04 01:10:50 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:50 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" returned: 0 in 0.435s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:50 devstack sudo[104001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 1G
Nov 04 01:10:50 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:50 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 1G" returned: 0 in 0.505s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:50 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05
Nov 04 01:10:50 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:51 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05" returned: 0 in 0.401s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:51 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 is being set with open permissions: ugo+rw
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:51 devstack sudo[104015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05
Nov 04 01:10:51 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:51 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05" returned: 0 in 0.256s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:51 devstack sudo[104018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.info
Nov 04 01:10:51 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:51 devstack sudo[104020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:10:51 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:51 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.info" returned: 0 in 0.304s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:51 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.info is being set with open permissions: ugo+rw
Nov 04 01:10:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:51 devstack sudo[104023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.info
Nov 04 01:10:51 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:52 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.359s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:10:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:10:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:10:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:10:52 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.info" returned: 0 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.340s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:52 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2587a5b5-0d45-456e-8721-14d5e32e431e tempest-VolumesSnapshotListTestJSON-1417563829 None] Create snapshot completed successfully
Nov 04 01:10:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] Creating offline snapshot 127bf502-7238-4d35-8f63-11f9621649e6 of volume 5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:10:53 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cb0ecf-0f8d-4b24-8df1-04b3ad1f9903]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:53 devstack sudo[104027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05
Nov 04 01:10:53 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:53 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05" returned: 0 in 0.421s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:10:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:53 devstack sudo[104032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 1G
Nov 04 01:10:53 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:54 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 1G" returned: 0 in 0.639s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:54 devstack sudo[104040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6
Nov 04 01:10:54 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:54 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6" returned: 0 in 0.347s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:54 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 is being set with open permissions: ugo+rw
Nov 04 01:10:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:54 devstack sudo[104046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6
Nov 04 01:10:54 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:55 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6" returned: 0 in 0.285s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-6bf57c37-a486-41ab-b999-a4aa71e5b6d1 tempest-VolumesSnapshotListTestJSON-1417563829 None] Create snapshot completed successfully
Nov 04 01:10:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:10:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:10:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] Creating offline snapshot 3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c of volume 5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:10:55 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24121e9-e436-4377-baec-90bd7a5b3d13]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:56 devstack sudo[104049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6
Nov 04 01:10:56 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:56 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6" returned: 0 in 0.525s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:10:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:56 devstack sudo[104056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c 1G
Nov 04 01:10:56 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:56 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c 1G" returned: 0 in 0.617s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:57 devstack sudo[104062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c
Nov 04 01:10:57 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:57 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c" returned: 0 in 0.367s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:57 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c is being set with open permissions: ugo+rw
Nov 04 01:10:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:57 devstack sudo[104067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c
Nov 04 01:10:57 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:57 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c" returned: 0 in 0.289s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:10:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1ae1a860-f527-49bc-a708-3c14cff4019e tempest-VolumesSnapshotListTestJSON-1417563829 None] Create snapshot completed successfully
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "cinder-3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "cinder-quobyte-3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Deleting offline snapshot 3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c of volume 5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] snapshot_file for this snap is: volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[148bc2db-2094-46d4-a8ec-e6f275085ba8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:59 devstack sudo[104070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c
Nov 04 01:10:59 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:10:59 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c" returned: 0 in 0.461s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffa84ba-f063-4732-a24b-37753ac37f17]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:10:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:10:59 devstack sudo[104076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6
Nov 04 01:10:59 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:00 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6" returned: 0 in 0.447s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:11:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:00 devstack sudo[104082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c
Nov 04 01:11:00 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:00 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c" returned: 0 in 0.526s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:00 devstack sudo[104087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c
Nov 04 01:11:00 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:00 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c" returned: 0 in 0.296s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c" released by "_delete_snapshot" :: held 1.889s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" released by "delete_snapshot" :: held 1.918s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Created reservations ['6a97885d-13e3-4423-b829-2758753533f6', '9a400b4a-6370-40f7-8a96-045931798f57', '1dafafa4-65bc-4812-a43a-224f35ae9154', '5785e82d-7273-48b2-b951-fe31f1e9bfd8'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Flow 'volume_create_manager' (54125502-5890-4e77-b667-fe30817ec785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7aa30e-b1e6-413c-90df-606983886871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7aa30e-b1e6-413c-90df-606983886871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-28953883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3bbcc5-ed10-41d0-8846-70d59e4f5965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec0f4e38e4c4ad08e2ddb4ee2264248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:11:01Z,use_quota=True,user_id='8c00835aa64a48f495539804c75a273f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1438130b-ff6c-4b6a-b026-127875f20819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1438130b-ff6c-4b6a-b026-127875f20819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16bdc66-c0f7-4abd-96a8-04485891bd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.image.glance [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Creating Keystone auth plugin from conf {{(pid=86660) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "cinder-127bf502-7238-4d35-8f63-11f9621649e6-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-127bf502-7238-4d35-8f63-11f9621649e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:11:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Delete snapshot completed successfully.
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-963ceed0-804a-416e-b269-496cb10a6166 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-3ccb703f-3cf0-4fb7-8a5e-daebc8c1e62c-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "cinder-quobyte-127bf502-7238-4d35-8f63-11f9621649e6" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-127bf502-7238-4d35-8f63-11f9621649e6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Deleting offline snapshot 127bf502-7238-4d35-8f63-11f9621649e6 of volume 5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] snapshot_file for this snap is: volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1ec069-05a7-408a-8cc2-548e325ca007]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:01 devstack sudo[104092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6
Nov 04 01:11:01 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:01 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6" returned: 0 in 0.482s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9173628-e814-4bca-9ca9-e2aa2d3365bc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16bdc66-c0f7-4abd-96a8-04485891bd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d3bbcc5-ed10-41d0-8846-70d59e4f5965', 'volume_name': 'volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b53d3f7020>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249de4bd-ffd4-476b-975f-bd8755482e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249de4bd-ffd4-476b-975f-bd8755482e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95ffeb1-d54a-434f-9c83-ee8e0054e625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Volume 6d3bbcc5-ed10-41d0-8846-70d59e4f5965: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b53d3f7020>}
Nov 04 01:11:01 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Trying to clone 6d3bbcc5-ed10-41d0-8846-70d59e4f5965 from image feeea883-a973-4c2d-b14e-c13d05c107a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]). {{(pid=86660) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 01:11:01 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05
Nov 04 01:11:01 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 01:11:02 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Image download 20.69 MB at 20.69 MB/s
Nov 04 01:11:02 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05" returned: 0 in 0.484s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:02 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6
Nov 04 01:11:02 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce16043-0575-4e4b-8db9-4c7a0d29666c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:02 devstack sudo[104109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD
Nov 04 01:11:02 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:02 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Temporary image feeea883-a973-4c2d-b14e-c13d05c107a4 is fetched for user 8c00835aa64a48f495539804c75a273f. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 01:11:02 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6" returned: 0 in 0.399s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:02 devstack sudo[104117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6
Nov 04 01:11:02 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8b5f1c-5672-4b02-ac5a-de68e926b0fb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:02 devstack sudo[104119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD
Nov 04 01:11:02 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:02 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.127bf502-7238-4d35-8f63-11f9621649e6" returned: 0 in 0.252s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-127bf502-7238-4d35-8f63-11f9621649e6" released by "_delete_snapshot" :: held 1.740s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" released by "delete_snapshot" :: held 1.767s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Created reservations ['e96075e5-03d7-47a9-857c-a978144b7f5d', 'e69de706-9c3b-4405-8aac-76e0213b3288', '3e8d8f93-e4e1-4f16-aa62-7b103ed2cca9', '422feb88-b10a-4326-bbc3-c105a7d2d03c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:11:03 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-28953883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3bbcc5-ed10-41d0-8846-70d59e4f5965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec0f4e38e4c4ad08e2ddb4ee2264248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:11:01Z,use_quota=True,user_id='8c00835aa64a48f495539804c75a273f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Creating volume 6d3bbcc5-ed10-41d0-8846-70d59e4f5965 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:11:03 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Delete snapshot completed successfully.
Nov 04 01:11:03 devstack sudo[104125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 1073741824
Nov 04 01:11:03 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-65a73e63-4125-4e10-8a1d-a2b44f44ba66 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-127bf502-7238-4d35-8f63-11f9621649e6-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "cinder-a5311d50-2cb7-4710-857c-1160390eca05-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-a5311d50-2cb7-4710-857c-1160390eca05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "cinder-quobyte-a5311d50-2cb7-4710-857c-1160390eca05" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-a5311d50-2cb7-4710-857c-1160390eca05" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Deleting offline snapshot a5311d50-2cb7-4710-857c-1160390eca05 of volume 5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] snapshot_file for this snap is: volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cc319b-8864-4943-85a8-99ea67cccbf8]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:03 devstack sudo[104130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05
Nov 04 01:11:03 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:03 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 1073741824" returned: 0 in 0.492s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:03 devstack sudo[104132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965
Nov 04 01:11:03 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:03 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05" returned: 0 in 0.397s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd131f9-9cf7-4eb9-b784-11c76f9b2106]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:04 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965" returned: 0 in 0.277s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Attempting download of feeea883-a973-4c2d-b14e-c13d05c107a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}])) to volume 6d3bbcc5-ed10-41d0-8846-70d59e4f5965. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 01:11:04 devstack sudo[104139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7
Nov 04 01:11:04 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b2657e-aadd-4d42-81ea-15ab7aee1d97]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_e89pll1s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:04 devstack sudo[104142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_e89pll1s
Nov 04 01:11:04 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:04 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" returned: 0 in 0.373s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:04 devstack sudo[104147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05
Nov 04 01:11:04 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:04 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_e89pll1s" returned: 0 in 0.355s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_e89pll1s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:04 devstack sudo[104151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_e89pll1s
Nov 04 01:11:04 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:04 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05" returned: 0 in 0.358s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:04 devstack sudo[104157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05
Nov 04 01:11:04 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:04 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_e89pll1s" returned: 1 in 0.344s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_feeea883-a973-4c2d-b14e-c13d05c107a4_e89pll1s' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d29e91-e408-43b6-bd02-c6df88d2e59e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:04 devstack sudo[104161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD
Nov 04 01:11:04 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:04 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7.a5311d50-2cb7-4710-857c-1160390eca05" returned: 0 in 0.248s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-a5311d50-2cb7-4710-857c-1160390eca05" released by "_delete_snapshot" :: held 1.493s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:11:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" released by "delete_snapshot" :: held 1.519s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:11:05 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Created reservations ['03af80c9-cb22-4ff1-a59c-5ee2fbccb8d2', '34b562c1-2078-4060-913a-e45df35b6a1c', '85442cd5-9ba9-4ff1-873e-17fbc4277a1d', 'd6fd123b-e7a4-470b-94b2-ff3b23b88a46'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:11:05 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Delete snapshot completed successfully.
Nov 04 01:11:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a9ce0c47-37a6-409a-aafa-e52c92dff5ad tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-a5311d50-2cb7-4710-857c-1160390eca05-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:11:05 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:05 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] feeea883-a973-4c2d-b14e-c13d05c107a4 was qcow2, converting to qcow2 {{(pid=86660) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 01:11:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:05 devstack sudo[104167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965
Nov 04 01:11:05 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "cinder-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:11:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:11:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:11:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:11:05 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af25f8e-a59b-4c90-b4b4-4b2cd78985fe]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:05 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7
Nov 04 01:11:05 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:06 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" returned: 0 in 0.401s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:06 devstack sudo[104180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7
Nov 04 01:11:06 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:06 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" returned: 0 in 0.294s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-quobyte-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7" released by "delete_volume" :: held 0.763s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Created reservations ['da56fa5f-6dd2-4381-b206-384469ad5e54', 'bcfdafa6-9351-408d-901e-454b11eaac27', 'd4288e3e-ac7e-42ef-adb3-89935f6b3fad', '41bf8be5-46c8-4e8e-a4cc-e174241dabdd'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:06 devstack sudo[104183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:11:06 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:06 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.275s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:11:06 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Deleted volume successfully.
Nov 04 01:11:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-04e44ecc-af90-4062-aa13-5311f4721376 tempest-VolumesSnapshotListTestJSON-1417563829 None] Lock "cinder-5dcfdc91-eab5-4029-9d94-9d8ea99f51c7-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:11:07 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965" returned: 0 in 1.947s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_feeea883-a973-4c2d-b14e-c13d05c107a4_8qakwfowdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:11:07 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Converted 112.00 MB image at 57.49 MB/s
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:07 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 1G
Nov 04 01:11:07 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:07 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 1G" returned: 0 in 0.367s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Downloaded image feeea883-a973-4c2d-b14e-c13d05c107a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}])) to volume 6d3bbcc5-ed10-41d0-8846-70d59e4f5965 successfully. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Temporary image feeea883-a973-4c2d-b14e-c13d05c107a4 for user 8c00835aa64a48f495539804c75a273f is deleted. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Marking volume 6d3bbcc5-ed10-41d0-8846-70d59e4f5965 as bootable. {{(pid=86660) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Copying metadata from image feeea883-a973-4c2d-b14e-c13d05c107a4 to 6d3bbcc5-ed10-41d0-8846-70d59e4f5965. {{(pid=86660) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Creating volume glance metadata for volume 6d3bbcc5-ed10-41d0-8846-70d59e4f5965 backed by image feeea883-a973-4c2d-b14e-c13d05c107a4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86660) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95ffeb1-d54a-434f-9c83-ee8e0054e625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965', 'volume_size': 1, 'image_id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/feeea883-a973-4c2d-b14e-c13d05c107a4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '19a99c2da7284defb597baed4df65e43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'feeea883-a973-4c2d-b14e-c13d05c107a4', 'created_at': datetime.datetime(2026, 11, 3, 23, 49, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 23, 49, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/feeea883-a973-4c2d-b14e-c13d05c107a4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b53d3f7020>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f12174b-8473-40ce-8795-4c6ddd5741be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:07 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Volume volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 (6d3bbcc5-ed10-41d0-8846-70d59e4f5965): created successfully
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f12174b-8473-40ce-8795-4c6ddd5741be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Flow 'volume_create_manager' (54125502-5890-4e77-b667-fe30817ec785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:11:07 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-199469a8-d53d-4b4e-848c-c79fc3da3da8 tempest-TestShelveInstance-488922255 None] Created volume successfully.
Nov 04 01:11:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-5cbbd4c3-ad3b-498e-806d-4586daa11062 req-588c4b23-e146-4d59-ba29-f1b836e6a6e8 tempest-TestShelveInstance-488922255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:11:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-5cbbd4c3-ad3b-498e-806d-4586daa11062 req-588c4b23-e146-4d59-ba29-f1b836e6a6e8 tempest-TestShelveInstance-488922255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:11:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-5cbbd4c3-ad3b-498e-806d-4586daa11062 req-588c4b23-e146-4d59-ba29-f1b836e6a6e8 tempest-TestShelveInstance-488922255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:11:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-5cbbd4c3-ad3b-498e-806d-4586daa11062 req-588c4b23-e146-4d59-ba29-f1b836e6a6e8 tempest-TestShelveInstance-488922255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf152374-2e37-4223-84f6-f151a13e6b69', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:11:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-5cbbd4c3-ad3b-498e-806d-4586daa11062 req-588c4b23-e146-4d59-ba29-f1b836e6a6e8 tempest-TestShelveInstance-488922255 None] attachment_update completed successfully.
Nov 04 01:11:21 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=85,cinder:INSERT=33,cinder:UPDATE=106,cinder:DELETE=5 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:11:21 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=97,cinder:DELETE=10,cinder:UPDATE=88,cinder:INSERT=31 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Flow 'volume_create_manager' (ed9e2bec-c767-4115-9e81-8bd8ad0df717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b29e9a-3208-4583-8d2c-dab5decf3a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b29e9a-3208-4583-8d2c-dab5decf3a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1738895994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e4e618-5e43-4072-b539-2ccf3fca5516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de78e255a1a74179b083b0c15883c0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:11:32Z,use_quota=True,user_id='76a2a90404cf4b43b0e7dc950cefd3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c33b62-55ef-439e-a66e-193fd4447e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c33b62-55ef-439e-a66e-193fd4447e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa857ee6-45e3-496d-9d94-a41ca833a550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa857ee6-45e3-496d-9d94-a41ca833a550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e4e618-5e43-4072-b539-2ccf3fca5516', 'volume_name': 'volume-b1e4e618-5e43-4072-b539-2ccf3fca5516', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa6a0ba-4c06-4276-b036-e78b3eca6943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa6a0ba-4c06-4276-b036-e78b3eca6943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28dada48-ca28-46c9-9f8b-04ad4b1571df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:31 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Volume b1e4e618-5e43-4072-b539-2ccf3fca5516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e4e618-5e43-4072-b539-2ccf3fca5516', 'volume_size': 1}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1738895994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e4e618-5e43-4072-b539-2ccf3fca5516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de78e255a1a74179b083b0c15883c0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:11:32Z,use_quota=True,user_id='76a2a90404cf4b43b0e7dc950cefd3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Creating volume b1e4e618-5e43-4072-b539-2ccf3fca5516 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:11:31 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:11:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:31 devstack sudo[104736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 1073741824
Nov 04 01:11:31 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:32 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 1073741824" returned: 0 in 0.500s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:32 devstack sudo[104742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516
Nov 04 01:11:32 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:32 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516" returned: 0 in 0.300s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:11:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:11:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28dada48-ca28-46c9-9f8b-04ad4b1571df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e4e618-5e43-4072-b539-2ccf3fca5516', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be38bcce-3ce0-4803-8a76-d4d47a9dd98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:11:32 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Volume volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 (b1e4e618-5e43-4072-b539-2ccf3fca5516): created successfully
Nov 04 01:11:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be38bcce-3ce0-4803-8a76-d4d47a9dd98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:11:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Flow 'volume_create_manager' (ed9e2bec-c767-4115-9e81-8bd8ad0df717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:11:32 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-26e6f289-33eb-4a3d-b2eb-e28726851a9f tempest-TestImageHashVerification-1165725416 None] Created volume successfully.
Nov 04 01:11:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:11:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:11:34 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4356ba-9815-40c1-8b09-da269a0b282c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:34 devstack sudo[104777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516
Nov 04 01:11:34 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:35 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516" returned: 0 in 0.361s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:35 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5c923b-7464-499f-b94f-598a1acfbe55]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:35 devstack sudo[104782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516
Nov 04 01:11:35 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:35 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516" returned: 0 in 0.375s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 /opt/stack/data/cinder/conversion/b1e4e618-5e43-4072-b539-2ccf3fca5516.temp_image.4cdf3260-83ff-4ed6-86c8-64cad680998bj10vbnll.img {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:35 devstack sudo[104787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 /opt/stack/data/cinder/conversion/b1e4e618-5e43-4072-b539-2ccf3fca5516.temp_image.4cdf3260-83ff-4ed6-86c8-64cad680998bj10vbnll.img
Nov 04 01:11:35 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:41 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 /opt/stack/data/cinder/conversion/b1e4e618-5e43-4072-b539-2ccf3fca5516.temp_image.4cdf3260-83ff-4ed6-86c8-64cad680998bj10vbnll.img" returned: 0 in 5.973s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:41 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c861a40b-317b-4be4-a0f4-c074133f2a41]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:11:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:41 devstack sudo[104801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516
Nov 04 01:11:41 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:42 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516" returned: 0 in 0.595s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:42 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/conversion/b1e4e618-5e43-4072-b539-2ccf3fca5516.temp_image.4cdf3260-83ff-4ed6-86c8-64cad680998bj10vbnll.img {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:11:42 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] Converted 1024.00 MB image at 171.42 MB/s
Nov 04 01:11:42 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] 4cdf3260-83ff-4ed6-86c8-64cad680998b was raw, no need to convert to raw {{(pid=86660) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 04 01:11:46 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-295dc4b3-10db-4e81-bf89-166acdf9cbc0 req-f25818f2-4a91-4df8-8617-8ef788ef1c12 tempest-TestShelveInstance-488922255 None] Terminate volume connection completed successfully.
Nov 04 01:11:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-295dc4b3-10db-4e81-bf89-166acdf9cbc0 req-f25818f2-4a91-4df8-8617-8ef788ef1c12 tempest-TestShelveInstance-488922255 None] Deleting attachment cf152374-2e37-4223-84f6-f151a13e6b69. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:11:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-fd625caa-3c98-42d4-9c7d-d4ab8f9953fe req-1b910dac-661f-4c31-9ae4-6f3e2f1143d6 tempest-TestShelveInstance-488922255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:11:51 devstack sudo[104858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:11:51 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:11:51 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.254s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:11:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:11:56 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:12:00 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=5,cinder:SELECT=6 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:12:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.356s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] Uploaded volume to glance image-id: 4cdf3260-83ff-4ed6-86c8-64cad680998b. {{(pid=86660) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 04 01:12:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-fd625caa-3c98-42d4-9c7d-d4ab8f9953fe req-1b910dac-661f-4c31-9ae4-6f3e2f1143d6 tempest-TestShelveInstance-488922255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.953s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-fd625caa-3c98-42d4-9c7d-d4ab8f9953fe req-1b910dac-661f-4c31-9ae4-6f3e2f1143d6 tempest-TestShelveInstance-488922255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5e01dbeb-126e-4dc2-a774-4c42ddc6ee99 tempest-TestImageHashVerification-1165725416 None] Copy volume to image completed successfully.
Nov 04 01:12:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-fd625caa-3c98-42d4-9c7d-d4ab8f9953fe req-1b910dac-661f-4c31-9ae4-6f3e2f1143d6 tempest-TestShelveInstance-488922255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157', 'name': 'volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d60106c-2590-490b-b0b6-52552a590ebc', 'enforce_multipath': True} {{(pid=86660) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 01:12:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-fd625caa-3c98-42d4-9c7d-d4ab8f9953fe req-1b910dac-661f-4c31-9ae4-6f3e2f1143d6 tempest-TestShelveInstance-488922255 None] attachment_update completed successfully.
Nov 04 01:12:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Acquiring lock "cinder-b1e4e618-5e43-4072-b539-2ccf3fca5516-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Lock "cinder-b1e4e618-5e43-4072-b539-2ccf3fca5516-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Acquiring lock "cinder-quobyte-b1e4e618-5e43-4072-b539-2ccf3fca5516" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Lock "cinder-quobyte-b1e4e618-5e43-4072-b539-2ccf3fca5516" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:02 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f892bc1-e82d-450f-9957-aa150ef42a78]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:12:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:02 devstack sudo[104864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516
Nov 04 01:12:02 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:02 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516" returned: 0 in 0.413s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:02 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516
Nov 04 01:12:02 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:03 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b1e4e618-5e43-4072-b539-2ccf3fca5516" returned: 0 in 0.281s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Lock "cinder-quobyte-b1e4e618-5e43-4072-b539-2ccf3fca5516" released by "delete_volume" :: held 0.746s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Created reservations ['cdaa4576-b513-4831-9916-64e279a34cb6', '10c128c1-49c8-4e0a-8e68-91ec4456a58b', '59c2d155-3a20-4937-bf37-e46ac962ccf9', '507e49f0-9ac7-470c-8262-84291dfeb94c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:03 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:12:03 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:03 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.273s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:12:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Deleted volume successfully.
Nov 04 01:12:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f3d6627a-c626-400b-8fb0-7a49badb4237 tempest-TestImageHashVerification-1165725416 None] Lock "cinder-b1e4e618-5e43-4072-b539-2ccf3fca5516-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Flow 'volume_create_manager' (81b33b83-8c56-478d-9d07-b4369ec221f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653f2d0e-5bf8-49fe-acbd-bffc7c22db38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653f2d0e-5bf8-49fe-acbd-bffc7c22db38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1585019852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4042f54a-cfe8-464f-acfe-1bfc573b5dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a24791237d44b5590c75ade588496fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:12:17Z,use_quota=True,user_id='f5af752712f74e7a8ad0509769bb0b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287cffb6-ec9e-4bd5-9b11-cd22e2058d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287cffb6-ec9e-4bd5-9b11-cd22e2058d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5926f0a-3464-4f3b-b288-b60daf0bfe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5926f0a-3464-4f3b-b288-b60daf0bfe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4042f54a-cfe8-464f-acfe-1bfc573b5dc5', 'volume_name': 'volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60404e3-2acf-48e6-98de-a4cf2e2d5da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60404e3-2acf-48e6-98de-a4cf2e2d5da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070547ab-b60a-4cc6-995b-8a35ec76860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:16 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Volume 4042f54a-cfe8-464f-acfe-1bfc573b5dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5', 'volume_size': 1}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1585019852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4042f54a-cfe8-464f-acfe-1bfc573b5dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a24791237d44b5590c75ade588496fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:12:17Z,use_quota=True,user_id='f5af752712f74e7a8ad0509769bb0b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Creating volume 4042f54a-cfe8-464f-acfe-1bfc573b5dc5 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:12:16 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:12:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:16 devstack sudo[105405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 1073741824
Nov 04 01:12:16 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:17 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 1073741824" returned: 0 in 0.409s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:17 devstack sudo[105410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5
Nov 04 01:12:17 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:17 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" returned: 0 in 0.247s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070547ab-b60a-4cc6-995b-8a35ec76860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404244f6-d548-415c-94a7-5ee0d0e954e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:17 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Volume volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 (4042f54a-cfe8-464f-acfe-1bfc573b5dc5): created successfully
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404244f6-d548-415c-94a7-5ee0d0e954e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Flow 'volume_create_manager' (81b33b83-8c56-478d-9d07-b4369ec221f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:12:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-bc8eb337-0f87-4dcb-a25c-40bb46b38fd6 tempest-VolumeDependencyTests-1614091903 None] Created volume successfully.
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] Creating offline snapshot 8a223b1d-37fe-4284-a4ac-f1b27a7577fb of volume 4042f54a-cfe8-464f-acfe-1bfc573b5dc5 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e53f9f-4c00-49f3-8a1b-b5732721e90a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:12:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:18 devstack sudo[105413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5
Nov 04 01:12:18 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:18 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" returned: 0 in 0.355s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:18 devstack sudo[105418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb 1G
Nov 04 01:12:18 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:18 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb 1G" returned: 0 in 0.376s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:18 devstack sudo[105423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb
Nov 04 01:12:18 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:18 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb" returned: 0 in 0.292s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:18 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb is being set with open permissions: ugo+rw
Nov 04 01:12:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:19 devstack sudo[105428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb
Nov 04 01:12:19 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:19 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb" returned: 0 in 0.266s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:19 devstack sudo[105431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.info
Nov 04 01:12:19 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:19 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.info" returned: 0 in 0.253s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:19 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.info is being set with open permissions: ugo+rw
Nov 04 01:12:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:19 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.info
Nov 04 01:12:19 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:19 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.info" returned: 0 in 0.255s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:19 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d872d5f8-d1ac-4b99-9332-88d32b644ff9 tempest-VolumeDependencyTests-1614091903 None] Create snapshot completed successfully
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Flow 'volume_create_manager' (6bf6a9f7-96e0-4dd8-96aa-0c72b28fab01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9ac3ee-a96e-4d51-9060-8b8db412fd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9ac3ee-a96e-4d51-9060-8b8db412fd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1870423762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e72d7c-20a7-4b1e-954f-9b166c817164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a24791237d44b5590c75ade588496fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a223b1d-37fe-4284-a4ac-f1b27a7577fb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:12:21Z,use_quota=True,user_id='f5af752712f74e7a8ad0509769bb0b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07e43d3-6105-4ee5-98cc-b378dc55fceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07e43d3-6105-4ee5-98cc-b378dc55fceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378de809-e74b-47be-a74a-ad7b6882960a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378de809-e74b-47be-a74a-ad7b6882960a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15e72d7c-20a7-4b1e-954f-9b166c817164', 'volume_name': 'volume-15e72d7c-20a7-4b1e-954f-9b166c817164', 'volume_size': 1, 'snapshot_id': '8a223b1d-37fe-4284-a4ac-f1b27a7577fb'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa19636-a907-4514-8d45-44cf37794b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa19636-a907-4514-8d45-44cf37794b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4225c9bd-1c82-4ee8-9e4f-4eb22fb310c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:20 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Volume 15e72d7c-20a7-4b1e-954f-9b166c817164: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15e72d7c-20a7-4b1e-954f-9b166c817164', 'volume_size': 1, 'snapshot_id': '8a223b1d-37fe-4284-a4ac-f1b27a7577fb'}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "cinder-quobyte-8a223b1d-37fe-4284-a4ac-f1b27a7577fb-15e72d7c-20a7-4b1e-954f-9b166c817164" by "_create_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-8a223b1d-37fe-4284-a4ac-f1b27a7577fb-15e72d7c-20a7-4b1e-954f-9b166c817164" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Creating volume 15e72d7c-20a7-4b1e-954f-9b166c817164 from snapshot 8a223b1d-37fe-4284-a4ac-f1b27a7577fb {{(pid=86660) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "cinder-quobyte-15e72d7c-20a7-4b1e-954f-9b166c817164" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-15e72d7c-20a7-4b1e-954f-9b166c817164" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] snapshot: 8a223b1d-37fe-4284-a4ac-f1b27a7577fb, volume: 15e72d7c-20a7-4b1e-954f-9b166c817164,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[26853544-0925-4a59-98b9-f6172f87d250]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:12:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:20 devstack sudo[105450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb
Nov 04 01:12:20 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:21 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb" returned: 0 in 0.354s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:12:21 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1df48b-92eb-4a90-9546-a98319161490]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:12:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:21 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5
Nov 04 01:12:21 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:21 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" returned: 0 in 0.345s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 01:12:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 01:12:21 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164 not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 01:12:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:21 devstack sudo[105461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164
Nov 04 01:12:21 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:27 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164" returned: 0 in 5.925s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:27 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:12:27 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Converted 1024.00 MB image at 172.79 MB/s
Nov 04 01:12:27 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164 is being set with open permissions: ugo+rw
Nov 04 01:12:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:27 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164
Nov 04 01:12:27 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:27 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164" returned: 0 in 0.254s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-15e72d7c-20a7-4b1e-954f-9b166c817164" released by "_copy_volume_from_snapshot" :: held 6.953s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-8a223b1d-37fe-4284-a4ac-f1b27a7577fb-15e72d7c-20a7-4b1e-954f-9b166c817164" released by "_create_volume_from_snapshot" :: held 7.014s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.030s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4225c9bd-1c82-4ee8-9e4f-4eb22fb310c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e72d7c-20a7-4b1e-954f-9b166c817164', 'volume_size': 1, 'snapshot_id': '8a223b1d-37fe-4284-a4ac-f1b27a7577fb'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5b9809-0382-4f45-90da-b5042b776838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:27 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Volume volume-15e72d7c-20a7-4b1e-954f-9b166c817164 (15e72d7c-20a7-4b1e-954f-9b166c817164): created successfully
Nov 04 01:12:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5b9809-0382-4f45-90da-b5042b776838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Flow 'volume_create_manager' (6bf6a9f7-96e0-4dd8-96aa-0c72b28fab01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:12:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-37aba4af-0a53-42c2-bd9d-4da6219db273 tempest-VolumeDependencyTests-1614091903 None] Created volume successfully.
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "cinder-8a223b1d-37fe-4284-a4ac-f1b27a7577fb-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-8a223b1d-37fe-4284-a4ac-f1b27a7577fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "cinder-quobyte-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "cinder-quobyte-8a223b1d-37fe-4284-a4ac-f1b27a7577fb" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-8a223b1d-37fe-4284-a4ac-f1b27a7577fb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Deleting offline snapshot 8a223b1d-37fe-4284-a4ac-f1b27a7577fb of volume 4042f54a-cfe8-464f-acfe-1bfc573b5dc5 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] snapshot_file for this snap is: volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6933b857-e4dd-4933-8179-87bd171bc737]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:28 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb
Nov 04 01:12:28 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:28 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb" returned: 0 in 0.372s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3b0f74-a4e4-4d96-b489-b0e6eed90f8b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:12:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:28 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5
Nov 04 01:12:28 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:29 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" returned: 0 in 0.535s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:29 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb
Nov 04 01:12:29 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:29 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb" returned: 0 in 0.342s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:29 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb
Nov 04 01:12:29 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:29 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5.8a223b1d-37fe-4284-a4ac-f1b27a7577fb" returned: 0 in 0.241s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-8a223b1d-37fe-4284-a4ac-f1b27a7577fb" released by "_delete_snapshot" :: held 1.598s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" released by "delete_snapshot" :: held 1.625s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:29 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Created reservations ['289c2ad2-13e7-4cd8-a2fb-dadd485398ab', '919c3c27-eaf7-4982-ad1a-ee8091e9b650', '0c2f714a-a500-4b94-9b96-c62fad225f2e', '8dcedbac-2aa5-4e12-97eb-47b6d6bbe6d6'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:12:29 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Delete snapshot completed successfully.
Nov 04 01:12:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3b5fdad9-17a9-4e01-922d-d40cecd353ca tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-8a223b1d-37fe-4284-a4ac-f1b27a7577fb-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "cinder-4042f54a-cfe8-464f-acfe-1bfc573b5dc5-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-4042f54a-cfe8-464f-acfe-1bfc573b5dc5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "cinder-quobyte-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" acquired by "delete_volume" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:30 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7892219-365e-4da5-90a4-d29191e8dfd3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:12:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:30 devstack sudo[105522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5
Nov 04 01:12:30 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:30 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" returned: 0 in 0.342s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:30 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5
Nov 04 01:12:30 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:31 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" returned: 0 in 0.255s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-4042f54a-cfe8-464f-acfe-1bfc573b5dc5" released by "delete_volume" :: held 0.654s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Created reservations ['2ebf5a0f-0892-451d-9e2e-a2db78ec3b68', 'df3255ec-b4d9-4e98-bb3e-647ca2fa41e1', '59ee8ba9-d873-4930-9fa2-d32beb6f4f1d', '12bc1985-b425-4656-a0ae-c23315fe0f2a'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:31 devstack sudo[105531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:12:31 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:31 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.246s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:12:31 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Deleted volume successfully.
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-21d6fb01-65a1-4b9f-8d92-c439af38fc6b tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-4042f54a-cfe8-464f-acfe-1bfc573b5dc5-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "cinder-15e72d7c-20a7-4b1e-954f-9b166c817164-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-15e72d7c-20a7-4b1e-954f-9b166c817164-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "cinder-quobyte-15e72d7c-20a7-4b1e-954f-9b166c817164" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-15e72d7c-20a7-4b1e-954f-9b166c817164" acquired by "delete_volume" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbff2728-620c-4e92-bd9e-d93619c2dbf4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:31 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164
Nov 04 01:12:31 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:31 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164" returned: 0 in 0.343s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:31 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164
Nov 04 01:12:31 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:32 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-15e72d7c-20a7-4b1e-954f-9b166c817164" returned: 0 in 0.240s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-quobyte-15e72d7c-20a7-4b1e-954f-9b166c817164" released by "delete_volume" :: held 0.628s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Created reservations ['659d5a91-e431-4cd4-98d9-3488479c9783', '033e4d0b-7140-415a-af07-5946785e916f', 'c067bf23-49ec-466a-a00b-ee40af9e97ee', 'e204b67c-f423-4cba-9215-5efc7169c5bc'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:32 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:12:32 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:32 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.235s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:12:32 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Deleted volume successfully.
Nov 04 01:12:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-77f422b6-c7df-482b-9c9f-7e381787094c tempest-VolumeDependencyTests-1614091903 None] Lock "cinder-15e72d7c-20a7-4b1e-954f-9b166c817164-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:42 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=30,cinder:UPDATE=41,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:12:42 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=42,cinder:UPDATE=38,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:12:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-eaba208c-9b94-433c-ad5f-d376467bd2dc tempest-TestShelveInstance-488922255 None] Terminate volume connection completed successfully.
Nov 04 01:12:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-eaba208c-9b94-433c-ad5f-d376467bd2dc tempest-TestShelveInstance-488922255 None] Deleting attachment 3d60106c-2590-490b-b0b6-52552a590ebc. {{(pid=86660) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Acquiring lock "cinder-6d3bbcc5-ed10-41d0-8846-70d59e4f5965-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Lock "cinder-6d3bbcc5-ed10-41d0-8846-70d59e4f5965-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Acquiring lock "cinder-quobyte-6d3bbcc5-ed10-41d0-8846-70d59e4f5965" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Lock "cinder-quobyte-6d3bbcc5-ed10-41d0-8846-70d59e4f5965" acquired by "delete_volume" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14369f0-9d56-4270-a59a-bbce818dd308]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:45 devstack sudo[105576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965
Nov 04 01:12:45 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:45 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965" returned: 0 in 0.391s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:45 devstack sudo[105581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965
Nov 04 01:12:45 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:45 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6d3bbcc5-ed10-41d0-8846-70d59e4f5965" returned: 0 in 0.238s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Lock "cinder-quobyte-6d3bbcc5-ed10-41d0-8846-70d59e4f5965" released by "delete_volume" :: held 0.679s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG cinder.quota [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Created reservations ['702367cd-5c59-48b9-a074-aff7222cfc73', 'c7f83d6e-0b5c-4573-9b87-167130acd49e', 'b1e1f879-5077-476f-a481-4c04fb563054', 'a646ddaa-7349-4c27-ae06-405f6d040f86'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:45 devstack sudo[105584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:12:45 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:46 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.251s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:46 devstack cinder-volume[86660]: DEBUG cinder.manager [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:12:46 devstack cinder-volume[86660]: INFO cinder.volume.manager [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Deleted volume successfully.
Nov 04 01:12:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [req-ae88c002-d0c8-4d97-ae40-d1c3e037c1ca req-1c9e7407-6190-462b-8f33-559686573a4a tempest-TestShelveInstance-488922255 None] Lock "cinder-6d3bbcc5-ed10-41d0-8846-70d59e4f5965-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:12:51 devstack sudo[105592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:12:51 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:12:51 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.246s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:12:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:12:55 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:12:56 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:12:59 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:12:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Flow 'volume_create_manager' (823701e4-0d05-4c05-9ac6-ad26358877c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:12:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1c86d2-603c-45ab-9956-80aa959f852b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1c86d2-603c-45ab-9956-80aa959f852b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4a6d7e-a2b4-4be2-88af-e27a0c079275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddb6b4031fa4420bca61d62e92660f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:00Z,use_quota=True,user_id='2be75a9f3c11485dbd6398808ea9b13b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bbd4ec2-02fb-451e-8086-4d1195d11925),volume_type_id=7bbd4ec2-02fb-451e-8086-4d1195d11925)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9324128e-67ec-4ecb-8f8a-4b1b080b8766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9324128e-67ec-4ecb-8f8a-4b1b080b8766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:12:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b0dfa5-74e0-41d9-96db-61fdd758ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:12:59 devstack cinder-volume[86660]: DEBUG cinder.image.glance [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Creating Keystone auth plugin from conf {{(pid=86660) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b0dfa5-74e0-41d9-96db-61fdd758ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c4a6d7e-a2b4-4be2-88af-e27a0c079275', 'volume_name': 'volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275', 'volume_size': 1, 'image_id': '6f426897-9716-4d1d-b9db-73df0714aaa7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f426897-9716-4d1d-b9db-73df0714aaa7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a6d76a2597866ea1ee9d0b0b346de26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dddb6b4031fa4420bca61d62e92660f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06b5080ac6c0744c3702c0364a6abb4a0770982816ce18b50504dbb10f3e7cdb0370440e71915189ba65716a6b9fc8be43fdfa799b0105de9c9fd893a2d398a8', 'id': '6f426897-9716-4d1d-b9db-73df0714aaa7', 'created_at': datetime.datetime(2026, 11, 4, 0, 12, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 12, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f426897-9716-4d1d-b9db-73df0714aaa7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547640290>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7440869b-1b75-4fcf-a6df-9040417456ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7440869b-1b75-4fcf-a6df-9040417456ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d88f0de-294a-4bc7-b279-926b0e5b2b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:00 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Volume 6c4a6d7e-a2b4-4be2-88af-e27a0c079275: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275', 'volume_size': 1, 'image_id': '6f426897-9716-4d1d-b9db-73df0714aaa7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f426897-9716-4d1d-b9db-73df0714aaa7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a6d76a2597866ea1ee9d0b0b346de26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dddb6b4031fa4420bca61d62e92660f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06b5080ac6c0744c3702c0364a6abb4a0770982816ce18b50504dbb10f3e7cdb0370440e71915189ba65716a6b9fc8be43fdfa799b0105de9c9fd893a2d398a8', 'id': '6f426897-9716-4d1d-b9db-73df0714aaa7', 'created_at': datetime.datetime(2026, 11, 4, 0, 12, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 12, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f426897-9716-4d1d-b9db-73df0714aaa7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547640290>}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Trying to clone 6c4a6d7e-a2b4-4be2-88af-e27a0c079275 from image 6f426897-9716-4d1d-b9db-73df0714aaa7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6f426897-9716-4d1d-b9db-73df0714aaa7', 'metadata': {}}]). {{(pid=86660) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 01:13:00 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Image download 0.00 MB at 0.00 MB/s
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[683860e8-0771-4afa-9f83-75c311be057c]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:00 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD
Nov 04 01:13:00 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:00 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:00 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD
Nov 04 01:13:00 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:00 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Temporary image 6f426897-9716-4d1d-b9db-73df0714aaa7 is fetched for user 2be75a9f3c11485dbd6398808ea9b13b. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[1482600a-1976-460b-851d-8baba50ba21f]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:01 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD
Nov 04 01:13:01 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:01 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:01 devstack sudo[105611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD
Nov 04 01:13:01 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:01 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4a6d7e-a2b4-4be2-88af-e27a0c079275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dddb6b4031fa4420bca61d62e92660f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:00Z,use_quota=True,user_id='2be75a9f3c11485dbd6398808ea9b13b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bbd4ec2-02fb-451e-8086-4d1195d11925),volume_type_id=7bbd4ec2-02fb-451e-8086-4d1195d11925)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Creating volume 6c4a6d7e-a2b4-4be2-88af-e27a0c079275 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:01 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:01 devstack sudo[105616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 1073741824
Nov 04 01:13:01 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:01 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 1073741824" returned: 0 in 0.398s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:02 devstack sudo[105622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275
Nov 04 01:13:02 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:02 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275" returned: 0 in 0.245s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Attempting download of 6f426897-9716-4d1d-b9db-73df0714aaa7 ((None, [{'url': 'file:///opt/stack/data/glance/images/6f426897-9716-4d1d-b9db-73df0714aaa7', 'metadata': {}}])) to volume 6c4a6d7e-a2b4-4be2-88af-e27a0c079275. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edc5509-9cbe-4aa6-9c05-4c343b7b3909]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f426897-9716-4d1d-b9db-73df0714aaa7_vtfrhwx7 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:02 devstack sudo[105625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f426897-9716-4d1d-b9db-73df0714aaa7_vtfrhwx7
Nov 04 01:13:02 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:02 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f426897-9716-4d1d-b9db-73df0714aaa7_vtfrhwx7" returned: 0 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f426897-9716-4d1d-b9db-73df0714aaa7_vtfrhwx7 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:02 devstack sudo[105630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f426897-9716-4d1d-b9db-73df0714aaa7_vtfrhwx7
Nov 04 01:13:02 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:02 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f426897-9716-4d1d-b9db-73df0714aaa7_vtfrhwx7" returned: 1 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f426897-9716-4d1d-b9db-73df0714aaa7_vtfrhwx7' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[60856bb0-2515-4593-bfcd-f63ab3ca7df1]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:03 devstack sudo[105634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD
Nov 04 01:13:03 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:03 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:03 devstack sudo[105638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD
Nov 04 01:13:03 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:03 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:13:03 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] 6f426897-9716-4d1d-b9db-73df0714aaa7 was raw, converting to qcow2 {{(pid=86660) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 01:13:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:03 devstack sudo[105643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275
Nov 04 01:13:03 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:04 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275" returned: 0 in 0.418s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6f426897-9716-4d1d-b9db-73df0714aaa7_fhoxpovldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:13:04 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Converted 0.00 MB image at 0.00 MB/s
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:04 devstack sudo[105651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 1G
Nov 04 01:13:04 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:04 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 1G" returned: 0 in 0.294s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Downloaded image 6f426897-9716-4d1d-b9db-73df0714aaa7 ((None, [{'url': 'file:///opt/stack/data/glance/images/6f426897-9716-4d1d-b9db-73df0714aaa7', 'metadata': {}}])) to volume 6c4a6d7e-a2b4-4be2-88af-e27a0c079275 successfully. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Temporary image 6f426897-9716-4d1d-b9db-73df0714aaa7 for user 2be75a9f3c11485dbd6398808ea9b13b is deleted. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Marking volume 6c4a6d7e-a2b4-4be2-88af-e27a0c079275 as bootable. {{(pid=86660) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Copying metadata from image 6f426897-9716-4d1d-b9db-73df0714aaa7 to 6c4a6d7e-a2b4-4be2-88af-e27a0c079275. {{(pid=86660) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Creating volume glance metadata for volume 6c4a6d7e-a2b4-4be2-88af-e27a0c079275 backed by image 6f426897-9716-4d1d-b9db-73df0714aaa7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6f426897-9716-4d1d-b9db-73df0714aaa7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0a6d76a2597866ea1ee9d0b0b346de26', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86660) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d88f0de-294a-4bc7-b279-926b0e5b2b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275', 'volume_size': 1, 'image_id': '6f426897-9716-4d1d-b9db-73df0714aaa7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f426897-9716-4d1d-b9db-73df0714aaa7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a6d76a2597866ea1ee9d0b0b346de26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dddb6b4031fa4420bca61d62e92660f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06b5080ac6c0744c3702c0364a6abb4a0770982816ce18b50504dbb10f3e7cdb0370440e71915189ba65716a6b9fc8be43fdfa799b0105de9c9fd893a2d398a8', 'id': '6f426897-9716-4d1d-b9db-73df0714aaa7', 'created_at': datetime.datetime(2026, 11, 4, 0, 12, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 12, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f426897-9716-4d1d-b9db-73df0714aaa7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547640290>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8302a7-3309-4936-a657-dea8327fd91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:04 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Volume volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 (6c4a6d7e-a2b4-4be2-88af-e27a0c079275): created successfully
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8302a7-3309-4936-a657-dea8327fd91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Flow 'volume_create_manager' (823701e4-0d05-4c05-9ac6-ad26358877c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:04 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-19877843-edad-4570-bd6a-e964945611a9 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Created volume successfully.
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Acquiring lock "cinder-6c4a6d7e-a2b4-4be2-88af-e27a0c079275-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Lock "cinder-6c4a6d7e-a2b4-4be2-88af-e27a0c079275-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Acquiring lock "cinder-quobyte-6c4a6d7e-a2b4-4be2-88af-e27a0c079275" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Lock "cinder-quobyte-6c4a6d7e-a2b4-4be2-88af-e27a0c079275" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[70392863-2f1d-4515-a490-8724a81da559]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:05 devstack sudo[105656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275
Nov 04 01:13:05 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:05 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275" returned: 0 in 0.345s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:05 devstack sudo[105661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275
Nov 04 01:13:05 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:05 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c4a6d7e-a2b4-4be2-88af-e27a0c079275" returned: 0 in 0.232s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Lock "cinder-quobyte-6c4a6d7e-a2b4-4be2-88af-e27a0c079275" released by "delete_volume" :: held 0.616s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:05 devstack cinder-volume[86660]: WARNING cinder.quota [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:13:05 devstack cinder-volume[86660]: WARNING cinder.quota [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Created reservations ['9ae51caa-14c3-42f5-a3b4-f418e3db82b1', 'f34b2224-9242-4e84-93a9-aa86beced054', '5aca340c-87af-4922-b1d3-4b864efe08ae', 'aecba94f-ef95-4a2f-ada8-77a158b335bd'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:05 devstack sudo[105664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:13:05 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:06 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.230s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:06 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:13:06 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Deleted volume successfully.
Nov 04 01:13:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-493bfdec-72ca-4a8d-877d-d59172f18815 tempest-VolumeAndVolumeTypeFromImageTest-917131245 None] Lock "cinder-6c4a6d7e-a2b4-4be2-88af-e27a0c079275-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (aace99bb-32de-434d-bbeb-45de9add9770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f31d5d0-251a-472c-8dfc-b75415b5ad2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f31d5d0-251a-472c-8dfc-b75415b5ad2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1647073310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4216ebd1-847f-43e9-b65b-182017310578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:10Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9709e9-d75c-4930-8e26-484139a6ef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9709e9-d75c-4930-8e26-484139a6ef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad05f9f-92ad-4570-a251-8d64fd8c5fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad05f9f-92ad-4570-a251-8d64fd8c5fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4216ebd1-847f-43e9-b65b-182017310578', 'volume_name': 'volume-4216ebd1-847f-43e9-b65b-182017310578', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4271660-2bfc-4eef-9e2e-999406749297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4271660-2bfc-4eef-9e2e-999406749297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58395de3-99c8-4ed8-b488-6fdebea9eb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:10 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume 4216ebd1-847f-43e9-b65b-182017310578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4216ebd1-847f-43e9-b65b-182017310578', 'volume_size': 1}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1647073310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4216ebd1-847f-43e9-b65b-182017310578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:10Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Creating volume 4216ebd1-847f-43e9-b65b-182017310578 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:10 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:10 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578 1073741824
Nov 04 01:13:10 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:10 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578 1073741824" returned: 0 in 0.444s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:11 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578
Nov 04 01:13:11 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:11 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578" returned: 0 in 0.264s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58395de3-99c8-4ed8-b488-6fdebea9eb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4216ebd1-847f-43e9-b65b-182017310578', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b01169c-f6f8-4373-8fd3-5bb1ef69308c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:11 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume volume-4216ebd1-847f-43e9-b65b-182017310578 (4216ebd1-847f-43e9-b65b-182017310578): created successfully
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b01169c-f6f8-4373-8fd3-5bb1ef69308c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (aace99bb-32de-434d-bbeb-45de9add9770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-0ac0e033-6382-4962-9d83-024ee841a111 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created volume successfully.
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Creating offline snapshot 4026fd08-1c7e-490c-a589-393145ace82b of volume 4216ebd1-847f-43e9-b65b-182017310578 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[11887777-c216-422c-8e88-19cfce530395]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:11 devstack sudo[105677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578
Nov 04 01:13:11 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:11 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578" returned: 0 in 0.369s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:12 devstack sudo[105682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b 1G
Nov 04 01:13:12 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:12 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b 1G" returned: 0 in 0.408s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4216ebd1-847f-43e9-b65b-182017310578 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:12 devstack sudo[105687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4216ebd1-847f-43e9-b65b-182017310578 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b
Nov 04 01:13:12 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:12 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4216ebd1-847f-43e9-b65b-182017310578 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b" returned: 0 in 0.293s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:12 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b is being set with open permissions: ugo+rw
Nov 04 01:13:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:12 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b
Nov 04 01:13:12 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:12 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b" returned: 0 in 0.262s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:13 devstack sudo[105698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.info
Nov 04 01:13:13 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:13 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.info" returned: 0 in 0.265s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:13 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.info is being set with open permissions: ugo+rw
Nov 04 01:13:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:13 devstack sudo[105704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.info
Nov 04 01:13:13 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:13 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.info" returned: 0 in 0.271s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:13 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d2451263-940e-4517-abd3-01cd13bb855f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Create snapshot completed successfully
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (8b1731e6-091f-4ae8-8782-0325186eed43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dbbd52-e185-491b-90c7-7b11f78f6033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dbbd52-e185-491b-90c7-7b11f78f6033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-186560897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7545516f-ec01-4b5e-a15c-11a945ddf5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:14Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6496c481-ebc7-4375-a318-a5ddae65d083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6496c481-ebc7-4375-a318-a5ddae65d083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c7390f-ab19-4c64-9ab7-ddc684dd26ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c7390f-ab19-4c64-9ab7-ddc684dd26ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7545516f-ec01-4b5e-a15c-11a945ddf5ca', 'volume_name': 'volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed58f976-a767-49be-ad05-589bfd0d7f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed58f976-a767-49be-ad05-589bfd0d7f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296df22d-ee9c-4e5a-870c-4eaa7a1df6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume 7545516f-ec01-4b5e-a15c-11a945ddf5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca', 'volume_size': 1}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-186560897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7545516f-ec01-4b5e-a15c-11a945ddf5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:14Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Creating volume 7545516f-ec01-4b5e-a15c-11a945ddf5ca {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:14 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:14 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca 1073741824
Nov 04 01:13:14 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (5b31b137-7313-483f-9ef9-bb70a130cf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7caba8-4adc-4fde-b991-a2e4594f6e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7caba8-4adc-4fde-b991-a2e4594f6e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817333921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368efb5b-6ccd-4274-9e9c-76a13a173011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:14Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872faa1b-490a-41c2-9a85-2b6ba0caf967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872faa1b-490a-41c2-9a85-2b6ba0caf967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224b813e-cc1a-42e9-80bc-5c258fc0bd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224b813e-cc1a-42e9-80bc-5c258fc0bd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368efb5b-6ccd-4274-9e9c-76a13a173011', 'volume_name': 'volume-368efb5b-6ccd-4274-9e9c-76a13a173011', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b271868-830b-4d60-bd27-b202ef6068c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b271868-830b-4d60-bd27-b202ef6068c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b484f7c-3535-44af-804a-0345ae2c2f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume 368efb5b-6ccd-4274-9e9c-76a13a173011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368efb5b-6ccd-4274-9e9c-76a13a173011', 'volume_size': 1}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:14 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca 1073741824" returned: 0 in 0.541s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:14 devstack sudo[105713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca
Nov 04 01:13:14 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (1f478451-f7e5-4460-a051-c6b084c431b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9178e3-3392-497d-92bf-c152dc4e1f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9178e3-3392-497d-92bf-c152dc4e1f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-534324253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a2dce5-10a6-4893-8298-73d152cb7e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:15Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71030dc9-611b-40cd-aebc-ebfc1b8754f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71030dc9-611b-40cd-aebc-ebfc1b8754f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed594559-850c-404e-89e8-a4127b37ea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed594559-850c-404e-89e8-a4127b37ea29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a2dce5-10a6-4893-8298-73d152cb7e74', 'volume_name': 'volume-d6a2dce5-10a6-4893-8298-73d152cb7e74', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287758dc-dd35-41af-aad4-90df3cdad9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287758dc-dd35-41af-aad4-90df3cdad9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfdde44-b4e6-4c84-8269-534661673e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:14 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume d6a2dce5-10a6-4893-8298-73d152cb7e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a2dce5-10a6-4893-8298-73d152cb7e74', 'volume_size': 1}
Nov 04 01:13:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:15 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca" returned: 0 in 0.301s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.495s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817333921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368efb5b-6ccd-4274-9e9c-76a13a173011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:14Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Creating volume 368efb5b-6ccd-4274-9e9c-76a13a173011 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:15 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296df22d-ee9c-4e5a-870c-4eaa7a1df6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ce8ed1-bd29-4cf4-bb8d-bb4ef40e1c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011 1073741824
Nov 04 01:13:15 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:15 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca (7545516f-ec01-4b5e-a15c-11a945ddf5ca): created successfully
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ce8ed1-bd29-4cf4-bb8d-bb4ef40e1c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (8b1731e6-091f-4ae8-8782-0325186eed43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:15 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-b67d5852-08d0-4945-8a48-ede510585de1 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created volume successfully.
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (88f41d41-aa65-4b4f-b7b3-e05289b1fe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5d354d-6802-47b4-b1d0-496985d8ba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5d354d-6802-47b4-b1d0-496985d8ba44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-979974504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d07bc73-472a-4463-a34d-bcc0660db146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:15Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2787c8-c95d-4b32-a9fb-9a9264df95e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2787c8-c95d-4b32-a9fb-9a9264df95e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c1f1e4-20de-44fa-a566-27d4554d5f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c1f1e4-20de-44fa-a566-27d4554d5f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d07bc73-472a-4463-a34d-bcc0660db146', 'volume_name': 'volume-5d07bc73-472a-4463-a34d-bcc0660db146', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308b1868-a7db-4a8e-8460-f134e7592b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308b1868-a7db-4a8e-8460-f134e7592b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787e6ed2-b284-4a94-b40a-44d97434c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume 5d07bc73-472a-4463-a34d-bcc0660db146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d07bc73-472a-4463-a34d-bcc0660db146', 'volume_size': 1}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (f69af80e-92d4-43ed-a229-db7b4b730ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:15 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adb56aa-c290-4a8e-aebf-414ef4cf7395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011 1073741824" returned: 0 in 0.524s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adb56aa-c290-4a8e-aebf-414ef4cf7395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1395448246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9875d6f5-1abf-4559-ab34-6c17e1ca836f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:16Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ede0675-8b70-4dea-ab69-f8bde27999a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ede0675-8b70-4dea-ab69-f8bde27999a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e846d7-1260-4661-938f-1d30ea9e00e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e846d7-1260-4661-938f-1d30ea9e00e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9875d6f5-1abf-4559-ab34-6c17e1ca836f', 'volume_name': 'volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d783a5-8a96-4107-ad6e-19514de3fcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d783a5-8a96-4107-ad6e-19514de3fcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98554db8-09b5-445a-8734-ef6bf5fa598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume 9875d6f5-1abf-4559-ab34-6c17e1ca836f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f', 'volume_size': 1}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:15 devstack sudo[105722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011
Nov 04 01:13:15 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:15 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011" returned: 0 in 0.243s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.997s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-534324253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a2dce5-10a6-4893-8298-73d152cb7e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:15Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Creating volume d6a2dce5-10a6-4893-8298-73d152cb7e74 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:15 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b484f7c-3535-44af-804a-0345ae2c2f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368efb5b-6ccd-4274-9e9c-76a13a173011', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:15 devstack sudo[105725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74 1073741824
Nov 04 01:13:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8234dd-2d84-44a1-a86b-5595668bc3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:15 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:16 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume volume-368efb5b-6ccd-4274-9e9c-76a13a173011 (368efb5b-6ccd-4274-9e9c-76a13a173011): created successfully
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8234dd-2d84-44a1-a86b-5595668bc3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (5b31b137-7313-483f-9ef9-bb70a130cf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:16 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-89ee7f3f-3efa-493e-b5a8-9f7e6628eb97 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created volume successfully.
Nov 04 01:13:16 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74 1073741824" returned: 0 in 0.457s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:16 devstack sudo[105766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74
Nov 04 01:13:16 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:16 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74" returned: 0 in 0.255s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-979974504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d07bc73-472a-4463-a34d-bcc0660db146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:15Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Creating volume 5d07bc73-472a-4463-a34d-bcc0660db146 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:16 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfdde44-b4e6-4c84-8269-534661673e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a2dce5-10a6-4893-8298-73d152cb7e74', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:16 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146 1073741824
Nov 04 01:13:16 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a32a51-abf0-464d-9b55-100c4d1db2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:16 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume volume-d6a2dce5-10a6-4893-8298-73d152cb7e74 (d6a2dce5-10a6-4893-8298-73d152cb7e74): created successfully
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a32a51-abf0-464d-9b55-100c4d1db2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (1f478451-f7e5-4460-a051-c6b084c431b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:16 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7b62bcda-e129-48fd-a7ac-121f7af4ad76 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created volume successfully.
Nov 04 01:13:17 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146 1073741824" returned: 0 in 0.414s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:17 devstack sudo[105774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146
Nov 04 01:13:17 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:17 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146" returned: 0 in 0.245s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.739s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1395448246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9875d6f5-1abf-4559-ab34-6c17e1ca836f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5e2f40ea944a29e022a29a7b887b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:16Z,use_quota=True,user_id='1de90b2cfdbb4eccaa2266af2680ffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Creating volume 9875d6f5-1abf-4559-ab34-6c17e1ca836f {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:17 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787e6ed2-b284-4a94-b40a-44d97434c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d07bc73-472a-4463-a34d-bcc0660db146', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72caacf8-ca86-4287-bd60-d8261f41f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:17 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f 1073741824
Nov 04 01:13:17 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:17 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume volume-5d07bc73-472a-4463-a34d-bcc0660db146 (5d07bc73-472a-4463-a34d-bcc0660db146): created successfully
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72caacf8-ca86-4287-bd60-d8261f41f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (88f41d41-aa65-4b4f-b7b3-e05289b1fe5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9d2acfb8-252c-4757-8993-53d4d510ea4f tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created volume successfully.
Nov 04 01:13:17 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f 1073741824" returned: 0 in 0.470s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:17 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f
Nov 04 01:13:17 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:18 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f" returned: 0 in 0.244s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:13:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98554db8-09b5-445a-8734-ef6bf5fa598a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df516548-bc68-4c53-8cec-ab472a8f02e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:18 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Volume volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f (9875d6f5-1abf-4559-ab34-6c17e1ca836f): created successfully
Nov 04 01:13:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df516548-bc68-4c53-8cec-ab472a8f02e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Flow 'volume_create_manager' (f69af80e-92d4-43ed-a229-db7b4b730ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:18 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-aaefcf72-c30c-47cd-98ab-89c2c561163b tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created volume successfully.
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-9875d6f5-1abf-4559-ab34-6c17e1ca836f-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-9875d6f5-1abf-4559-ab34-6c17e1ca836f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-quobyte-9875d6f5-1abf-4559-ab34-6c17e1ca836f" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-9875d6f5-1abf-4559-ab34-6c17e1ca836f" acquired by "delete_volume" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4e722f-1b5f-40b0-8e06-510f78a0c6b4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:19 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f
Nov 04 01:13:19 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:19 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f" returned: 0 in 0.358s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:19 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f
Nov 04 01:13:19 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:19 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9875d6f5-1abf-4559-ab34-6c17e1ca836f" returned: 0 in 0.240s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-9875d6f5-1abf-4559-ab34-6c17e1ca836f" released by "delete_volume" :: held 0.644s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created reservations ['882b5863-a5f5-474e-a5d2-e09cbb5e3c60', 'f8683964-73c5-4042-b35e-e7378f97a006', '25d064c2-9c4b-4f2b-92fe-fb4228d67396', '705e9f4d-048f-49c9-b58e-7bf6913c33ac'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:19 devstack sudo[105793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:13:19 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:20 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.242s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:13:20 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Deleted volume successfully.
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dfc4e2f1-00ed-45ad-a76a-0f1f1cc9f003 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-9875d6f5-1abf-4559-ab34-6c17e1ca836f-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-5d07bc73-472a-4463-a34d-bcc0660db146-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-5d07bc73-472a-4463-a34d-bcc0660db146-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-quobyte-5d07bc73-472a-4463-a34d-bcc0660db146" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-5d07bc73-472a-4463-a34d-bcc0660db146" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeec962e-ceac-4aa3-ae77-7b64c75911c5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:20 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146
Nov 04 01:13:20 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:20 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146" returned: 0 in 0.348s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:20 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146
Nov 04 01:13:20 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:20 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-5d07bc73-472a-4463-a34d-bcc0660db146" returned: 0 in 0.234s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-5d07bc73-472a-4463-a34d-bcc0660db146" released by "delete_volume" :: held 0.628s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created reservations ['dbb15548-6e8a-4ebc-8ef0-a9799f845338', '141ee8d4-116a-4aff-ae2a-7bce948d7f7a', '1a02233a-abea-4431-9756-eac9dc7bf86f', '2d4678f3-7918-43e8-b08d-b6d43e17c852'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:20 devstack sudo[105805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:13:20 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:21 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.243s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:21 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:13:21 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Deleted volume successfully.
Nov 04 01:13:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3934a447-69e1-411f-b22e-5afc135eef6e tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-5d07bc73-472a-4463-a34d-bcc0660db146-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-d6a2dce5-10a6-4893-8298-73d152cb7e74-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-d6a2dce5-10a6-4893-8298-73d152cb7e74-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-quobyte-d6a2dce5-10a6-4893-8298-73d152cb7e74" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-d6a2dce5-10a6-4893-8298-73d152cb7e74" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:21 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e740e798-add2-4577-a0f2-6b8180f5ad40]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:21 devstack sudo[105808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74
Nov 04 01:13:21 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:21 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74" returned: 0 in 0.359s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:21 devstack sudo[105813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74
Nov 04 01:13:21 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:22 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-d6a2dce5-10a6-4893-8298-73d152cb7e74" returned: 0 in 0.243s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-d6a2dce5-10a6-4893-8298-73d152cb7e74" released by "delete_volume" :: held 0.643s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created reservations ['2a00a16e-8665-4996-8364-3341e6e725e8', 'fc10a4e0-0a4d-4635-9b51-143f3c0e10f1', '06b64d76-68f9-409b-a8de-ae6c8e24495a', 'a069d7e8-c20e-401a-8b4f-3c55338e075b'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:22 devstack sudo[105816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:13:22 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:22 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.236s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:13:22 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Deleted volume successfully.
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a41ae57-3e30-4c8d-a413-e74dceffb7f5 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-d6a2dce5-10a6-4893-8298-73d152cb7e74-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-368efb5b-6ccd-4274-9e9c-76a13a173011-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-368efb5b-6ccd-4274-9e9c-76a13a173011-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-quobyte-368efb5b-6ccd-4274-9e9c-76a13a173011" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-368efb5b-6ccd-4274-9e9c-76a13a173011" acquired by "delete_volume" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e5bd8c-3754-4c63-bad1-20788f60c125]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:22 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011
Nov 04 01:13:22 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:22 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011" returned: 0 in 0.346s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:22 devstack sudo[105824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011
Nov 04 01:13:22 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:23 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-368efb5b-6ccd-4274-9e9c-76a13a173011" returned: 0 in 0.246s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-368efb5b-6ccd-4274-9e9c-76a13a173011" released by "delete_volume" :: held 0.633s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created reservations ['9699f331-6663-41fc-8fcd-b07f339093db', '86a23c43-b3a4-480e-8b32-274ad7f6affe', '3d84d8f0-2513-473d-9f83-69b31cdb4fec', '16dbc669-a182-4abc-bfec-df54384f81f2'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:23 devstack sudo[105827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:13:23 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:23 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.238s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:13:23 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Deleted volume successfully.
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-3ac3bc96-3454-4cd7-8612-50929302d757 tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-368efb5b-6ccd-4274-9e9c-76a13a173011-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-7545516f-ec01-4b5e-a15c-11a945ddf5ca-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-7545516f-ec01-4b5e-a15c-11a945ddf5ca-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-quobyte-7545516f-ec01-4b5e-a15c-11a945ddf5ca" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-7545516f-ec01-4b5e-a15c-11a945ddf5ca" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[072ed1c6-eedb-4be8-b1fc-a0402ed4bc28]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:23 devstack sudo[105830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca
Nov 04 01:13:23 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:24 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca" returned: 0 in 0.350s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:24 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca
Nov 04 01:13:24 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:24 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7545516f-ec01-4b5e-a15c-11a945ddf5ca" returned: 0 in 0.242s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-7545516f-ec01-4b5e-a15c-11a945ddf5ca" released by "delete_volume" :: held 0.633s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created reservations ['d262d9e7-a701-45f5-bf32-f86f441a8432', '74dfa0a1-81db-4425-b01d-73cc9035abdd', 'a201cf55-18e7-4a39-93f5-99be4df6fd7a', 'd40cf474-61e6-4668-bbb3-30ff6247d559'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:24 devstack sudo[105838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:13:24 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:24 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.241s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:13:24 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Deleted volume successfully.
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-844cb041-ad0e-4eb0-9491-e510f02b705a tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-7545516f-ec01-4b5e-a15c-11a945ddf5ca-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-4026fd08-1c7e-490c-a589-393145ace82b-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-4026fd08-1c7e-490c-a589-393145ace82b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-quobyte-4216ebd1-847f-43e9-b65b-182017310578" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-4216ebd1-847f-43e9-b65b-182017310578" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-quobyte-4026fd08-1c7e-490c-a589-393145ace82b" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-4026fd08-1c7e-490c-a589-393145ace82b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Deleting offline snapshot 4026fd08-1c7e-490c-a589-393145ace82b of volume 4216ebd1-847f-43e9-b65b-182017310578 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] snapshot_file for this snap is: volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[46badf55-2050-46ea-973b-a58b18da203a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:24 devstack sudo[105841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b
Nov 04 01:13:24 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:25 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b" returned: 0 in 0.347s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4216ebd1-847f-43e9-b65b-182017310578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:13:25 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[959aef09-4ed4-4c33-a23a-6a0248016eb0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:25 devstack sudo[105846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578
Nov 04 01:13:25 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:25 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578" returned: 0 in 0.356s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:25 devstack sudo[105851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b
Nov 04 01:13:25 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:25 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b" returned: 0 in 0.328s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:25 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b
Nov 04 01:13:25 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:26 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578.4026fd08-1c7e-490c-a589-393145ace82b" returned: 0 in 0.253s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-4026fd08-1c7e-490c-a589-393145ace82b" released by "_delete_snapshot" :: held 1.390s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-4216ebd1-847f-43e9-b65b-182017310578" released by "delete_snapshot" :: held 1.412s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:26 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created reservations ['b88daa53-4769-484f-a2ec-5f71b8b514e8', '55717ade-6361-45f7-b06f-a746cfdf5ae8', 'c0417a48-5027-491e-8b84-6d6aaeec1316', '67e54330-c694-4085-97d4-8f18a9a5cae4'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:13:26 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Delete snapshot completed successfully.
Nov 04 01:13:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-35a89d7f-bae1-45a6-aa15-ec2788572ffa tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-4026fd08-1c7e-490c-a589-393145ace82b-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-4216ebd1-847f-43e9-b65b-182017310578-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-4216ebd1-847f-43e9-b65b-182017310578-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "cinder-quobyte-4216ebd1-847f-43e9-b65b-182017310578" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-4216ebd1-847f-43e9-b65b-182017310578" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e220f87c-5cbc-46c6-ac55-f17b15e4ce45]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:27 devstack sudo[105860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578
Nov 04 01:13:27 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:27 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578" returned: 0 in 0.368s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:27 devstack sudo[105865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578
Nov 04 01:13:27 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:27 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4216ebd1-847f-43e9-b65b-182017310578" returned: 0 in 0.277s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-quobyte-4216ebd1-847f-43e9-b65b-182017310578" released by "delete_volume" :: held 0.714s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Created reservations ['e291a229-df49-4678-bd3e-fc7374c98085', '9807e874-29fb-46f8-a6ca-5919d90bc58b', '872fc695-fdc1-4410-a673-b0c87d16dea3', '947508ae-2f4c-4bce-bcad-7a2544205020'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:27 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:13:27 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:28 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.265s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:28 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:13:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Deleted volume successfully.
Nov 04 01:13:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-28150182-68d5-440d-852e-e5dfb1beb79d tempest-CreateVolumesFromSnapshotTest-1049440538 None] Lock "cinder-4216ebd1-847f-43e9-b65b-182017310578-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:32 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Flow 'volume_create_manager' (af82d819-e62c-4122-a410-b2713e5faad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd72a591-14aa-4647-bb80-dfc07238103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd72a591-14aa-4647-bb80-dfc07238103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790eea07-d751-4ad4-9b68-5eb794a14187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5123b9220d6648a486ca5ad1572b00df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:33Z,use_quota=True,user_id='c6c89b5a1cba4919a7a9180e20dd32eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add58780-655f-4860-bf11-c567f2c75131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add58780-655f-4860-bf11-c567f2c75131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:32 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122f2660-bf44-4ad8-80d2-0d5d156c697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:32 devstack cinder-volume[86660]: DEBUG cinder.image.glance [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Creating Keystone auth plugin from conf {{(pid=86660) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 01:13:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122f2660-bf44-4ad8-80d2-0d5d156c697b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '790eea07-d751-4ad4-9b68-5eb794a14187', 'volume_name': 'volume-790eea07-d751-4ad4-9b68-5eb794a14187', 'volume_size': 1, 'image_id': '3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd04b6c67b11af98dad308604e70b5f9a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5123b9220d6648a486ca5ad1572b00df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc4c597a11959918e7cb578038333c84f4e803d4dbdb730e0f820927c05a0407b7ab12c0ff22872f974710060d64f6eed0d86e497b7fafc91f3a181a284ccde9', 'id': '3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'created_at': datetime.datetime(2026, 11, 4, 0, 13, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 13, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f437e88-40cd-4d6a-bc74-e6675bac31c1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547da99a0>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3ae557-13dd-4c3e-afb2-d76bed789161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3ae557-13dd-4c3e-afb2-d76bed789161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:33 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30dde965-70ca-43f1-a47e-2ab3b1d9b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:33 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Volume 790eea07-d751-4ad4-9b68-5eb794a14187: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-790eea07-d751-4ad4-9b68-5eb794a14187', 'volume_size': 1, 'image_id': '3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd04b6c67b11af98dad308604e70b5f9a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5123b9220d6648a486ca5ad1572b00df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc4c597a11959918e7cb578038333c84f4e803d4dbdb730e0f820927c05a0407b7ab12c0ff22872f974710060d64f6eed0d86e497b7fafc91f3a181a284ccde9', 'id': '3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'created_at': datetime.datetime(2026, 11, 4, 0, 13, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 13, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f437e88-40cd-4d6a-bc74-e6675bac31c1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547da99a0>}
Nov 04 01:13:33 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Trying to clone 790eea07-d751-4ad4-9b68-5eb794a14187 from image 3f437e88-40cd-4d6a-bc74-e6675bac31c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'metadata': {}}]). {{(pid=86660) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 01:13:33 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 01:13:33 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Image download 0.00 MB at 0.00 MB/s
Nov 04 01:13:33 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4290ad34-5fe1-4007-b1f4-8fbb40956fd8]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:33 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD
Nov 04 01:13:33 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:33 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:33 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD
Nov 04 01:13:33 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:34 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD" returned: 1 in 0.328s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Temporary image 3f437e88-40cd-4d6a-bc74-e6675bac31c1 is fetched for user c6c89b5a1cba4919a7a9180e20dd32eb. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df438af-64cc-4e1f-be83-a5ab97714d50]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:34 devstack sudo[105884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD
Nov 04 01:13:34 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:34 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:34 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD
Nov 04 01:13:34 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:34 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790eea07-d751-4ad4-9b68-5eb794a14187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5123b9220d6648a486ca5ad1572b00df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:33Z,use_quota=True,user_id='c6c89b5a1cba4919a7a9180e20dd32eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Creating volume 790eea07-d751-4ad4-9b68-5eb794a14187 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:34 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:34 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187 1073741824
Nov 04 01:13:34 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:35 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187 1073741824" returned: 0 in 0.421s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:35 devstack sudo[105899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187
Nov 04 01:13:35 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:35 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187" returned: 0 in 0.242s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:13:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:35 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Attempting download of 3f437e88-40cd-4d6a-bc74-e6675bac31c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'metadata': {}}])) to volume 790eea07-d751-4ad4-9b68-5eb794a14187. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 01:13:35 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdcb4d0-353c-4588-b33f-dfc25fd897e4]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f437e88-40cd-4d6a-bc74-e6675bac31c1_qhnhz05h {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:35 devstack sudo[105902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f437e88-40cd-4d6a-bc74-e6675bac31c1_qhnhz05h
Nov 04 01:13:35 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:35 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f437e88-40cd-4d6a-bc74-e6675bac31c1_qhnhz05h" returned: 0 in 0.341s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f437e88-40cd-4d6a-bc74-e6675bac31c1_qhnhz05h {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:35 devstack sudo[105906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f437e88-40cd-4d6a-bc74-e6675bac31c1_qhnhz05h
Nov 04 01:13:35 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:36 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f437e88-40cd-4d6a-bc74-e6675bac31c1_qhnhz05h" returned: 1 in 0.326s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f437e88-40cd-4d6a-bc74-e6675bac31c1_qhnhz05h' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:13:36 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2effd16-559a-454e-b61c-133383032b2c]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:36 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD
Nov 04 01:13:36 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:36 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:36 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD
Nov 04 01:13:36 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:36 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD" returned: 1 in 0.308s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:13:36 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] 3f437e88-40cd-4d6a-bc74-e6675bac31c1 was raw, converting to qcow2 {{(pid=86660) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 01:13:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:36 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187
Nov 04 01:13:36 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:37 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187" returned: 0 in 0.431s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f437e88-40cd-4d6a-bc74-e6675bac31c1__9d11_vsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:13:37 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Converted 0.00 MB image at 0.00 MB/s
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:37 devstack sudo[105925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187 1G
Nov 04 01:13:37 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:37 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187 1G" returned: 0 in 0.315s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Downloaded image 3f437e88-40cd-4d6a-bc74-e6675bac31c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'metadata': {}}])) to volume 790eea07-d751-4ad4-9b68-5eb794a14187 successfully. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Temporary image 3f437e88-40cd-4d6a-bc74-e6675bac31c1 for user c6c89b5a1cba4919a7a9180e20dd32eb is deleted. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Marking volume 790eea07-d751-4ad4-9b68-5eb794a14187 as bootable. {{(pid=86660) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Copying metadata from image 3f437e88-40cd-4d6a-bc74-e6675bac31c1 to 790eea07-d751-4ad4-9b68-5eb794a14187. {{(pid=86660) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Creating volume glance metadata for volume 790eea07-d751-4ad4-9b68-5eb794a14187 backed by image 3f437e88-40cd-4d6a-bc74-e6675bac31c1 with: {'image_id': '3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd04b6c67b11af98dad308604e70b5f9a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86660) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30dde965-70ca-43f1-a47e-2ab3b1d9b540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790eea07-d751-4ad4-9b68-5eb794a14187', 'volume_size': 1, 'image_id': '3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd04b6c67b11af98dad308604e70b5f9a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5123b9220d6648a486ca5ad1572b00df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc4c597a11959918e7cb578038333c84f4e803d4dbdb730e0f820927c05a0407b7ab12c0ff22872f974710060d64f6eed0d86e497b7fafc91f3a181a284ccde9', 'id': '3f437e88-40cd-4d6a-bc74-e6675bac31c1', 'created_at': datetime.datetime(2026, 11, 4, 0, 13, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 13, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f437e88-40cd-4d6a-bc74-e6675bac31c1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547da99a0>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c909454e-175b-4c3f-bdaa-52cba3c08e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:37 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Volume volume-790eea07-d751-4ad4-9b68-5eb794a14187 (790eea07-d751-4ad4-9b68-5eb794a14187): created successfully
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c909454e-175b-4c3f-bdaa-52cba3c08e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Flow 'volume_create_manager' (af82d819-e62c-4122-a410-b2713e5faad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:37 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-be0ae785-1418-4c70-b011-3b27478f55db tempest-VolumeImageDependencyTests-1987847637 None] Created volume successfully.
Nov 04 01:13:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Acquiring lock "cinder-790eea07-d751-4ad4-9b68-5eb794a14187-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Lock "cinder-790eea07-d751-4ad4-9b68-5eb794a14187-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Acquiring lock "cinder-quobyte-790eea07-d751-4ad4-9b68-5eb794a14187" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:13:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Lock "cinder-quobyte-790eea07-d751-4ad4-9b68-5eb794a14187" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:13:38 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eca24e3-ec0a-472c-833e-594a8cdd7c6d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:13:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:38 devstack sudo[105930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187
Nov 04 01:13:38 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:38 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187" returned: 0 in 0.360s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:38 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187
Nov 04 01:13:38 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:38 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-790eea07-d751-4ad4-9b68-5eb794a14187" returned: 0 in 0.248s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Lock "cinder-quobyte-790eea07-d751-4ad4-9b68-5eb794a14187" released by "delete_volume" :: held 0.646s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:39 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Created reservations ['1f1e041a-6eea-4c92-9a6b-c5546ab65a03', '7edac3ac-5c56-4436-8a26-74c1010fdb20', '2711d40d-2622-4f3a-b1a5-ac8374c3693e', '4b5f1152-8dee-44b6-8d40-adb53bcee3f7'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:13:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:39 devstack sudo[105938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:13:39 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:39 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.241s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:39 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:13:39 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Deleted volume successfully.
Nov 04 01:13:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84f91927-fb6c-4c8c-a534-b419c75915b8 tempest-VolumeImageDependencyTests-1987847637 None] Lock "cinder-790eea07-d751-4ad4-9b68-5eb794a14187-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:13:49 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=77,cinder:UPDATE=96,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:13:49 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=76,cinder:INSERT=34,cinder:UPDATE=100,cinder:DELETE=8 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:51 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:13:51 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:51 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.250s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:13:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Flow 'volume_create_manager' (0543ebf7-0a6b-4055-aafc-6e9687e26b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a817f417-9b27-4407-90be-096cba454cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a817f417-9b27-4407-90be-096cba454cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abe6d4a-4dd6-4908-a7de-771875616158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ea984a038c4fd7b1d1e9b5e436dbcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:56Z,use_quota=True,user_id='04ca6b3f09b24100b1c5a8042432fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63c64c6-219f-42ec-9d31-55b9edbb7252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63c64c6-219f-42ec-9d31-55b9edbb7252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de30c13d-4726-4a18-a024-ba5c26f37fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de30c13d-4726-4a18-a024-ba5c26f37fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abe6d4a-4dd6-4908-a7de-771875616158', 'volume_name': 'volume-7abe6d4a-4dd6-4908-a7de-771875616158', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ddb5b4a-1e6e-4b1b-8270-25df96830c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ddb5b4a-1e6e-4b1b-8270-25df96830c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5bac889-9e7f-4ca6-bb81-94428b33dc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Volume 7abe6d4a-4dd6-4908-a7de-771875616158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abe6d4a-4dd6-4908-a7de-771875616158', 'volume_size': 1}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abe6d4a-4dd6-4908-a7de-771875616158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ea984a038c4fd7b1d1e9b5e436dbcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:56Z,use_quota=True,user_id='04ca6b3f09b24100b1c5a8042432fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Creating volume 7abe6d4a-4dd6-4908-a7de-771875616158 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:56 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:56 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158 1073741824
Nov 04 01:13:56 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Flow 'volume_create_manager' (e9eaaafd-ecaa-4d19-8ccd-d24047a8519d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26135f3e-0139-49b4-ba4a-80c4605e58dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26135f3e-0139-49b4-ba4a-80c4605e58dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-571349586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e7f48e-9553-4a68-b361-de897fd605b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b50612e014a462e808f234ba663820b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:56Z,use_quota=True,user_id='21eea2ff988a4455abbe1964374c2869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc54f8f-640f-40a5-8e82-3e09976ca16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc54f8f-640f-40a5-8e82-3e09976ca16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e556b1a5-c5cf-462d-aff5-41829b81a545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e556b1a5-c5cf-462d-aff5-41829b81a545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e7f48e-9553-4a68-b361-de897fd605b9', 'volume_name': 'volume-30e7f48e-9553-4a68-b361-de897fd605b9', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0307e55-84db-49d6-b6d3-bef424277554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0307e55-84db-49d6-b6d3-bef424277554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d32bc7e-837b-4da9-84fe-1e55394d345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Volume 30e7f48e-9553-4a68-b361-de897fd605b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e7f48e-9553-4a68-b361-de897fd605b9', 'volume_size': 1}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Flow 'volume_create_manager' (f8885d04-c3b8-4aa3-b695-75cd5e9a89b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdf3151-bdbd-4cfc-bf40-6cd2cfee6867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdf3151-bdbd-4cfc-bf40-6cd2cfee6867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1478279583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dba709-9104-4415-a613-bcc681098992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b50612e014a462e808f234ba663820b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:57Z,use_quota=True,user_id='21eea2ff988a4455abbe1964374c2869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81f8989-8fa6-43b0-9309-97f6d1899e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81f8989-8fa6-43b0-9309-97f6d1899e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcbe050-2011-4013-9d07-07e59c319f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcbe050-2011-4013-9d07-07e59c319f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2dba709-9104-4415-a613-bcc681098992', 'volume_name': 'volume-a2dba709-9104-4415-a613-bcc681098992', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3336d307-cb53-49f8-a3fe-82648b20b7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3336d307-cb53-49f8-a3fe-82648b20b7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f197fe82-1ebe-4639-8b31-9d323e8fc91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:56 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Volume a2dba709-9104-4415-a613-bcc681098992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2dba709-9104-4415-a613-bcc681098992', 'volume_size': 1}
Nov 04 01:13:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:57 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158 1073741824" returned: 0 in 0.732s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:57 devstack sudo[105988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158
Nov 04 01:13:57 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (6c4c6cb5-2a35-46b1-abec-a68bfe91643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03dfac0-20b8-4ee6-9e6f-963ae6b53400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03dfac0-20b8-4ee6-9e6f-963ae6b53400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-871605354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f33dfc-080f-4d37-b1c2-d338492436bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:57Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7200d9f1-a55e-4a07-9ca2-319fbd8fc396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7200d9f1-a55e-4a07-9ca2-319fbd8fc396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75584f00-0bba-47c4-aa42-0437dc18db05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75584f00-0bba-47c4-aa42-0437dc18db05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f33dfc-080f-4d37-b1c2-d338492436bb', 'volume_name': 'volume-f0f33dfc-080f-4d37-b1c2-d338492436bb', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b964992d-e66a-4267-bc0c-197ae34e018e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b964992d-e66a-4267-bc0c-197ae34e018e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5800aede-0f54-456c-a17c-18d17448f111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume f0f33dfc-080f-4d37-b1c2-d338492436bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f33dfc-080f-4d37-b1c2-d338492436bb', 'volume_size': 1}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Flow 'volume_create_manager' (c8b83ede-cf0e-4989-95d8-35dcce3946e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b5ddb8-04e9-4c56-a1f9-41d02e9e1970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158" returned: 0 in 0.442s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.040s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-571349586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e7f48e-9553-4a68-b361-de897fd605b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b50612e014a462e808f234ba663820b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:56Z,use_quota=True,user_id='21eea2ff988a4455abbe1964374c2869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Creating volume 30e7f48e-9553-4a68-b361-de897fd605b9 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:57 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b5ddb8-04e9-4c56-a1f9-41d02e9e1970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1857238781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bef64d-2ced-442e-92af-af27939a48ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b50612e014a462e808f234ba663820b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:57Z,use_quota=True,user_id='21eea2ff988a4455abbe1964374c2869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5c9432-97cc-4992-8d37-ade45792c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack sudo[105991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9 1073741824
Nov 04 01:13:57 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5c9432-97cc-4992-8d37-ade45792c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d087dac-bab0-4996-af54-459408c7185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d087dac-bab0-4996-af54-459408c7185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6bef64d-2ced-442e-92af-af27939a48ef', 'volume_name': 'volume-c6bef64d-2ced-442e-92af-af27939a48ef', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0d558d-6e85-4732-aac3-55b3599962ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0d558d-6e85-4732-aac3-55b3599962ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15844819-57b8-45c8-abd7-0839188a1d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Volume c6bef64d-2ced-442e-92af-af27939a48ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6bef64d-2ced-442e-92af-af27939a48ef', 'volume_size': 1}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5bac889-9e7f-4ca6-bb81-94428b33dc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abe6d4a-4dd6-4908-a7de-771875616158', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fa97b7-50e6-4132-ac09-5ffce65689d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Flow 'volume_create_manager' (a0649165-9994-4a20-a7d8-15a6009af291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e9158a-a4d5-458e-b3e0-2f95f5b92e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e9158a-a4d5-458e-b3e0-2f95f5b92e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1515314294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc74f5f6-c2c3-4ebb-8b26-97b00e385f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b50612e014a462e808f234ba663820b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:58Z,use_quota=True,user_id='21eea2ff988a4455abbe1964374c2869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2faecf39-5d46-470a-a47e-8709c3da5c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2faecf39-5d46-470a-a47e-8709c3da5c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3901abec-f586-4d39-81a6-9a6b6bf075ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3901abec-f586-4d39-81a6-9a6b6bf075ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc74f5f6-c2c3-4ebb-8b26-97b00e385f19', 'volume_name': 'volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75048a3a-4cb6-416c-95b8-b1302efbc0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75048a3a-4cb6-416c-95b8-b1302efbc0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbd6d20-12dc-4f90-b55c-855e30bd7ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:57 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Volume dc74f5f6-c2c3-4ebb-8b26-97b00e385f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19', 'volume_size': 1}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:57 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Volume volume-7abe6d4a-4dd6-4908-a7de-771875616158 (7abe6d4a-4dd6-4908-a7de-771875616158): created successfully
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fa97b7-50e6-4132-ac09-5ffce65689d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:57 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Flow 'volume_create_manager' (0543ebf7-0a6b-4055-aafc-6e9687e26b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-dbd1ed43-aa15-4dca-b646-441c57ea10fc tempest-CinderUnicodeTest-894693979 None] Created volume successfully.
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Flow 'volume_create_manager' (5bd6ecd4-d329-4ee0-8d39-34a1ba7e0b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fe1522-d618-49a3-bb6b-743905e7a093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:58 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fe1522-d618-49a3-bb6b-743905e7a093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1132015339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfdd598-0dc9-4145-98ac-d09e7b492430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b50612e014a462e808f234ba663820b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:58Z,use_quota=True,user_id='21eea2ff988a4455abbe1964374c2869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aceb94-aa38-4b11-8f9d-97e6a5e8bf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aceb94-aa38-4b11-8f9d-97e6a5e8bf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6502e0c-35a5-481f-81b3-a9122bb47389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6502e0c-35a5-481f-81b3-a9122bb47389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dfdd598-0dc9-4145-98ac-d09e7b492430', 'volume_name': 'volume-4dfdd598-0dc9-4145-98ac-d09e7b492430', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c9a28b-cea3-43a7-9d17-f96adf5a4542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c9a28b-cea3-43a7-9d17-f96adf5a4542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6819e7-846b-41c0-b892-a1ee313c6576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:58 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Volume 4dfdd598-0dc9-4145-98ac-d09e7b492430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dfdd598-0dc9-4145-98ac-d09e7b492430', 'volume_size': 1}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9 1073741824" returned: 0 in 0.623s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:58 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9
Nov 04 01:13:58 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:58 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9" returned: 0 in 0.278s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.788s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1478279583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dba709-9104-4415-a613-bcc681098992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b50612e014a462e808f234ba663820b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:57Z,use_quota=True,user_id='21eea2ff988a4455abbe1964374c2869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Creating volume a2dba709-9104-4415-a613-bcc681098992 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:58 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d32bc7e-837b-4da9-84fe-1e55394d345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e7f48e-9553-4a68-b361-de897fd605b9', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:58 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992 1073741824
Nov 04 01:13:58 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec460b3f-3dbf-48cf-895d-ba10f84ba610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:58 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Volume volume-30e7f48e-9553-4a68-b361-de897fd605b9 (30e7f48e-9553-4a68-b361-de897fd605b9): created successfully
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec460b3f-3dbf-48cf-895d-ba10f84ba610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Flow 'volume_create_manager' (e9eaaafd-ecaa-4d19-8ccd-d24047a8519d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:58 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fae4d1bf-aa29-4ae2-817e-529644be649f tempest-CreateVolumesFromImageTest-1738492721 None] Created volume successfully.
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Flow 'volume_create_manager' (b6ab64b3-2090-4296-9943-ef0ace4f9814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8485ac8c-70a1-4bfd-b2ab-1515636d687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8485ac8c-70a1-4bfd-b2ab-1515636d687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1809953452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a8cb7c-453e-4275-9e1b-6302a18e4c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ea984a038c4fd7b1d1e9b5e436dbcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:59Z,use_quota=True,user_id='04ca6b3f09b24100b1c5a8042432fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b5703a-e151-49f0-85f6-c898942d4280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b5703a-e151-49f0-85f6-c898942d4280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ebe091-f9bd-4693-a28b-de36ffd7da5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ebe091-f9bd-4693-a28b-de36ffd7da5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a8cb7c-453e-4275-9e1b-6302a18e4c4a', 'volume_name': 'volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60cd3c8-1043-43d3-88e9-af83bf509042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60cd3c8-1043-43d3-88e9-af83bf509042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ebbfe4-d61d-4e51-853e-49f76e17503c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:59 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Volume 21a8cb7c-453e-4275-9e1b-6302a18e4c4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a', 'volume_size': 1}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:59 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992 1073741824" returned: 0 in 0.534s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:59 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992
Nov 04 01:13:59 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:59 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992" returned: 0 in 0.263s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.921s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-871605354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f33dfc-080f-4d37-b1c2-d338492436bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:57Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Creating volume f0f33dfc-080f-4d37-b1c2-d338492436bb {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:13:59 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:13:59 devstack sudo[106009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb 1073741824
Nov 04 01:13:59 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f197fe82-1ebe-4639-8b31-9d323e8fc91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2dba709-9104-4415-a613-bcc681098992', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab952efb-e6f4-4182-b787-6f87b1e30639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:13:59 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Volume volume-a2dba709-9104-4415-a613-bcc681098992 (a2dba709-9104-4415-a613-bcc681098992): created successfully
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab952efb-e6f4-4182-b787-6f87b1e30639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:13:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Flow 'volume_create_manager' (f8885d04-c3b8-4aa3-b695-75cd5e9a89b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:13:59 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-09e55c5a-1ae5-4185-823b-507289f976ea tempest-CreateVolumesFromImageTest-1738492721 None] Created volume successfully.
Nov 04 01:14:00 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb 1073741824" returned: 0 in 0.492s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:00 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb
Nov 04 01:14:00 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:00 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb" returned: 0 in 0.272s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.557s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1857238781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bef64d-2ced-442e-92af-af27939a48ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b50612e014a462e808f234ba663820b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:57Z,use_quota=True,user_id='21eea2ff988a4455abbe1964374c2869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Creating volume c6bef64d-2ced-442e-92af-af27939a48ef {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:00 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5800aede-0f54-456c-a17c-18d17448f111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f33dfc-080f-4d37-b1c2-d338492436bb', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:00 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef 1073741824
Nov 04 01:14:00 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b5c246-28fa-4b01-b77d-57405936f1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:00 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume volume-f0f33dfc-080f-4d37-b1c2-d338492436bb (f0f33dfc-080f-4d37-b1c2-d338492436bb): created successfully
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b5c246-28fa-4b01-b77d-57405936f1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (6c4c6cb5-2a35-46b1-abec-a68bfe91643a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:00 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f8e15720-af82-41e1-90d5-faf78e7ca510 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created volume successfully.
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Flow 'volume_create_manager' (2392992d-3d01-4d3b-8df9-747cac089f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31fa9be-840f-48e4-91f2-c2b16efe05a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31fa9be-840f-48e4-91f2-c2b16efe05a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09432f0d-19e2-4b4d-b6ef-4ee71311b455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fecfc72a08434d198c1bfea1a00b83cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:01Z,use_quota=True,user_id='c9eee8afaebd4da99fb9539525a7087a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb188e4c-9e7b-40a1-bb92-5ab46c5366af),volume_type_id=fb188e4c-9e7b-40a1-bb92-5ab46c5366af)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc733d26-4a07-4757-a4fb-822c62dd2ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc733d26-4a07-4757-a4fb-822c62dd2ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b4af6f-ce44-4172-962a-dbdac2e2fc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG cinder.image.glance [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Creating Keystone auth plugin from conf {{(pid=86660) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 01:14:00 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef 1073741824" returned: 0 in 0.483s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:00 devstack sudo[106024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef
Nov 04 01:14:00 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b4af6f-ce44-4172-962a-dbdac2e2fc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09432f0d-19e2-4b4d-b6ef-4ee71311b455', 'volume_name': 'volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455', 'volume_size': 1, 'image_id': '191dc02a-a668-4143-9749-d36f1176bb0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/191dc02a-a668-4143-9749-d36f1176bb0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7043b475ab9a3f04b1e6f733abf9323c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fecfc72a08434d198c1bfea1a00b83cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '445ff1b6b1ecbde7527366c8115491c0ad795ad1f6ba4b4368d5289dac6250f50acb6d9b48f0e6ca394b3931feb9f65bb0742578387caa61d53dc32049560f27', 'id': '191dc02a-a668-4143-9749-d36f1176bb0b', 'created_at': datetime.datetime(2026, 11, 4, 0, 13, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/191dc02a-a668-4143-9749-d36f1176bb0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b53d3e5910>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b55b1ef-4911-4929-a014-3550292dcbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b55b1ef-4911-4929-a014-3550292dcbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710a00ad-834a-49e7-a955-c6b1853265ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Volume 09432f0d-19e2-4b4d-b6ef-4ee71311b455: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455', 'volume_size': 1, 'image_id': '191dc02a-a668-4143-9749-d36f1176bb0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/191dc02a-a668-4143-9749-d36f1176bb0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7043b475ab9a3f04b1e6f733abf9323c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fecfc72a08434d198c1bfea1a00b83cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '445ff1b6b1ecbde7527366c8115491c0ad795ad1f6ba4b4368d5289dac6250f50acb6d9b48f0e6ca394b3931feb9f65bb0742578387caa61d53dc32049560f27', 'id': '191dc02a-a668-4143-9749-d36f1176bb0b', 'created_at': datetime.datetime(2026, 11, 4, 0, 13, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/191dc02a-a668-4143-9749-d36f1176bb0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b53d3e5910>}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Trying to clone 09432f0d-19e2-4b4d-b6ef-4ee71311b455 from image 191dc02a-a668-4143-9749-d36f1176bb0b at location (None, [{'url': 'file:///opt/stack/data/glance/images/191dc02a-a668-4143-9749-d36f1176bb0b', 'metadata': {}}]). {{(pid=86660) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 01:14:01 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Image download 0.00 MB at 0.00 MB/s
Nov 04 01:14:01 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef" returned: 0 in 0.260s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.253s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1515314294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc74f5f6-c2c3-4ebb-8b26-97b00e385f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b50612e014a462e808f234ba663820b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:58Z,use_quota=True,user_id='21eea2ff988a4455abbe1964374c2869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Creating volume dc74f5f6-c2c3-4ebb-8b26-97b00e385f19 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:01 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:01 devstack sudo[106028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19 1073741824
Nov 04 01:14:01 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15844819-57b8-45c8-abd7-0839188a1d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6bef64d-2ced-442e-92af-af27939a48ef', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7433194-2b72-46c8-bb8c-b526e0f68121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b30dcfb-5b06-421b-86e4-ad66bae909e1]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Volume volume-c6bef64d-2ced-442e-92af-af27939a48ef (c6bef64d-2ced-442e-92af-af27939a48ef): created successfully
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7433194-2b72-46c8-bb8c-b526e0f68121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Flow 'volume_create_manager' (c8b83ede-cf0e-4989-95d8-35dcce3946e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-84788eb2-a13e-41ae-934d-ba860492a2c1 tempest-CreateVolumesFromImageTest-1738492721 None] Created volume successfully.
Nov 04 01:14:01 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD
Nov 04 01:14:01 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:01 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:01 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19 1073741824" returned: 0 in 0.516s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:01 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19
Nov 04 01:14:01 devstack sudo[106038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD
Nov 04 01:14:01 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:01 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:01 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Temporary image 191dc02a-a668-4143-9749-d36f1176bb0b is fetched for user c9eee8afaebd4da99fb9539525a7087a. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 01:14:01 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19" returned: 0 in 0.251s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.617s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1132015339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfdd598-0dc9-4145-98ac-d09e7b492430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b50612e014a462e808f234ba663820b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:58Z,use_quota=True,user_id='21eea2ff988a4455abbe1964374c2869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Creating volume 4dfdd598-0dc9-4145-98ac-d09e7b492430 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:01 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbd6d20-12dc-4f90-b55c-855e30bd7ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:02 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430 1073741824
Nov 04 01:14:02 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2776d4dd-0116-436d-8b21-6260c8e72c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:02 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Volume volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19 (dc74f5f6-c2c3-4ebb-8b26-97b00e385f19): created successfully
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2776d4dd-0116-436d-8b21-6260c8e72c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Flow 'volume_create_manager' (a0649165-9994-4a20-a7d8-15a6009af291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[804b2335-f37d-4e13-8a00-0d16ab240c9b]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:02 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3a5818c4-0050-46f6-a1ef-328833347427 tempest-CreateVolumesFromImageTest-1738492721 None] Created volume successfully.
Nov 04 01:14:02 devstack sudo[106048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD
Nov 04 01:14:02 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:02 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:02 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430 1073741824" returned: 0 in 0.441s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:02 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430
Nov 04 01:14:02 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:02 devstack sudo[106056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD
Nov 04 01:14:02 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:02 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430" returned: 0 in 0.258s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.705s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:13:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1809953452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a8cb7c-453e-4275-9e1b-6302a18e4c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ea984a038c4fd7b1d1e9b5e436dbcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:13:59Z,use_quota=True,user_id='04ca6b3f09b24100b1c5a8042432fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Creating volume 21a8cb7c-453e-4275-9e1b-6302a18e4c4a {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:02 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:02 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:02 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a 1073741824
Nov 04 01:14:02 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6819e7-846b-41c0-b892-a1ee313c6576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dfdd598-0dc9-4145-98ac-d09e7b492430', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b4b653-f862-46f2-8a41-6cc137fad8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:02 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Volume volume-4dfdd598-0dc9-4145-98ac-d09e7b492430 (4dfdd598-0dc9-4145-98ac-d09e7b492430): created successfully
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b4b653-f862-46f2-8a41-6cc137fad8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:02 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Flow 'volume_create_manager' (5bd6ecd4-d329-4ee0-8d39-34a1ba7e0b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:02 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-40c37370-9df2-4af2-ad3b-465b3996d797 tempest-CreateVolumesFromImageTest-1738492721 None] Created volume successfully.
Nov 04 01:14:03 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a 1073741824" returned: 0 in 0.414s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:03 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a
Nov 04 01:14:03 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:03 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a" returned: 0 in 0.262s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.863s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ebbfe4-d61d-4e51-853e-49f76e17503c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846c02b1-011d-4599-9a63-04fe906ee5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] Creating offline snapshot fb2b1e92-1431-44ce-9456-e59904f82b0f of volume f0f33dfc-080f-4d37-b1c2-d338492436bb {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8ad44f-859d-4e3e-8f32-62886636b654]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:03 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Volume volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a (21a8cb7c-453e-4275-9e1b-6302a18e4c4a): created successfully
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846c02b1-011d-4599-9a63-04fe906ee5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Flow 'volume_create_manager' (b6ab64b3-2090-4296-9943-ef0ace4f9814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-75feb7b5-f2b2-4f0d-937e-489218b9b07d tempest-CinderUnicodeTest-894693979 None] Created volume successfully.
Nov 04 01:14:03 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb
Nov 04 01:14:03 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "cinder-4dfdd598-0dc9-4145-98ac-d09e7b492430-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-4dfdd598-0dc9-4145-98ac-d09e7b492430-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "cinder-quobyte-4dfdd598-0dc9-4145-98ac-d09e7b492430" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-quobyte-4dfdd598-0dc9-4145-98ac-d09e7b492430" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afef379-90c3-4758-9b6b-68403bec973d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:03 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb" returned: 0 in 0.415s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:03 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f 1G
Nov 04 01:14:03 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:04 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430
Nov 04 01:14:04 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:04 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430" returned: 0 in 0.383s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:04 devstack sudo[106090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430
Nov 04 01:14:04 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:04 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f 1G" returned: 0 in 0.474s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f33dfc-080f-4d37-b1c2-d338492436bb -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:04 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f33dfc-080f-4d37-b1c2-d338492436bb -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f
Nov 04 01:14:04 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:04 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4dfdd598-0dc9-4145-98ac-d09e7b492430" returned: 0 in 0.291s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-quobyte-4dfdd598-0dc9-4145-98ac-d09e7b492430" released by "delete_volume" :: held 0.717s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Created reservations ['657a4a7a-4312-46ef-84ce-fe370c7ff5f0', 'e7f1bb12-c4d3-4988-b2d1-b1bd9e86cddc', 'be33784e-45bd-44d6-a427-ad7f7f2feeac', 'ed963771-167f-4959-b0d6-fa25b874a84f'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:04 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:04 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f33dfc-080f-4d37-b1c2-d338492436bb -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f" returned: 0 in 0.331s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:04 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:04 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f is being set with open permissions: ugo+rw
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:04 devstack sudo[106102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f
Nov 04 01:14:04 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "cinder-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:04 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.263s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:04 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Deleted volume successfully.
Nov 04 01:14:04 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f" returned: 0 in 0.250s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-88a2ac98-7b84-4e01-a694-61f8468d75f8 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-4dfdd598-0dc9-4145-98ac-d09e7b492430-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "cinder-quobyte-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-quobyte-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:05 devstack sudo[106106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.info
Nov 04 01:14:05 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[a947f3cb-d21b-4c0a-a790-afce2ac2313f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:05 devstack sudo[106108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19
Nov 04 01:14:05 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:05 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.info" returned: 0 in 0.260s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:05 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.info is being set with open permissions: ugo+rw
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:05 devstack sudo[106111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.info
Nov 04 01:14:05 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:05 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19" returned: 0 in 0.393s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:05 devstack sudo[106116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19
Nov 04 01:14:05 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:05 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.info" returned: 0 in 0.250s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.793s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09432f0d-19e2-4b4d-b6ef-4ee71311b455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fecfc72a08434d198c1bfea1a00b83cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:01Z,use_quota=True,user_id='c9eee8afaebd4da99fb9539525a7087a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb188e4c-9e7b-40a1-bb92-5ab46c5366af),volume_type_id=fb188e4c-9e7b-40a1-bb92-5ab46c5366af)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Creating volume 09432f0d-19e2-4b4d-b6ef-4ee71311b455 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:05 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:05 devstack sudo[106119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 1073741824
Nov 04 01:14:05 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:05 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-b6693114-9633-4113-9f0a-74571b4f61ce tempest-CreateVolumesFromSnapshotTest-2138386828 None] Create snapshot completed successfully
Nov 04 01:14:05 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19" returned: 0 in 0.262s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-quobyte-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19" released by "delete_volume" :: held 0.701s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Created reservations ['645d8c81-c73d-4d01-876e-19c1dc4db2ba', '1f483138-f67d-4923-8dab-cc85ff7c1270', '51024852-0cca-4c15-a3f3-be1c44481fe7', 'd5e7c54e-1fcd-4f9b-b588-54cfd91d2bb8'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:05 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:05 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:06 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 1073741824" returned: 0 in 0.554s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "cinder-c6bef64d-2ced-442e-92af-af27939a48ef-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-c6bef64d-2ced-442e-92af-af27939a48ef-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:06 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.358s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:06 devstack sudo[106129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455
Nov 04 01:14:06 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:06 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Deleted volume successfully.
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "cinder-quobyte-c6bef64d-2ced-442e-92af-af27939a48ef" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d50cb170-4a6f-4379-abd0-b517907069f0 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-dc74f5f6-c2c3-4ebb-8b26-97b00e385f19-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-quobyte-c6bef64d-2ced-442e-92af-af27939a48ef" acquired by "delete_volume" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e83e33-6c87-4313-9784-ff1d0839f4a3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (ee14e0bb-6f3b-46ab-94da-f8a9fa2c0e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0b918f-07fe-4421-af6b-7fd2d0b4e30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0b918f-07fe-4421-af6b-7fd2d0b4e30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1366542642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef1176f-3f6d-48cf-bdf5-789111241c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:06Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445cdd4b-718f-405a-9fe6-c99b09f8c33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445cdd4b-718f-405a-9fe6-c99b09f8c33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b63bb5-5c0f-4293-a632-5e6dcad0cba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b63bb5-5c0f-4293-a632-5e6dcad0cba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef1176f-3f6d-48cf-bdf5-789111241c96', 'volume_name': 'volume-3ef1176f-3f6d-48cf-bdf5-789111241c96', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca0c57f-b4af-4e84-bd4a-f18adf9aa794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca0c57f-b4af-4e84-bd4a-f18adf9aa794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6992dad7-6446-4bf7-8ebf-0762e5e89a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:06 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume 3ef1176f-3f6d-48cf-bdf5-789111241c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef1176f-3f6d-48cf-bdf5-789111241c96', 'volume_size': 1}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:06 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef
Nov 04 01:14:06 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:06 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455" returned: 0 in 0.371s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.124s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] Creating offline snapshot ec74025c-213d-4aa6-95ba-ea152f692c45 of volume 21a8cb7c-453e-4275-9e1b-6302a18e4c4a {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ae844f-b782-4da3-9cce-cddff3f2653a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Attempting download of 191dc02a-a668-4143-9749-d36f1176bb0b ((None, [{'url': 'file:///opt/stack/data/glance/images/191dc02a-a668-4143-9749-d36f1176bb0b', 'metadata': {}}])) to volume 09432f0d-19e2-4b4d-b6ef-4ee71311b455. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[137b558b-dfb5-472a-b404-3d58a4c84e3b]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_191dc02a-a668-4143-9749-d36f1176bb0b_k4u19d1a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:06 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a
Nov 04 01:14:06 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:06 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_191dc02a-a668-4143-9749-d36f1176bb0b_k4u19d1a
Nov 04 01:14:06 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:06 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (64371315-af91-4e48-8827-2b3d469f23c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff03f870-4928-4d15-a49a-6fc5d5ba6374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef" returned: 0 in 0.568s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:07 devstack sudo[106141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef
Nov 04 01:14:07 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff03f870-4928-4d15-a49a-6fc5d5ba6374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2069934493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f28068-6fd2-4d86-9150-d0acdb8fffe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:07Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f137db-ea5b-43f6-94ce-a96450f8a9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f137db-ea5b-43f6-94ce-a96450f8a9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c108e75-be60-4cda-bcc3-d1d1fedab3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c108e75-be60-4cda-bcc3-d1d1fedab3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f28068-6fd2-4d86-9150-d0acdb8fffe2', 'volume_name': 'volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e341f4-678f-429a-b8c7-a650ee02fb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e341f4-678f-429a-b8c7-a650ee02fb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4e43ab-15eb-4a32-bbc3-d49eab1e7a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:07 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume 71f28068-6fd2-4d86-9150-d0acdb8fffe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2', 'volume_size': 1}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:07 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a" returned: 0 in 0.520s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:07 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_191dc02a-a668-4143-9749-d36f1176bb0b_k4u19d1a" returned: 0 in 0.486s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:07 devstack sudo[106147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45 1G
Nov 04 01:14:07 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_191dc02a-a668-4143-9749-d36f1176bb0b_k4u19d1a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:07 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_191dc02a-a668-4143-9749-d36f1176bb0b_k4u19d1a
Nov 04 01:14:07 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:07 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c6bef64d-2ced-442e-92af-af27939a48ef" returned: 0 in 0.454s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (a09626b5-caa8-4da3-8fd8-d413558c09ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfaca94-9150-4b5c-a66b-92184f9943cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-quobyte-c6bef64d-2ced-442e-92af-af27939a48ef" released by "delete_volume" :: held 1.168s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfaca94-9150-4b5c-a66b-92184f9943cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-445800920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f6cc90-1ff1-4eee-921f-f7d5390137dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:07Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fda155e-c413-4b4d-a774-776ffe4d172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fda155e-c413-4b4d-a774-776ffe4d172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a31b31b-9d8a-44d2-9066-51956ded430a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a31b31b-9d8a-44d2-9066-51956ded430a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f6cc90-1ff1-4eee-921f-f7d5390137dc', 'volume_name': 'volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f66f249-0057-4fa9-8d41-5ce99f7673c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f66f249-0057-4fa9-8d41-5ce99f7673c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58843971-ef5a-45f3-a4ee-2461dba700d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:07 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume f7f6cc90-1ff1-4eee-921f-f7d5390137dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc', 'volume_size': 1}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:07 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_191dc02a-a668-4143-9749-d36f1176bb0b_k4u19d1a" returned: 1 in 0.410s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_191dc02a-a668-4143-9749-d36f1176bb0b_k4u19d1a' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[077d162d-3924-4e66-99b9-c22933881d3b]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Created reservations ['15c47060-4c06-4f50-9e12-33797837cd82', '7d6f35d6-6622-4970-9fc9-66eae8bf23b7', '92ff65c1-2024-4122-88f7-d8d0fdd6a5d2', '7f0b2247-6eee-49ad-a432-b4644876a50b'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:07 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45 1G" returned: 0 in 0.592s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:07 devstack sudo[106159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD
Nov 04 01:14:07 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:07 devstack sudo[106160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45
Nov 04 01:14:07 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:07 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:07 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:07 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (1952bb86-1b2c-4fa9-8ee8-ff637e058a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a69caa-1508-417e-b937-62b0cf98caf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a69caa-1508-417e-b937-62b0cf98caf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1356204384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fd8dd7-89d1-4631-a903-290bbfdd776e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:08Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5288ade-166d-48cb-9b14-f2800a3d3966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5288ade-166d-48cb-9b14-f2800a3d3966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:08 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:08 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c975d45d-aa70-438a-9bac-213d67d883fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c975d45d-aa70-438a-9bac-213d67d883fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1fd8dd7-89d1-4631-a903-290bbfdd776e', 'volume_name': 'volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead5f50b-4893-4456-8460-12c9fb0fcb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead5f50b-4893-4456-8460-12c9fb0fcb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bad5ca6-6aac-4618-acec-61653a76148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:08 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume f1fd8dd7-89d1-4631-a903-290bbfdd776e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e', 'volume_size': 1}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.356s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:08 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Deleted volume successfully.
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-76f7d582-efba-42a0-b3dd-23fbb3c26b7a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-c6bef64d-2ced-442e-92af-af27939a48ef-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:08 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45" returned: 0 in 0.540s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:08 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45 is being set with open permissions: ugo+rw
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:08 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD
Nov 04 01:14:08 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:08 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45
Nov 04 01:14:08 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (9ee78bad-6b0f-4f95-8de3-e2c185922027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2af4b3-25e1-4e8f-b318-783e47495db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2af4b3-25e1-4e8f-b318-783e47495db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1960344662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a213eca-b8ee-4cdb-990f-3f065a861b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:08Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3e1c99-7686-46ce-ac5a-63604071107c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3e1c99-7686-46ce-ac5a-63604071107c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5af9f4c-fd36-47ef-895e-63d8e52c96e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5af9f4c-fd36-47ef-895e-63d8e52c96e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a213eca-b8ee-4cdb-990f-3f065a861b01', 'volume_name': 'volume-9a213eca-b8ee-4cdb-990f-3f065a861b01', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e29822-32e7-44d4-af6a-eb9d6129ce5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e29822-32e7-44d4-af6a-eb9d6129ce5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f2bce5-b4d3-4352-b9ef-6ee1ee67fc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:08 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume 9a213eca-b8ee-4cdb-990f-3f065a861b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a213eca-b8ee-4cdb-990f-3f065a861b01', 'volume_size': 1}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:08 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] 191dc02a-a668-4143-9749-d36f1176bb0b was raw, converting to qcow2 {{(pid=86660) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:08 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "cinder-a2dba709-9104-4415-a613-bcc681098992-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45" returned: 0 in 0.293s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:08 devstack sudo[106179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455
Nov 04 01:14:08 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-a2dba709-9104-4415-a613-bcc681098992-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:08 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.info
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "cinder-quobyte-a2dba709-9104-4415-a613-bcc681098992" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:08 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-quobyte-a2dba709-9104-4415-a613-bcc681098992" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fbe4ee-def5-415e-bacf-00ffd2619133]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:08 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992
Nov 04 01:14:08 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:08 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.info" returned: 0 in 0.267s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:08 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.info is being set with open permissions: ugo+rw
Nov 04 01:14:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:08 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.info
Nov 04 01:14:08 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:09 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455" returned: 0 in 0.528s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_191dc02a-a668-4143-9749-d36f1176bb0b_bx27fbazdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:14:09 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Converted 0.00 MB image at 0.00 MB/s
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:09 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992" returned: 0 in 0.397s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:09 devstack sudo[106194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 1G
Nov 04 01:14:09 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:09 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992
Nov 04 01:14:09 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:09 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.info" returned: 0 in 0.309s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.765s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1366542642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef1176f-3f6d-48cf-bdf5-789111241c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:06Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Creating volume 3ef1176f-3f6d-48cf-bdf5-789111241c96 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:09 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:09 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-703ad9b1-637b-441a-8456-d6d7693f83a7 tempest-CinderUnicodeTest-894693979 None] Create snapshot completed successfully
Nov 04 01:14:09 devstack sudo[106199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96 1073741824
Nov 04 01:14:09 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:09 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a2dba709-9104-4415-a613-bcc681098992" returned: 0 in 0.272s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-quobyte-a2dba709-9104-4415-a613-bcc681098992" released by "delete_volume" :: held 0.721s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Created reservations ['dc77f78c-86c9-4676-88f7-9454b85a4128', '88444890-f366-442b-a060-6d51de49c473', '43df512c-770d-4b1e-9821-aeb197974dca', '3a4d2cc2-899c-43d5-88b0-d762baf74d3b'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:09 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 1G" returned: 0 in 0.375s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Downloaded image 191dc02a-a668-4143-9749-d36f1176bb0b ((None, [{'url': 'file:///opt/stack/data/glance/images/191dc02a-a668-4143-9749-d36f1176bb0b', 'metadata': {}}])) to volume 09432f0d-19e2-4b4d-b6ef-4ee71311b455 successfully. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Temporary image 191dc02a-a668-4143-9749-d36f1176bb0b for user c9eee8afaebd4da99fb9539525a7087a is deleted. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Marking volume 09432f0d-19e2-4b4d-b6ef-4ee71311b455 as bootable. {{(pid=86660) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Copying metadata from image 191dc02a-a668-4143-9749-d36f1176bb0b to 09432f0d-19e2-4b4d-b6ef-4ee71311b455. {{(pid=86660) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Creating volume glance metadata for volume 09432f0d-19e2-4b4d-b6ef-4ee71311b455 backed by image 191dc02a-a668-4143-9749-d36f1176bb0b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '191dc02a-a668-4143-9749-d36f1176bb0b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7043b475ab9a3f04b1e6f733abf9323c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86660) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:09 devstack sudo[106208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:09 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710a00ad-834a-49e7-a955-c6b1853265ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455', 'volume_size': 1, 'image_id': '191dc02a-a668-4143-9749-d36f1176bb0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/191dc02a-a668-4143-9749-d36f1176bb0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7043b475ab9a3f04b1e6f733abf9323c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fecfc72a08434d198c1bfea1a00b83cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '445ff1b6b1ecbde7527366c8115491c0ad795ad1f6ba4b4368d5289dac6250f50acb6d9b48f0e6ca394b3931feb9f65bb0742578387caa61d53dc32049560f27', 'id': '191dc02a-a668-4143-9749-d36f1176bb0b', 'created_at': datetime.datetime(2026, 11, 4, 0, 13, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/191dc02a-a668-4143-9749-d36f1176bb0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b53d3e5910>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0dfb338-14dc-43b4-b099-ccbed07341b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:09 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Volume volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 (09432f0d-19e2-4b4d-b6ef-4ee71311b455): created successfully
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0dfb338-14dc-43b4-b099-ccbed07341b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Flow 'volume_create_manager' (2392992d-3d01-4d3b-8df9-747cac089f81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:09 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-00a60546-3bc0-4393-99c0-5fabbad5cad0 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Created volume successfully.
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Acquiring lock "cinder-ec74025c-213d-4aa6-95ba-ea152f692c45-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "cinder-30e7f48e-9553-4a68-b361-de897fd605b9-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Lock "cinder-ec74025c-213d-4aa6-95ba-ea152f692c45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Acquiring lock "cinder-quobyte-21a8cb7c-453e-4275-9e1b-6302a18e4c4a" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-30e7f48e-9553-4a68-b361-de897fd605b9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Lock "cinder-quobyte-21a8cb7c-453e-4275-9e1b-6302a18e4c4a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Acquiring lock "cinder-quobyte-ec74025c-213d-4aa6-95ba-ea152f692c45" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Lock "cinder-quobyte-ec74025c-213d-4aa6-95ba-ea152f692c45" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Deleting offline snapshot ec74025c-213d-4aa6-95ba-ea152f692c45 of volume 21a8cb7c-453e-4275-9e1b-6302a18e4c4a {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:14:09 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:09 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] snapshot_file for this snap is: volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96 1073741824" returned: 0 in 0.633s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f3fb62-541c-45e1-b797-a1f17fb57f03]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:09 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Deleted volume successfully.
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "cinder-quobyte-30e7f48e-9553-4a68-b361-de897fd605b9" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cd1f0e9e-6ef0-4eff-9113-693a53e94b42 tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-a2dba709-9104-4415-a613-bcc681098992-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-quobyte-30e7f48e-9553-4a68-b361-de897fd605b9" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ebdff9-917e-4e6d-8308-79cd6ad9e627]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:10 devstack sudo[106213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96
Nov 04 01:14:10 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:10 devstack sudo[106212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45
Nov 04 01:14:10 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:10 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9
Nov 04 01:14:10 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:10 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96" returned: 0 in 0.281s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.204s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2069934493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f28068-6fd2-4d86-9150-d0acdb8fffe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:07Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Creating volume 71f28068-6fd2-4d86-9150-d0acdb8fffe2 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:10 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:10 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2 1073741824
Nov 04 01:14:10 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6992dad7-6446-4bf7-8ebf-0762e5e89a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef1176f-3f6d-48cf-bdf5-789111241c96', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fcec03b-046f-4c1a-a743-61400a241c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:10 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45" returned: 0 in 0.431s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:14:10 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume volume-3ef1176f-3f6d-48cf-bdf5-789111241c96 (3ef1176f-3f6d-48cf-bdf5-789111241c96): created successfully
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fcec03b-046f-4c1a-a743-61400a241c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (ee14e0bb-6f3b-46ab-94da-f8a9fa2c0e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d5ed0d-73f7-4af3-9523-8d287cab4329]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Acquiring lock "cinder-09432f0d-19e2-4b4d-b6ef-4ee71311b455-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-05b3899a-2566-4224-999a-709f46f40561 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created volume successfully.
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Lock "cinder-09432f0d-19e2-4b4d-b6ef-4ee71311b455-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:10 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9" returned: 0 in 0.493s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:10 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9
Nov 04 01:14:10 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Acquiring lock "cinder-quobyte-09432f0d-19e2-4b4d-b6ef-4ee71311b455" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Lock "cinder-quobyte-09432f0d-19e2-4b4d-b6ef-4ee71311b455" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38b7b93-65e6-42d6-a6b9-c286122fe314]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:10 devstack sudo[106228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a
Nov 04 01:14:10 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:10 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455
Nov 04 01:14:10 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:10 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-30e7f48e-9553-4a68-b361-de897fd605b9" returned: 0 in 0.264s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-quobyte-30e7f48e-9553-4a68-b361-de897fd605b9" released by "delete_volume" :: held 0.817s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:10 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Created reservations ['baf6145b-8c8b-4d7e-8906-fd189f19a481', '918cead0-24c9-4763-a2be-89bf5bc48666', '72cba9f7-50f0-4aa4-a854-770d44576ad7', '9d00b62b-3868-4047-95b6-7de2cf792bf9'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2 1073741824" returned: 0 in 0.548s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:10 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:10 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:10 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a" returned: 0 in 0.546s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:11 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:11 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:11 devstack sudo[106247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45
Nov 04 01:14:11 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:11 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455" returned: 0 in 0.562s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:11 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455
Nov 04 01:14:11 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:11 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2" returned: 0 in 0.330s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.676s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:11 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-445800920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f6cc90-1ff1-4eee-921f-f7d5390137dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:07Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Creating volume f7f6cc90-1ff1-4eee-921f-f7d5390137dc {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:11 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.324s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Deleted volume successfully.
Nov 04 01:14:11 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc 1073741824
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4e43ab-15eb-4a32-bbc3-d49eab1e7a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:11 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74019be1-2d56-407f-a250-a2bd8ea33129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7e0a98d6-8305-4c83-b9b7-e71411577f1a tempest-CreateVolumesFromImageTest-1738492721 None] Lock "cinder-30e7f48e-9553-4a68-b361-de897fd605b9-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:11 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2 (71f28068-6fd2-4d86-9150-d0acdb8fffe2): created successfully
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74019be1-2d56-407f-a250-a2bd8ea33129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (64371315-af91-4e48-8827-2b3d469f23c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cc685846-8009-409c-8b0a-95239277110d tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created volume successfully.
Nov 04 01:14:11 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45" returned: 0 in 0.546s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:11 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45
Nov 04 01:14:11 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:11 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-09432f0d-19e2-4b4d-b6ef-4ee71311b455" returned: 0 in 0.432s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Lock "cinder-quobyte-09432f0d-19e2-4b4d-b6ef-4ee71311b455" released by "delete_volume" :: held 1.071s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Created reservations ['add1f5e0-b77d-4bc3-9053-0aa4f1148ee6', 'ccea075e-2914-47db-975d-ec19165cb2c2', 'b66aa6ff-2495-4671-81bb-2cce26a48c57', 'c03f0fe8-af34-4bed-85c7-795124eb3478'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:11 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a.ec74025c-213d-4aa6-95ba-ea152f692c45" returned: 0 in 0.359s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:11 devstack sudo[106269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:11 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Lock "cinder-quobyte-ec74025c-213d-4aa6-95ba-ea152f692c45" released by "_delete_snapshot" :: held 2.082s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Lock "cinder-quobyte-21a8cb7c-453e-4275-9e1b-6302a18e4c4a" released by "delete_snapshot" :: held 2.121s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:12 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc 1073741824" returned: 0 in 0.765s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Created reservations ['ed4fbea1-3269-448a-bb62-704ddbe1a473', '114e2cec-124a-4687-be7e-44e7cd46e0a9', 'aeb2b6eb-53b7-4f5b-9e80-4dca8d3687d1', '8ee9c11d-1d36-488c-93ee-664ce1dd565d'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:12 devstack sudo[106272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc
Nov 04 01:14:12 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:12 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Delete snapshot completed successfully.
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-277e1728-15e9-49bf-bbf5-bca848dde3c7 tempest-CinderUnicodeTest-894693979 None] Lock "cinder-ec74025c-213d-4aa6-95ba-ea152f692c45-delete_snapshot" released by "delete_snapshot" :: held 2.362s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:12 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.354s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:12 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Deleted volume successfully.
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e337c522-831f-4f64-a403-d3c74de6b151 tempest-VolumeAndVolumeTypeFromImageTest-2092593395 None] Lock "cinder-09432f0d-19e2-4b4d-b6ef-4ee71311b455-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:12 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc" returned: 0 in 0.318s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.252s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1356204384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fd8dd7-89d1-4631-a903-290bbfdd776e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:08Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Creating volume f1fd8dd7-89d1-4631-a903-290bbfdd776e {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:12 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58843971-ef5a-45f3-a4ee-2461dba700d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:12 devstack sudo[106277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e 1073741824
Nov 04 01:14:12 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ccddf7-8807-4e9b-898b-613da655f7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:12 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc (f7f6cc90-1ff1-4eee-921f-f7d5390137dc): created successfully
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ccddf7-8807-4e9b-898b-613da655f7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (a09626b5-caa8-4da3-8fd8-d413558c09ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:12 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-eefdea02-30fe-4b04-96c0-9b52ae7970e2 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created volume successfully.
Nov 04 01:14:12 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e 1073741824" returned: 0 in 0.549s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:13 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e
Nov 04 01:14:13 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Acquiring lock "cinder-21a8cb7c-453e-4275-9e1b-6302a18e4c4a-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Lock "cinder-21a8cb7c-453e-4275-9e1b-6302a18e4c4a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Acquiring lock "cinder-quobyte-21a8cb7c-453e-4275-9e1b-6302a18e4c4a" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Lock "cinder-quobyte-21a8cb7c-453e-4275-9e1b-6302a18e4c4a" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5100e3-6c7f-42d7-85b5-57248cef5401]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:13 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e" returned: 0 in 0.332s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.896s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1960344662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a213eca-b8ee-4cdb-990f-3f065a861b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da4003fceb40ea92db56aa2b8368d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:08Z,use_quota=True,user_id='29e7d7e613fb4292b800f1970fd5523b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Creating volume 9a213eca-b8ee-4cdb-990f-3f065a861b01 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:13 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:13 devstack sudo[106291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a
Nov 04 01:14:13 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bad5ca6-6aac-4618-acec-61653a76148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea50ebb-ab1c-4c5c-abde-9fe439b20389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:13 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e (f1fd8dd7-89d1-4631-a903-290bbfdd776e): created successfully
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea50ebb-ab1c-4c5c-abde-9fe439b20389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (1952bb86-1b2c-4fa9-8ee8-ff637e058a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:13 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-203fbc51-4543-45b9-bd32-6fecedae3eb6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created volume successfully.
Nov 04 01:14:13 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01 1073741824
Nov 04 01:14:13 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:13 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a" returned: 0 in 0.581s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:13 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a
Nov 04 01:14:13 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:14 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01 1073741824" returned: 0 in 0.664s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:14 devstack sudo[106308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01
Nov 04 01:14:14 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:14 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-21a8cb7c-453e-4275-9e1b-6302a18e4c4a" returned: 0 in 0.369s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Lock "cinder-quobyte-21a8cb7c-453e-4275-9e1b-6302a18e4c4a" released by "delete_volume" :: held 1.051s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Created reservations ['0b090439-2961-4719-924e-7763a3ab330d', 'eb22ea27-cd7c-411c-883a-10e15d1b7913', '51a0917e-4b20-4cd7-a9f3-bafefa0e96b7', 'e6950d60-0fd3-49be-9e2e-0d883935ef42'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:14 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:14 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:14 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01" returned: 0 in 0.348s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f2bce5-b4d3-4352-b9ef-6ee1ee67fc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a213eca-b8ee-4cdb-990f-3f065a861b01', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4070aeb3-f2fb-4ba7-8c4e-9d29a56c7f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:14 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Volume volume-9a213eca-b8ee-4cdb-990f-3f065a861b01 (9a213eca-b8ee-4cdb-990f-3f065a861b01): created successfully
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4070aeb3-f2fb-4ba7-8c4e-9d29a56c7f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Flow 'volume_create_manager' (9ee78bad-6b0f-4f95-8de3-e2c185922027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:14 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-b687d5df-fb8a-4891-8fca-9fed1e9e92c1 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created volume successfully.
Nov 04 01:14:14 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.356s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:14 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Deleted volume successfully.
Nov 04 01:14:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a049058e-d86e-41ba-898c-60e78ab0d8da tempest-CinderUnicodeTest-894693979 None] Lock "cinder-21a8cb7c-453e-4275-9e1b-6302a18e4c4a-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-9a213eca-b8ee-4cdb-990f-3f065a861b01-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-9a213eca-b8ee-4cdb-990f-3f065a861b01-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (541ebac9-dbe5-477a-8569-10c1a6a55c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eed7ef3-c49c-4c70-ad19-53b810c3fe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eed7ef3-c49c-4c70-ad19-53b810c3fe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-564596392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62138ff9-a768-4809-89bc-c8df940a7723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:15Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3f0445-2df3-46b7-a795-6374d5e5b0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3f0445-2df3-46b7-a795-6374d5e5b0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbca01ad-01e6-4f09-b629-6edc49219824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbca01ad-01e6-4f09-b629-6edc49219824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62138ff9-a768-4809-89bc-c8df940a7723', 'volume_name': 'volume-62138ff9-a768-4809-89bc-c8df940a7723', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd329528-8e2c-4033-878d-a34d3188e74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd329528-8e2c-4033-878d-a34d3188e74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba90f0d-667f-4ebb-afb0-220ab03901ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:15 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume 62138ff9-a768-4809-89bc-c8df940a7723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62138ff9-a768-4809-89bc-c8df940a7723', 'volume_size': 1}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-564596392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62138ff9-a768-4809-89bc-c8df940a7723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:15Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Creating volume 62138ff9-a768-4809-89bc-c8df940a7723 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:15 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Acquiring lock "cinder-7abe6d4a-4dd6-4908-a7de-771875616158-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:15 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723 1073741824
Nov 04 01:14:15 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-quobyte-9a213eca-b8ee-4cdb-990f-3f065a861b01" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Lock "cinder-7abe6d4a-4dd6-4908-a7de-771875616158-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-9a213eca-b8ee-4cdb-990f-3f065a861b01" acquired by "delete_volume" :: waited 0.021s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d78c069-417c-4df9-be6d-7ef390b1cacb]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Acquiring lock "cinder-quobyte-7abe6d4a-4dd6-4908-a7de-771875616158" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Lock "cinder-quobyte-7abe6d4a-4dd6-4908-a7de-771875616158" acquired by "delete_volume" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a667ea-8695-482e-961d-276fe7b0ad67]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:15 devstack sudo[106316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01
Nov 04 01:14:15 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:15 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158
Nov 04 01:14:15 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:16 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723 1073741824" returned: 0 in 0.566s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:16 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01" returned: 0 in 0.492s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:16 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01
Nov 04 01:14:16 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:16 devstack sudo[106330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723
Nov 04 01:14:16 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:16 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158" returned: 0 in 0.512s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:16 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158
Nov 04 01:14:16 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:16 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723" returned: 0 in 0.313s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba90f0d-667f-4ebb-afb0-220ab03901ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62138ff9-a768-4809-89bc-c8df940a7723', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad8781d-8a44-4547-8a49-074f0ac88115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:16 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:16 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume volume-62138ff9-a768-4809-89bc-c8df940a7723 (62138ff9-a768-4809-89bc-c8df940a7723): created successfully
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad8781d-8a44-4547-8a49-074f0ac88115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (541ebac9-dbe5-477a-8569-10c1a6a55c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9a213eca-b8ee-4cdb-990f-3f065a861b01" returned: 0 in 0.392s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:16 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4ab043b5-7fbc-4c60-add6-2cef202fbb45 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created volume successfully.
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-9a213eca-b8ee-4cdb-990f-3f065a861b01" released by "delete_volume" :: held 0.965s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:16 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-7abe6d4a-4dd6-4908-a7de-771875616158" returned: 0 in 0.419s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Lock "cinder-quobyte-7abe6d4a-4dd6-4908-a7de-771875616158" released by "delete_volume" :: held 1.005s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created reservations ['1c0cd91b-33b6-416e-b76f-8774a6edc08b', 'aec92008-9c66-4681-84c2-24689afaadeb', '7e1fbc24-37ce-48c4-a1e2-9b087b430198', '17d8d3a0-66b3-4844-b57a-def9e999a5fe'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Created reservations ['a78e4aef-5d6d-4c78-b119-751daa72ac03', 'fc3e0b55-3e8e-4531-80cc-36ff4d650018', 'de9c210c-92b7-4685-8442-619767e949e5', '6362e476-a25e-4f4b-9dea-46d9454dc8c9'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:16 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:16 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:16 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:16 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:17 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.326s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Deleted volume successfully.
Nov 04 01:14:17 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.277s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-96af9627-3c3e-4316-8f9f-1bc11d967dd8 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-9a213eca-b8ee-4cdb-990f-3f065a861b01-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Deleted volume successfully.
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4a44cb3c-7a7d-455c-9eb9-88f7b2732676 tempest-CinderUnicodeTest-894693979 None] Lock "cinder-7abe6d4a-4dd6-4908-a7de-771875616158-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-f1fd8dd7-89d1-4631-a903-290bbfdd776e-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-f1fd8dd7-89d1-4631-a903-290bbfdd776e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-quobyte-f1fd8dd7-89d1-4631-a903-290bbfdd776e" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-f1fd8dd7-89d1-4631-a903-290bbfdd776e" acquired by "delete_volume" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bc6ccb-fde7-44d0-b8de-c7c1c91b9814]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:17 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e
Nov 04 01:14:17 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (a75de59c-ef8c-4ec7-acd8-85fc9f59f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d02030-ac0b-4d04-9ffb-936ffc4bae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d02030-ac0b-4d04-9ffb-936ffc4bae74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-32179915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf750b8-958a-4ab4-9d63-04772827674e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:18Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee79283-7e20-4244-b0df-3e2c3be39044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee79283-7e20-4244-b0df-3e2c3be39044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49bcbad-3dcd-4179-9d59-667b3b946ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49bcbad-3dcd-4179-9d59-667b3b946ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf750b8-958a-4ab4-9d63-04772827674e', 'volume_name': 'volume-3cf750b8-958a-4ab4-9d63-04772827674e', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b715d1-d99a-4d2c-966d-d688913b8f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:18 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b715d1-d99a-4d2c-966d-d688913b8f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6bff08-6fcd-4df6-af41-efa4318aa0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:18 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume 3cf750b8-958a-4ab4-9d63-04772827674e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf750b8-958a-4ab4-9d63-04772827674e', 'volume_size': 1}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-32179915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf750b8-958a-4ab4-9d63-04772827674e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:18Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Creating volume 3cf750b8-958a-4ab4-9d63-04772827674e {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:18 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e" returned: 0 in 0.583s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:18 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e 1073741824
Nov 04 01:14:18 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:18 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e
Nov 04 01:14:18 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:18 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f1fd8dd7-89d1-4631-a903-290bbfdd776e" returned: 0 in 0.365s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-f1fd8dd7-89d1-4631-a903-290bbfdd776e" released by "delete_volume" :: held 1.018s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created reservations ['5e32cd25-4db4-4018-be92-c26ad2dc3f5d', '6bb21135-10aa-4383-906d-2b5a4adc0490', 'b504b105-afdc-45e4-b6a6-c782256cf1f1', '9b4c22ec-5bc7-4fb5-8799-f980491ff0b3'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:19 devstack sudo[106395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:19 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:19 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e 1073741824" returned: 0 in 0.768s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Flow 'volume_create_manager' (114885a5-d944-4ea1-9323-273c4db03e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5c775c-7c07-47d4-85af-139d49ab4a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-f7f6cc90-1ff1-4eee-921f-f7d5390137dc-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5c775c-7c07-47d4-85af-139d49ab4a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1825651921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3388160f-fd7c-468a-a318-47af1799ff71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2895bed30d754c9685611b2ef14de602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:19Z,use_quota=True,user_id='2541798f77314e67962a1165804baefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e350bf5-97c4-4205-ad8d-8f0d5c1d7dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e350bf5-97c4-4205-ad8d-8f0d5c1d7dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d1ee6c-e337-4f88-aa25-a72238c42807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d1ee6c-e337-4f88-aa25-a72238c42807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3388160f-fd7c-468a-a318-47af1799ff71', 'volume_name': 'volume-3388160f-fd7c-468a-a318-47af1799ff71', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70bfb47b-7f06-4395-bc62-9e929c55c666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70bfb47b-7f06-4395-bc62-9e929c55c666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f4d982-61f2-46d0-918f-cc7f41644311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Volume 3388160f-fd7c-468a-a318-47af1799ff71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3388160f-fd7c-468a-a318-47af1799ff71', 'volume_size': 1}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-f7f6cc90-1ff1-4eee-921f-f7d5390137dc-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:19 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (2165d9d1-bcc2-47b5-8b29-6a9c83442875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fc528b-84b8-44f2-af92-00b2f2e3aa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.568s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fc528b-84b8-44f2-af92-00b2f2e3aa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1465310338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500df10f-e92d-4b47-a2a7-9dce29042d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:19Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56ec9d0-c81c-4f11-9975-c41725dbc9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56ec9d0-c81c-4f11-9975-c41725dbc9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a098b9bb-be71-4284-90d7-881e11236a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a098b9bb-be71-4284-90d7-881e11236a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '500df10f-e92d-4b47-a2a7-9dce29042d96', 'volume_name': 'volume-500df10f-e92d-4b47-a2a7-9dce29042d96', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b096e5e-f92e-4a53-8ae1-a9d028d3a25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b096e5e-f92e-4a53-8ae1-a9d028d3a25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791d9ae1-0499-4ca9-8b2e-00246ee83b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume 500df10f-e92d-4b47-a2a7-9dce29042d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-500df10f-e92d-4b47-a2a7-9dce29042d96', 'volume_size': 1}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:19 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Deleted volume successfully.
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (862888d9-0ec0-4efa-8a70-485a4bcfdc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:19 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e
Nov 04 01:14:19 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000e7ff5-b3b5-41c3-9cf8-b2199ba6f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000e7ff5-b3b5-41c3-9cf8-b2199ba6f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2035025727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74c0cf1-8787-412c-b7c1-f8fd85ba3c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:19Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba760a32-69d7-44f6-b808-df8184205556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba760a32-69d7-44f6-b808-df8184205556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb403461-63fc-4ef7-8cab-c6551ac74784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb403461-63fc-4ef7-8cab-c6551ac74784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b74c0cf1-8787-412c-b7c1-f8fd85ba3c76', 'volume_name': 'volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3d21f7-0ddd-4fdb-99de-1926f821763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3d21f7-0ddd-4fdb-99de-1926f821763c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d40df8c-fb15-4468-9327-f65ba01388f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume b74c0cf1-8787-412c-b7c1-f8fd85ba3c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76', 'volume_size': 1}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-cc6872c5-3ee1-4047-979c-3f2b0047e235 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-f1fd8dd7-89d1-4631-a903-290bbfdd776e-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (91c9fec6-c2a8-490b-8802-fe2a0ae0bf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8285f0f-c9dd-4f35-ba11-71f1ebb2483a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-quobyte-f7f6cc90-1ff1-4eee-921f-f7d5390137dc" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8285f0f-c9dd-4f35-ba11-71f1ebb2483a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979527648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:20Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7ac84b-b7dd-4f5a-98a4-4930c5d7ab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7ac84b-b7dd-4f5a-98a4-4930c5d7ab3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951d90b1-db48-4af4-b078-05474b92a4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951d90b1-db48-4af4-b078-05474b92a4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2', 'volume_name': 'volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914fe21f-525a-4ce1-8b0b-f318495fde80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914fe21f-525a-4ce1-8b0b-f318495fde80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb245f0c-2035-4076-8868-fb28fa27a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:19 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume 680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2', 'volume_size': 1}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-f7f6cc90-1ff1-4eee-921f-f7d5390137dc" acquired by "delete_volume" :: waited 0.066s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b0ba06-9552-43ba-ad93-3f273f76c66c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:20 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e" returned: 0 in 0.446s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.714s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1825651921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3388160f-fd7c-468a-a318-47af1799ff71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2895bed30d754c9685611b2ef14de602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:19Z,use_quota=True,user_id='2541798f77314e67962a1165804baefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Creating volume 3388160f-fd7c-468a-a318-47af1799ff71 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:20 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:20 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc
Nov 04 01:14:20 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:20 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 1073741824
Nov 04 01:14:20 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6bff08-6fcd-4df6-af41-efa4318aa0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf750b8-958a-4ab4-9d63-04772827674e', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f825ee-ad1f-4059-85ba-f40c38c29539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:20 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume volume-3cf750b8-958a-4ab4-9d63-04772827674e (3cf750b8-958a-4ab4-9d63-04772827674e): created successfully
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f825ee-ad1f-4059-85ba-f40c38c29539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (a75de59c-ef8c-4ec7-acd8-85fc9f59f722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:20 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-39491978-9b12-48cf-862d-d0b3f20bd05e tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created volume successfully.
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (33d89b5d-b376-4373-93b1-2259fe14446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b96828-433d-46a9-8563-6016df9ba6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b96828-433d-46a9-8563-6016df9ba6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-793645619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed18c72e-213a-41bc-9a77-a33610b3f170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:20Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e6bbf0-675f-4389-805d-cde28463b83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e6bbf0-675f-4389-805d-cde28463b83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989285a5-6586-4d0e-939c-8f77ac518b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989285a5-6586-4d0e-939c-8f77ac518b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed18c72e-213a-41bc-9a77-a33610b3f170', 'volume_name': 'volume-ed18c72e-213a-41bc-9a77-a33610b3f170', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6cfa681-5318-4e54-acba-49df38f1958f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6cfa681-5318-4e54-acba-49df38f1958f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417a2d75-a2fc-4a2c-8c79-ed54d07a7650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:20 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume ed18c72e-213a-41bc-9a77-a33610b3f170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed18c72e-213a-41bc-9a77-a33610b3f170', 'volume_size': 1}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:20 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc" returned: 0 in 0.555s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:20 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc
Nov 04 01:14:20 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:20 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 1073741824" returned: 0 in 0.592s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:20 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71
Nov 04 01:14:20 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:20 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f7f6cc90-1ff1-4eee-921f-f7d5390137dc" returned: 0 in 0.325s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-f7f6cc90-1ff1-4eee-921f-f7d5390137dc" released by "delete_volume" :: held 0.938s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created reservations ['c0c0ff24-50d5-4174-8772-a953e78910f2', '03de0361-eb9a-40ad-8b3d-91da3e28b77d', '40e13762-3458-4f2e-8345-edad6e583eb4', '03305e7c-75c0-49b0-a0ce-de7cc0cd3398'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:21 devstack sudo[106419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:21 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:21 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71" returned: 0 in 0.289s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.425s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1465310338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500df10f-e92d-4b47-a2a7-9dce29042d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:19Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Creating volume 500df10f-e92d-4b47-a2a7-9dce29042d96 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:21 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f4d982-61f2-46d0-918f-cc7f41644311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3388160f-fd7c-468a-a318-47af1799ff71', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:21 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96 1073741824
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b29568-83e6-4ad6-a49f-b684ed9b830b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:21 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:21 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Volume volume-3388160f-fd7c-468a-a318-47af1799ff71 (3388160f-fd7c-468a-a318-47af1799ff71): created successfully
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b29568-83e6-4ad6-a49f-b684ed9b830b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Flow 'volume_create_manager' (114885a5-d944-4ea1-9323-273c4db03e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:21 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d482151c-9feb-4339-a742-9097c2f63e44 tempest-VolumeDependencyTests-465577248 None] Created volume successfully.
Nov 04 01:14:21 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.322s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:21 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Deleted volume successfully.
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8075267a-168b-4550-b57b-7a5d1df4294b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-f7f6cc90-1ff1-4eee-921f-f7d5390137dc-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-71f28068-6fd2-4d86-9150-d0acdb8fffe2-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-71f28068-6fd2-4d86-9150-d0acdb8fffe2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-quobyte-71f28068-6fd2-4d86-9150-d0acdb8fffe2" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-71f28068-6fd2-4d86-9150-d0acdb8fffe2" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:21 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96 1073741824" returned: 0 in 0.564s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae360ef-e61d-4355-88fa-7aeebff7f7f3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:21 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96
Nov 04 01:14:21 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:21 devstack sudo[106428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2
Nov 04 01:14:21 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:21 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96" returned: 0 in 0.285s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.185s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2035025727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74c0cf1-8787-412c-b7c1-f8fd85ba3c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:19Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Creating volume b74c0cf1-8787-412c-b7c1-f8fd85ba3c76 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:21 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:22 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76 1073741824
Nov 04 01:14:22 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791d9ae1-0499-4ca9-8b2e-00246ee83b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-500df10f-e92d-4b47-a2a7-9dce29042d96', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a04353e-d69f-4c96-baa4-0fd53d58ae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:22 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume volume-500df10f-e92d-4b47-a2a7-9dce29042d96 (500df10f-e92d-4b47-a2a7-9dce29042d96): created successfully
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a04353e-d69f-4c96-baa4-0fd53d58ae01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (2165d9d1-bcc2-47b5-8b29-6a9c83442875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:22 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2" returned: 0 in 0.489s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:22 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-aa923582-1a64-49d8-86a8-3e5351c417a1 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created volume successfully.
Nov 04 01:14:22 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2
Nov 04 01:14:22 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:22 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-71f28068-6fd2-4d86-9150-d0acdb8fffe2" returned: 0 in 0.297s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-71f28068-6fd2-4d86-9150-d0acdb8fffe2" released by "delete_volume" :: held 0.844s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created reservations ['b1b08548-68ac-4d43-80f6-e5cb143d6b93', '7314b536-91ae-4649-9312-c57fcdc923bc', 'e6d64154-dbd2-415f-adaa-a8e70b47c77a', '553fcda4-f359-408f-9a9b-2a90137c0cd4'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:22 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76 1073741824" returned: 0 in 0.588s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:22 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:22 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:22 devstack sudo[106446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76
Nov 04 01:14:22 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-3ef1176f-3f6d-48cf-bdf5-789111241c96-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-3ef1176f-3f6d-48cf-bdf5-789111241c96-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-quobyte-3ef1176f-3f6d-48cf-bdf5-789111241c96" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-3ef1176f-3f6d-48cf-bdf5-789111241c96" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:22 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.316s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:22 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Deleted volume successfully.
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2c9f23-f6be-4785-8e8a-acd268a75f90]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:22 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5c7d38f6-b09d-45d5-b9da-f80c0e93417b tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-71f28068-6fd2-4d86-9150-d0acdb8fffe2-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:23 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (2f90b79b-5780-4afb-bde2-f4cd0e53d555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf51359-0a5e-4496-9ec9-189359f1e1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76" returned: 0 in 0.425s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.138s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979527648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:20Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Creating volume 680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:23 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:23 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96
Nov 04 01:14:23 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf51359-0a5e-4496-9ec9-189359f1e1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998238738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37b3949-6d29-4d0b-8337-3f7832c2b098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:23Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:23 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2 1073741824
Nov 04 01:14:23 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e97b3ee-3158-4f60-90a7-a572b0af3714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e97b3ee-3158-4f60-90a7-a572b0af3714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245430b3-632d-4d73-8907-effd9a87896d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245430b3-632d-4d73-8907-effd9a87896d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c37b3949-6d29-4d0b-8337-3f7832c2b098', 'volume_name': 'volume-c37b3949-6d29-4d0b-8337-3f7832c2b098', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0863e6-b749-4883-96f5-71bd93a1fc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0863e6-b749-4883-96f5-71bd93a1fc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aa7761-b90c-4557-82dc-efc9d5aac3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:23 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Volume c37b3949-6d29-4d0b-8337-3f7832c2b098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c37b3949-6d29-4d0b-8337-3f7832c2b098', 'volume_size': 1}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d40df8c-fb15-4468-9327-f65ba01388f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd23a6ac-c813-45d0-86ff-2fe42f6e14f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:23 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76 (b74c0cf1-8787-412c-b7c1-f8fd85ba3c76): created successfully
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd23a6ac-c813-45d0-86ff-2fe42f6e14f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (862888d9-0ec0-4efa-8a70-485a4bcfdc4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:23 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d9577cc8-fc1a-4bf9-8b0b-320b7b6aae2c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created volume successfully.
Nov 04 01:14:23 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96" returned: 0 in 0.414s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:23 devstack sudo[106461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96
Nov 04 01:14:23 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:23 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2 1073741824" returned: 0 in 0.474s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:23 devstack sudo[106464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2
Nov 04 01:14:23 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:23 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3ef1176f-3f6d-48cf-bdf5-789111241c96" returned: 0 in 0.288s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-3ef1176f-3f6d-48cf-bdf5-789111241c96" released by "delete_volume" :: held 0.773s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created reservations ['64118642-8fe7-4c4b-90e4-5c61e55b836e', 'b9bab99f-b31e-48c9-97d9-49812fd3db87', 'e41ae57f-7368-4b0e-b872-d2ca7ff7f5fe', '9b9639d4-7e83-4f27-8c73-38a322db0bb3'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:23 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:23 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:23 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2" returned: 0 in 0.271s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.353s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-793645619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed18c72e-213a-41bc-9a77-a33610b3f170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97de57a2e3e4718b7bdcce1e4ae0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:20Z,use_quota=True,user_id='8b1020c9bef64500b2f86909ecca20b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Creating volume ed18c72e-213a-41bc-9a77-a33610b3f170 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:23 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-fb2b1e92-1431-44ce-9456-e59904f82b0f-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:23 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170 1073741824
Nov 04 01:14:23 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb245f0c-2035-4076-8868-fb28fa27a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355f5d17-c49b-43ac-a41a-be72f9b6e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-fb2b1e92-1431-44ce-9456-e59904f82b0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-quobyte-f0f33dfc-080f-4d37-b1c2-d338492436bb" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:23 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2 (680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2): created successfully
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355f5d17-c49b-43ac-a41a-be72f9b6e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:23 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (91c9fec6-c2a8-490b-8802-fe2a0ae0bf3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:23 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8c3ebf09-4822-4bc9-b067-c7eba3ceab65 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created volume successfully.
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-f0f33dfc-080f-4d37-b1c2-d338492436bb" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-quobyte-fb2b1e92-1431-44ce-9456-e59904f82b0f" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-fb2b1e92-1431-44ce-9456-e59904f82b0f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Deleting offline snapshot fb2b1e92-1431-44ce-9456-e59904f82b0f of volume f0f33dfc-080f-4d37-b1c2-d338492436bb {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] snapshot_file for this snap is: volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4d07ce-2027-4544-971a-0fcd5c048068]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:24 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.290s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:24 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Deleted volume successfully.
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ed524152-9b05-41bb-8d7f-73960923ac93 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-3ef1176f-3f6d-48cf-bdf5-789111241c96-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:24 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f
Nov 04 01:14:24 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:24 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170 1073741824" returned: 0 in 0.520s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:24 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170
Nov 04 01:14:24 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:24 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f" returned: 0 in 0.407s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0f33dfc-080f-4d37-b1c2-d338492436bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b975fbbe-e915-419c-ad97-3b05c7fc8e75]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:24 devstack sudo[106484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb
Nov 04 01:14:24 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:24 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170" returned: 0 in 0.277s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.572s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417a2d75-a2fc-4a2c-8c79-ed54d07a7650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed18c72e-213a-41bc-9a77-a33610b3f170', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7391899b-3800-4746-b68f-55abcddde398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] Creating offline snapshot 79c650c1-99d3-4cde-99c3-7f39f90a5e85 of volume 3388160f-fd7c-468a-a318-47af1799ff71 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:14:24 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Volume volume-ed18c72e-213a-41bc-9a77-a33610b3f170 (ed18c72e-213a-41bc-9a77-a33610b3f170): created successfully
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7391899b-3800-4746-b68f-55abcddde398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Flow 'volume_create_manager' (33d89b5d-b376-4373-93b1-2259fe14446a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[65226405-4bd6-4e18-9f93-a5f5e7d5edf6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:24 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d7efa7d7-4d11-4020-91f9-0d171c36e0d7 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created volume successfully.
Nov 04 01:14:24 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb" returned: 0 in 0.391s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:24 devstack sudo[106487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71
Nov 04 01:14:24 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:24 devstack sudo[106492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f
Nov 04 01:14:24 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:25 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71" returned: 0 in 0.406s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:25 devstack sudo[106500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85 1G
Nov 04 01:14:25 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:25 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f" returned: 0 in 0.389s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:25 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f
Nov 04 01:14:25 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:25 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb.fb2b1e92-1431-44ce-9456-e59904f82b0f" returned: 0 in 0.278s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:25 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85 1G" returned: 0 in 0.431s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3388160f-fd7c-468a-a318-47af1799ff71 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-fb2b1e92-1431-44ce-9456-e59904f82b0f" released by "_delete_snapshot" :: held 1.617s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-f0f33dfc-080f-4d37-b1c2-d338492436bb" released by "delete_snapshot" :: held 1.647s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:25 devstack sudo[106509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3388160f-fd7c-468a-a318-47af1799ff71 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85
Nov 04 01:14:25 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created reservations ['3eed9a07-12c9-4b2d-8b88-7a75d1aa023f', 'd308fc84-78af-4a1d-995e-8259932522be', 'bbc56a20-b38b-4186-9c8c-51d1eb134ab2', 'fcd8441b-9dfa-4850-9031-6ae9970bf062'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:25 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Delete snapshot completed successfully.
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6702009b-ce5c-43e1-882e-6175357132a9 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-fb2b1e92-1431-44ce-9456-e59904f82b0f-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-ed18c72e-213a-41bc-9a77-a33610b3f170-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-ed18c72e-213a-41bc-9a77-a33610b3f170-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-quobyte-ed18c72e-213a-41bc-9a77-a33610b3f170" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-ed18c72e-213a-41bc-9a77-a33610b3f170" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:25 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3388160f-fd7c-468a-a318-47af1799ff71 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85" returned: 0 in 0.333s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:25 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85 is being set with open permissions: ugo+rw
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f30159-5f02-4a84-b6d1-8da69d7fdb80]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:25 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85
Nov 04 01:14:25 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-f0f33dfc-080f-4d37-b1c2-d338492436bb-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-f0f33dfc-080f-4d37-b1c2-d338492436bb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:26 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170
Nov 04 01:14:26 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "cinder-quobyte-f0f33dfc-080f-4d37-b1c2-d338492436bb" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-f0f33dfc-080f-4d37-b1c2-d338492436bb" acquired by "delete_volume" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:26 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f14ff8b-d9df-4b76-b2ad-78697bd753b9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85" returned: 0 in 0.311s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:26 devstack sudo[106520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.info
Nov 04 01:14:26 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:26 devstack sudo[106519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb
Nov 04 01:14:26 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:26 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170" returned: 0 in 0.471s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:26 devstack sudo[106526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170
Nov 04 01:14:26 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:26 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.info" returned: 0 in 0.314s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:26 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.info is being set with open permissions: ugo+rw
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:26 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb" returned: 0 in 0.387s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:26 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.info
Nov 04 01:14:26 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:26 devstack sudo[106533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb
Nov 04 01:14:26 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:26 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-ed18c72e-213a-41bc-9a77-a33610b3f170" returned: 0 in 0.283s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-ed18c72e-213a-41bc-9a77-a33610b3f170" released by "delete_volume" :: held 0.812s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created reservations ['5227f032-b264-4629-b9ae-58a597cc2cc4', '850b3e4a-083b-4915-9b67-572da1eaeb69', '3218f0e6-5fa0-4e77-b8a1-b1d02daedc54', 'fb39c350-1052-482d-b7cd-45dea6654c1c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:26 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.info" returned: 0 in 0.284s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:26 devstack sudo[106539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:26 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:26 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.810s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998238738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37b3949-6d29-4d0b-8337-3f7832c2b098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:23Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Creating volume c37b3949-6d29-4d0b-8337-3f7832c2b098 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:26 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f0f33dfc-080f-4d37-b1c2-d338492436bb" returned: 0 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:26 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 1073741824
Nov 04 01:14:26 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-quobyte-f0f33dfc-080f-4d37-b1c2-d338492436bb" released by "delete_volume" :: held 0.830s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c620914d-1d7f-4d1c-b84d-cccb7e22c445 tempest-VolumeDependencyTests-465577248 None] Create snapshot completed successfully
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Created reservations ['f37cf6c7-3d9f-42b7-bebf-bbf8cc3e2fec', '840de65f-fc5c-4e59-a2dc-929af40aba1a', '4a9af1be-4b1d-409e-a1f6-c4f30adebb42', 'ad2b22cb-1394-4da0-8629-82fa6bc3276e'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-quobyte-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2" acquired by "delete_volume" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:27 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.374s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[5905d06c-45b2-4abc-b62a-d7bf48e9589b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Deleted volume successfully.
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-84934ddc-0eb0-4736-803c-b72636b9dc9f tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-ed18c72e-213a-41bc-9a77-a33610b3f170-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:27 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:27 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:27 devstack sudo[106546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2
Nov 04 01:14:27 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:27 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 1073741824" returned: 0 in 0.624s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:27 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:27 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098
Nov 04 01:14:27 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.334s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:27 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Deleted volume successfully.
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-751f70dc-86e1-4a18-af77-769c978d61f6 tempest-CreateVolumesFromSnapshotTest-2138386828 None] Lock "cinder-f0f33dfc-080f-4d37-b1c2-d338492436bb-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:27 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2" returned: 0 in 0.505s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:27 devstack sudo[106558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2
Nov 04 01:14:27 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:27 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098" returned: 0 in 0.328s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aa7761-b90c-4557-82dc-efc9d5aac3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c37b3949-6d29-4d0b-8337-3f7832c2b098', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd339029-cb9f-4eed-9ffa-90d1bfcdd7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Flow 'volume_create_manager' (9f9fe364-8662-4cd7-947e-70aa7220fb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e132e0-3cff-4162-bb86-a18bab81c10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:28 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Volume volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 (c37b3949-6d29-4d0b-8337-3f7832c2b098): created successfully
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd339029-cb9f-4eed-9ffa-90d1bfcdd7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (2f90b79b-5780-4afb-bde2-f4cd0e53d555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e132e0-3cff-4162-bb86-a18bab81c10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1051353836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa49212-9495-4c67-9ba1-fd688cf55c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2895bed30d754c9685611b2ef14de602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79c650c1-99d3-4cde-99c3-7f39f90a5e85,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:28Z,use_quota=True,user_id='2541798f77314e67962a1165804baefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d94e618-2587-4587-b9ba-9a5ac3721487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:28 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d94e618-2587-4587-b9ba-9a5ac3721487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2852d1-adcf-4caf-b87f-5820266c470a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2852d1-adcf-4caf-b87f-5820266c470a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1fa49212-9495-4c67-9ba1-fd688cf55c59', 'volume_name': 'volume-1fa49212-9495-4c67-9ba1-fd688cf55c59', 'volume_size': 1, 'snapshot_id': '79c650c1-99d3-4cde-99c3-7f39f90a5e85'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bf2d3d-f98f-4c37-91fc-fa881364585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bf2d3d-f98f-4c37-91fc-fa881364585b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de87817-d9ce-4ad5-91f0-6811cd055c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:28 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Volume 1fa49212-9495-4c67-9ba1-fd688cf55c59: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1fa49212-9495-4c67-9ba1-fd688cf55c59', 'volume_size': 1, 'snapshot_id': '79c650c1-99d3-4cde-99c3-7f39f90a5e85'}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2" returned: 0 in 0.314s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-03951f12-263d-49aa-93aa-00c8b7b082c3 tempest-ProjectMemberTests-1052399897 None] Created volume successfully.
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Acquiring lock "cinder-quobyte-79c650c1-99d3-4cde-99c3-7f39f90a5e85-1fa49212-9495-4c67-9ba1-fd688cf55c59" by "_create_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2" released by "delete_volume" :: held 0.913s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-79c650c1-99d3-4cde-99c3-7f39f90a5e85-1fa49212-9495-4c67-9ba1-fd688cf55c59" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Creating volume 1fa49212-9495-4c67-9ba1-fd688cf55c59 from snapshot 79c650c1-99d3-4cde-99c3-7f39f90a5e85 {{(pid=86660) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Acquiring lock "cinder-quobyte-1fa49212-9495-4c67-9ba1-fd688cf55c59" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-1fa49212-9495-4c67-9ba1-fd688cf55c59" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] snapshot: 79c650c1-99d3-4cde-99c3-7f39f90a5e85, volume: 1fa49212-9495-4c67-9ba1-fd688cf55c59,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6ea50b-1527-4aca-a48e-89ac4783ca00]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created reservations ['deb793d0-1cc7-4ccc-bfe9-9220e48a3a0b', '3a1137bc-b6f3-42dc-87cb-db9208978c8e', '6d304e28-85b1-4633-9cba-f07987ee3565', '55c18fec-f95f-450d-84fe-ace53b5d5f54'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:28 devstack sudo[106562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85
Nov 04 01:14:28 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:28 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:28 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:28 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.281s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Deleted volume successfully.
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f7edbcef-c67f-44dd-ba09-f971a61b1f46 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-680f39a4-fa96-43c5-ba9d-ab7a3ffd4df2-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:28 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85" returned: 0 in 0.516s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3388160f-fd7c-468a-a318-47af1799ff71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[3327a042-fa11-4c96-8cbf-deb5571f3912]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:28 devstack sudo[106570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71
Nov 04 01:14:28 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:29 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71" returned: 0 in 0.400s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 01:14:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 01:14:29 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59 not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 01:14:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:29 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59
Nov 04 01:14:29 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-quobyte-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:29 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:29 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca53bd3-7e73-458b-9f39-873c12680e83]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:29 devstack sudo[106580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76
Nov 04 01:14:29 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:30 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76" returned: 0 in 0.697s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:30 devstack sudo[106592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76
Nov 04 01:14:30 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:30 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76" returned: 0 in 0.475s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:30 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76" released by "delete_volume" :: held 1.236s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:30 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created reservations ['67caef63-1b42-49bb-a1bc-0ed2dccdbd6e', '48baf47f-6718-4871-9e61-50971d3eb54a', '0f142400-ef54-4a5b-a12d-a11dfbb24901', 'dc947fc0-3446-418c-b17a-5d420dc7b9bc'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:31 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:31 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:31 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.489s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:31 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:31 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Deleted volume successfully.
Nov 04 01:14:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a99f728b-33d4-4bb4-bac4-54b1f69e182b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-b74c0cf1-8787-412c-b7c1-f8fd85ba3c76-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-500df10f-e92d-4b47-a2a7-9dce29042d96-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-500df10f-e92d-4b47-a2a7-9dce29042d96-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:31 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-quobyte-500df10f-e92d-4b47-a2a7-9dce29042d96" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-500df10f-e92d-4b47-a2a7-9dce29042d96" acquired by "delete_volume" :: waited 0.037s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:32 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[042dc0c2-dc4c-4e5e-9190-9792255b9eff]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:32 devstack sudo[106600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96
Nov 04 01:14:32 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:32 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96" returned: 0 in 0.867s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:33 devstack sudo[106606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96
Nov 04 01:14:33 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:33 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-500df10f-e92d-4b47-a2a7-9dce29042d96" returned: 0 in 0.447s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-500df10f-e92d-4b47-a2a7-9dce29042d96" released by "delete_volume" :: held 1.430s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:33 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created reservations ['e1a17cb2-2789-4c11-9d28-32f29a4935a0', 'cc14dd34-addc-4eb7-aa82-bdbd88c98c7d', 'a037be32-73a2-4a9d-8c60-02166049e38b', 'ca4e1c27-fabc-411c-b245-5f06821addea'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:33 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:33 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:34 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.486s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:34 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:34 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Deleted volume successfully.
Nov 04 01:14:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a6085682-197b-4c3b-990e-4760ee2f9f5c tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-500df10f-e92d-4b47-a2a7-9dce29042d96-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-3cf750b8-958a-4ab4-9d63-04772827674e-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-3cf750b8-958a-4ab4-9d63-04772827674e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-quobyte-3cf750b8-958a-4ab4-9d63-04772827674e" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:34 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a9c52f94-02b9-4ec6-8b03-dd8ef90a05ce tempest-ProjectAdminTests-1020026527 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6460418701172, 'free_capacity_gb': 1773.6460418701172, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86660) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 04 01:14:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-3cf750b8-958a-4ab4-9d63-04772827674e" acquired by "delete_volume" :: waited 0.043s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:34 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a2ea1-62b3-431c-bd96-a1d5acf720a3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:34 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e
Nov 04 01:14:34 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:35 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e" returned: 0 in 0.626s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:35 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e
Nov 04 01:14:35 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:35 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3cf750b8-958a-4ab4-9d63-04772827674e" returned: 0 in 0.387s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-3cf750b8-958a-4ab4-9d63-04772827674e" released by "delete_volume" :: held 1.105s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:35 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created reservations ['1d114ba6-5a9b-40ab-903c-b91832e7caeb', 'd17b27b7-457a-4d9b-83c9-44dd90326643', '5dc13b6d-9a2b-40b9-851b-4c523064be7e', 'f1e75bd9-3eb7-4ce9-9dc1-c949ea8cd8d9'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:35 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:35 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:36 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.394s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:36 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:36 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Deleted volume successfully.
Nov 04 01:14:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1ece88d8-c1af-44f7-8d7d-0c70b0d929a3 tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-3cf750b8-958a-4ab4-9d63-04772827674e-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-62138ff9-a768-4809-89bc-c8df940a7723-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-62138ff9-a768-4809-89bc-c8df940a7723-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "cinder-quobyte-62138ff9-a768-4809-89bc-c8df940a7723" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:36 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-62138ff9-a768-4809-89bc-c8df940a7723" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:36 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8a3e41-12f4-49ac-8fed-6ae8f7914868]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:37 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723
Nov 04 01:14:37 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:37 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:37 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59" returned: 0 in 8.571s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:37 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:14:37 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Converted 1024.00 MB image at 119.45 MB/s
Nov 04 01:14:37 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59 is being set with open permissions: ugo+rw
Nov 04 01:14:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723" returned: 0 in 0.764s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:37 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59
Nov 04 01:14:37 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:37 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723
Nov 04 01:14:37 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:38 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:38 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59" returned: 0 in 0.288s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-62138ff9-a768-4809-89bc-c8df940a7723" returned: 0 in 0.283s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-1fa49212-9495-4c67-9ba1-fd688cf55c59" released by "_copy_volume_from_snapshot" :: held 9.889s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-quobyte-62138ff9-a768-4809-89bc-c8df940a7723" released by "delete_volume" :: held 1.159s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-79c650c1-99d3-4cde-99c3-7f39f90a5e85-1fa49212-9495-4c67-9ba1-fd688cf55c59" released by "_create_volume_from_snapshot" :: held 9.978s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.999s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.364s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] Creating offline snapshot 99a8a123-233d-4524-b4fe-8fce59c20bd1 of volume c37b3949-6d29-4d0b-8337-3f7832c2b098 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de87817-d9ce-4ad5-91f0-6811cd055c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa49212-9495-4c67-9ba1-fd688cf55c59', 'volume_size': 1, 'snapshot_id': '79c650c1-99d3-4cde-99c3-7f39f90a5e85'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e6f735-05b7-4001-bfe2-96785257dbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f00b09-fa0a-4454-b316-021914d76023]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Created reservations ['783c6fb6-e88e-4f45-b29f-108659e10a2f', 'd33d0e0d-d75d-4045-a3aa-6392ad97ed8c', '75b71230-5595-427c-969f-ffcd81d4782a', 'b77e3db2-398b-4c5c-b4ea-96ddfd7809c4'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:38 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Volume volume-1fa49212-9495-4c67-9ba1-fd688cf55c59 (1fa49212-9495-4c67-9ba1-fd688cf55c59): created successfully
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e6f735-05b7-4001-bfe2-96785257dbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Flow 'volume_create_manager' (9f9fe364-8662-4cd7-947e-70aa7220fb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:38 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c92c0712-790a-4105-8fde-369ce7ce2143 tempest-VolumeDependencyTests-465577248 None] Created volume successfully.
Nov 04 01:14:38 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098
Nov 04 01:14:38 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:38 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:38 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Acquiring lock "cinder-79c650c1-99d3-4cde-99c3-7f39f90a5e85-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Lock "cinder-79c650c1-99d3-4cde-99c3-7f39f90a5e85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Acquiring lock "cinder-quobyte-3388160f-fd7c-468a-a318-47af1799ff71" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-3388160f-fd7c-468a-a318-47af1799ff71" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Acquiring lock "cinder-quobyte-79c650c1-99d3-4cde-99c3-7f39f90a5e85" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-79c650c1-99d3-4cde-99c3-7f39f90a5e85" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Deleting offline snapshot 79c650c1-99d3-4cde-99c3-7f39f90a5e85 of volume 3388160f-fd7c-468a-a318-47af1799ff71 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] snapshot_file for this snap is: volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c58087-3fce-4f76-b16d-f1d643105190]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:38 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.304s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:38 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:38 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Deleted volume successfully.
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098" returned: 0 in 0.495s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:38 devstack sudo[106645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1 1G
Nov 04 01:14:38 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-46bb1d69-1714-4596-b58b-19cbf8a5df8b tempest-CreateVolumesFromSourceVolumeTest-1143783030 None] Lock "cinder-62138ff9-a768-4809-89bc-c8df940a7723-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:38 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:38 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85
Nov 04 01:14:38 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:39 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85" returned: 0 in 0.427s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3388160f-fd7c-468a-a318-47af1799ff71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba749b0-34a3-4008-9d20-2cff0aa1f65e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:39 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1 1G" returned: 0 in 0.513s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:39 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1
Nov 04 01:14:39 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:39 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71
Nov 04 01:14:39 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:39 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1" returned: 0 in 0.390s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:39 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1 is being set with open permissions: ugo+rw
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:39 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1
Nov 04 01:14:39 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:39 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71" returned: 0 in 0.729s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:39 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85
Nov 04 01:14:39 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:39 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1" returned: 0 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:39 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.info
Nov 04 01:14:39 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:40 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:40 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85" returned: 0 in 0.453s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.info" returned: 0 in 0.362s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:40 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.info is being set with open permissions: ugo+rw
Nov 04 01:14:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:40 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85
Nov 04 01:14:40 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:40 devstack sudo[106679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.info
Nov 04 01:14:40 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:40 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.info" returned: 0 in 0.326s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:40 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71.79c650c1-99d3-4cde-99c3-7f39f90a5e85" returned: 0 in 0.369s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:40 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1a695e1c-d667-4953-8565-6a2477468894 tempest-ProjectMemberTests-1052399897 None] Create snapshot completed successfully
Nov 04 01:14:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-79c650c1-99d3-4cde-99c3-7f39f90a5e85" released by "_delete_snapshot" :: held 2.139s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-3388160f-fd7c-468a-a318-47af1799ff71" released by "delete_snapshot" :: held 2.183s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:40 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Created reservations ['0b4d322b-bb10-4ea4-946c-38d98d24bdc4', '213280fe-f7e5-4cfe-9775-a28a4665bdc6', 'f0390f54-0b97-4fa1-a74d-b8c69818e82d', 'b3ee5cef-e633-4898-9093-8f11119288a5'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:40 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Delete snapshot completed successfully.
Nov 04 01:14:40 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eac37422-aa2b-4ab5-87f8-c0dc5bf327fe tempest-VolumeDependencyTests-465577248 None] Lock "cinder-79c650c1-99d3-4cde-99c3-7f39f90a5e85-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-99a8a123-233d-4524-b4fe-8fce59c20bd1-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Lock "cinder-99a8a123-233d-4524-b4fe-8fce59c20bd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-c37b3949-6d29-4d0b-8337-3f7832c2b098" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-c37b3949-6d29-4d0b-8337-3f7832c2b098" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-99a8a123-233d-4524-b4fe-8fce59c20bd1" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-99a8a123-233d-4524-b4fe-8fce59c20bd1" acquired by "_delete_snapshot" :: waited 0.093s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Deleting offline snapshot 99a8a123-233d-4524-b4fe-8fce59c20bd1 of volume c37b3949-6d29-4d0b-8337-3f7832c2b098 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] snapshot_file for this snap is: volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Acquiring lock "cinder-3388160f-fd7c-468a-a318-47af1799ff71-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafdbd2a-f96d-432f-98b2-4745526f2171]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Lock "cinder-3388160f-fd7c-468a-a318-47af1799ff71-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Acquiring lock "cinder-quobyte-3388160f-fd7c-468a-a318-47af1799ff71" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-3388160f-fd7c-468a-a318-47af1799ff71" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[87181deb-df05-4c2d-b144-b80d4eb9d455]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:41 devstack sudo[106685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1
Nov 04 01:14:41 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:42 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71
Nov 04 01:14:42 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:42 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1" returned: 0 in 0.579s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c37b3949-6d29-4d0b-8337-3f7832c2b098(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:14:42 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71" returned: 0 in 0.467s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e28a3b-507a-44a0-a08b-a9254d4db88c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:42 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71
Nov 04 01:14:42 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:42 devstack sudo[106698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098
Nov 04 01:14:42 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:42 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-3388160f-fd7c-468a-a318-47af1799ff71" returned: 0 in 0.316s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-3388160f-fd7c-468a-a318-47af1799ff71" released by "delete_volume" :: held 0.868s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Created reservations ['cf63db63-87be-43a2-8156-08ac1ed862b6', '62ee8803-6a23-4b32-99d9-d1e12032a0a9', 'a663a030-12a1-4906-b519-d5093c9f0111', 'edf1f712-b4e5-46c5-9136-aeb9f001b0bc'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:42 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:42 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:42 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098" returned: 0 in 0.543s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:42 devstack sudo[106707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1
Nov 04 01:14:42 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Acquiring lock "cinder-1fa49212-9495-4c67-9ba1-fd688cf55c59-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Lock "cinder-1fa49212-9495-4c67-9ba1-fd688cf55c59-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Acquiring lock "cinder-quobyte-1fa49212-9495-4c67-9ba1-fd688cf55c59" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-1fa49212-9495-4c67-9ba1-fd688cf55c59" acquired by "delete_volume" :: waited 0.034s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf79833-028a-4032-a40b-72f08c3bf7ce]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:43 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.354s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:43 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Deleted volume successfully.
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a5599f80-d162-429b-b9be-e4a9cf04fcce tempest-VolumeDependencyTests-465577248 None] Lock "cinder-3388160f-fd7c-468a-a318-47af1799ff71-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:43 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59
Nov 04 01:14:43 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:43 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1" returned: 0 in 0.546s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:43 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1
Nov 04 01:14:43 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:43 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59" returned: 0 in 0.474s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:43 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59
Nov 04 01:14:43 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:43 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098.99a8a123-233d-4524-b4fe-8fce59c20bd1" returned: 0 in 0.338s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-99a8a123-233d-4524-b4fe-8fce59c20bd1" released by "_delete_snapshot" :: held 2.179s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-c37b3949-6d29-4d0b-8337-3f7832c2b098" released by "delete_snapshot" :: held 2.286s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:43 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1fa49212-9495-4c67-9ba1-fd688cf55c59" returned: 0 in 0.313s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Created reservations ['29e48ddc-eb9b-4098-93fc-3ef19c6bd5f8', '115ab5dd-59c2-4d17-a6ba-5f3e49ca61a9', 'bb6276c6-982f-4778-a02a-4ef2fd065670', '2bb21a89-2c29-4332-bab0-9462ab534fe0'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Lock "cinder-quobyte-1fa49212-9495-4c67-9ba1-fd688cf55c59" released by "delete_volume" :: held 0.856s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Delete snapshot completed successfully.
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-eafe08e3-80bf-4dc3-8476-d0dc1f98e7ad tempest-ProjectMemberTests-1052399897 None] Lock "cinder-99a8a123-233d-4524-b4fe-8fce59c20bd1-delete_snapshot" released by "delete_snapshot" :: held 2.519s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Created reservations ['ef16b0a6-e6c3-46e3-a25c-064e2b42954d', 'fa4682d0-ab6e-4e03-a225-fdc66a071661', 'fb319cfe-e42e-4a71-9824-b4160fbb81ff', 'c4637084-9bfb-45ab-8999-160c656cca76'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:44 devstack sudo[106725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:44 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:44 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.358s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Deleted volume successfully.
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-ffb110a6-932c-49db-8919-775916620e4f tempest-VolumeDependencyTests-465577248 None] Lock "cinder-1fa49212-9495-4c67-9ba1-fd688cf55c59-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-c37b3949-6d29-4d0b-8337-3f7832c2b098-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Lock "cinder-c37b3949-6d29-4d0b-8337-3f7832c2b098-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-c37b3949-6d29-4d0b-8337-3f7832c2b098" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-c37b3949-6d29-4d0b-8337-3f7832c2b098" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a5a2ac-3c67-4f30-957e-1ce23bbf3f94]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:45 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098
Nov 04 01:14:45 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:45 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098" returned: 0 in 0.430s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:45 devstack sudo[106733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098
Nov 04 01:14:45 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:45 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c37b3949-6d29-4d0b-8337-3f7832c2b098" returned: 0 in 0.359s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:45 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-c37b3949-6d29-4d0b-8337-3f7832c2b098" released by "delete_volume" :: held 0.877s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:45 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Created reservations ['004f01f3-87ca-4c61-8c71-228cdd9ef6c9', '160c04fe-ab25-435c-b13f-e4a220222cc5', '92b7e286-3a0b-4f26-ab9e-f3b99d1dc790', '5a7bae2a-73bd-48d8-9b8c-4ccad3360330'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:45 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:45 devstack sudo[106736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:45 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:46 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.329s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:46 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Deleted volume successfully.
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9ee612aa-a3a4-4c23-8861-636063da2bff tempest-ProjectMemberTests-1052399897 None] Lock "cinder-c37b3949-6d29-4d0b-8337-3f7832c2b098-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (c0436862-d60e-4610-8c67-01dbe9e8a3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64213d85-182f-4539-aa2f-c299f9dbb7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64213d85-182f-4539-aa2f-c299f9dbb7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103260790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c3e508-ce04-427b-bb4a-7d396df18f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:47Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0035a7-304c-479a-ab3e-67564515f9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0035a7-304c-479a-ab3e-67564515f9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15483dbc-3457-41f0-8fc0-7aedcbcb79a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15483dbc-3457-41f0-8fc0-7aedcbcb79a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c3e508-ce04-427b-bb4a-7d396df18f16', 'volume_name': 'volume-e7c3e508-ce04-427b-bb4a-7d396df18f16', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdbe33b-7f3b-4642-90da-6bda9f39b507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdbe33b-7f3b-4642-90da-6bda9f39b507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96af236-1136-4da7-9fbb-fbfce90ffcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:46 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Volume e7c3e508-ce04-427b-bb4a-7d396df18f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c3e508-ce04-427b-bb4a-7d396df18f16', 'volume_size': 1}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103260790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c3e508-ce04-427b-bb4a-7d396df18f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:47Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Creating volume e7c3e508-ce04-427b-bb4a-7d396df18f16 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:46 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:46 devstack sudo[106739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 1073741824
Nov 04 01:14:46 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:47 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 1073741824" returned: 0 in 0.580s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:47 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16
Nov 04 01:14:47 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:47 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16" returned: 0 in 0.281s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96af236-1136-4da7-9fbb-fbfce90ffcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c3e508-ce04-427b-bb4a-7d396df18f16', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d4f18c-f80e-42b8-beab-090cc64af407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:47 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Volume volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 (e7c3e508-ce04-427b-bb4a-7d396df18f16): created successfully
Nov 04 01:14:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d4f18c-f80e-42b8-beab-090cc64af407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:47 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (c0436862-d60e-4610-8c67-01dbe9e8a3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:47 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-43a7963b-63b5-4fd7-ab3c-2ed60e0d6237 tempest-ProjectMemberTests-1052399897 None] Created volume successfully.
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Flow 'volume_create_manager' (64cff5be-84f6-4df3-895e-7307febedbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c11322-31e2-4303-8871-bca9d0779d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c11322-31e2-4303-8871-bca9d0779d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484186319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6035ef40-ef27-4450-88c4-b2037affcb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de74dff659594e4e9a6d4b829f243206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:49Z,use_quota=True,user_id='74abfca7466844818b590808d9d04d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0695109-461c-449f-8e59-52dec6b37148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0695109-461c-449f-8e59-52dec6b37148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f480b274-ec1b-4a73-84a7-3da8c2c19414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f480b274-ec1b-4a73-84a7-3da8c2c19414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6035ef40-ef27-4450-88c4-b2037affcb08', 'volume_name': 'volume-6035ef40-ef27-4450-88c4-b2037affcb08', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09554d15-f1a9-4d62-a728-727477aca9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09554d15-f1a9-4d62-a728-727477aca9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082f63bd-03de-4dee-89e3-b7d12ed8ec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:48 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Volume 6035ef40-ef27-4450-88c4-b2037affcb08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6035ef40-ef27-4450-88c4-b2037affcb08', 'volume_size': 1}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484186319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6035ef40-ef27-4450-88c4-b2037affcb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de74dff659594e4e9a6d4b829f243206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:49Z,use_quota=True,user_id='74abfca7466844818b590808d9d04d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Creating volume 6035ef40-ef27-4450-88c4-b2037affcb08 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:48 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:48 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08 1073741824
Nov 04 01:14:48 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=215,cinder:UPDATE=277,cinder:INSERT=74,cinder:DELETE=31 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:49 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08 1073741824" returned: 0 in 0.615s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=203,cinder:UPDATE=297,cinder:DELETE=20,cinder:INSERT=72 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:49 devstack sudo[106756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08
Nov 04 01:14:49 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:49 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08" returned: 0 in 0.344s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.632s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082f63bd-03de-4dee-89e3-b7d12ed8ec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6035ef40-ef27-4450-88c4-b2037affcb08', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160182b6-b8bc-4905-bd88-868f57e57e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] Creating offline snapshot 6cf30408-8b01-45ea-b18e-9dbac6755e26 of volume e7c3e508-ce04-427b-bb4a-7d396df18f16 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:14:49 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Volume volume-6035ef40-ef27-4450-88c4-b2037affcb08 (6035ef40-ef27-4450-88c4-b2037affcb08): created successfully
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160182b6-b8bc-4905-bd88-868f57e57e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Flow 'volume_create_manager' (64cff5be-84f6-4df3-895e-7307febedbd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[52268cab-094a-44af-8ae2-60fe8f7cabf3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:49 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-043c3ec2-80e2-441b-86ee-8ddc780c670c tempest-ProjectReaderTests-428599336 None] Created volume successfully.
Nov 04 01:14:50 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16
Nov 04 01:14:50 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:50 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16" returned: 0 in 0.496s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:50 devstack sudo[106765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26 1G
Nov 04 01:14:50 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:50 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26 1G" returned: 0 in 0.480s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:50 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26
Nov 04 01:14:50 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:50 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Acquiring lock "cinder-6035ef40-ef27-4450-88c4-b2037affcb08-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Lock "cinder-6035ef40-ef27-4450-88c4-b2037affcb08-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Acquiring lock "cinder-quobyte-6035ef40-ef27-4450-88c4-b2037affcb08" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Lock "cinder-quobyte-6035ef40-ef27-4450-88c4-b2037affcb08" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b8ef8e-295a-4cdd-a181-39072fa5487a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:51 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26" returned: 0 in 0.398s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:51 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08
Nov 04 01:14:51 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:51 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26 is being set with open permissions: ugo+rw
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:51 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26
Nov 04 01:14:51 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:51 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08" returned: 0 in 0.482s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:51 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26" returned: 0 in 0.371s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:51 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08
Nov 04 01:14:51 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:51 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.info
Nov 04 01:14:51 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:51 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:51 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:52 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.info" returned: 0 in 0.331s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:52 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.info is being set with open permissions: ugo+rw
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:52 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6035ef40-ef27-4450-88c4-b2037affcb08" returned: 0 in 0.449s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:52 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:52 devstack sudo[106795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.info
Nov 04 01:14:52 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.355s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Lock "cinder-quobyte-6035ef40-ef27-4450-88c4-b2037affcb08" released by "delete_volume" :: held 1.014s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Created reservations ['ed5fed97-669e-422a-ac1b-a0846c20d4c8', 'd15588a5-e59a-4f4d-844c-f763ee3e040f', '15311f0c-d350-43f3-a633-1a7159d1b452', 'ff8ae7fe-9985-4c3d-882e-233d9c828d38'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:52 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:52 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:52 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.info" returned: 0 in 0.435s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:52 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-de3e55c7-df3d-4700-b935-b4298797f2f1 tempest-ProjectMemberTests-1052399897 None] Create snapshot completed successfully
Nov 04 01:14:52 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.285s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:52 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Deleted volume successfully.
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-395c5ce8-5f1d-478f-85be-870a5514729d tempest-ProjectReaderTests-428599336 None] Lock "cinder-6035ef40-ef27-4450-88c4-b2037affcb08-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Flow 'volume_create_manager' (fc282ea8-1d22-497a-acfb-567f2ebe6a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1d7628-a9a0-4096-b556-f1be0d33e999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1d7628-a9a0-4096-b556-f1be0d33e999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a40918-f67c-4f8d-ad99-312548b8be04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a8ea3f63d44f65ac73d36e83df8aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:53Z,use_quota=True,user_id='f4fa90efcefc4232adf4331d4f2f42ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c83bdef-62da-45a5-86f6-d7539bdf8d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c83bdef-62da-45a5-86f6-d7539bdf8d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3857db-ff74-423d-a27b-1d72dbe027ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:52 devstack cinder-volume[86660]: DEBUG cinder.image.glance [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Creating Keystone auth plugin from conf {{(pid=86660) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3857db-ff74-423d-a27b-1d72dbe027ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38a40918-f67c-4f8d-ad99-312548b8be04', 'volume_name': 'volume-38a40918-f67c-4f8d-ad99-312548b8be04', 'volume_size': 1, 'image_id': '149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c0701c93722416abd8352f80170c757', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2a8ea3f63d44f65ac73d36e83df8aad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '726b8945b08c0203b158638c6426f9c34efe0221090576f2e7e9f7cd62313f01255a2b119a50ec133b634929da485f69a8ca04d5af9a5ea17f71de1147f04fd1', 'id': '149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'created_at': datetime.datetime(2026, 11, 4, 0, 14, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 14, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/149be2bc-477c-4530-8bc2-5f1d42d7fdf7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547692420>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf521161-5a20-4eb5-9c82-56211f68ff87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf521161-5a20-4eb5-9c82-56211f68ff87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21be549-dd8c-4600-a9ad-124027da29b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:53 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Volume 38a40918-f67c-4f8d-ad99-312548b8be04: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38a40918-f67c-4f8d-ad99-312548b8be04', 'volume_size': 1, 'image_id': '149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c0701c93722416abd8352f80170c757', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2a8ea3f63d44f65ac73d36e83df8aad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '726b8945b08c0203b158638c6426f9c34efe0221090576f2e7e9f7cd62313f01255a2b119a50ec133b634929da485f69a8ca04d5af9a5ea17f71de1147f04fd1', 'id': '149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'created_at': datetime.datetime(2026, 11, 4, 0, 14, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 14, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/149be2bc-477c-4530-8bc2-5f1d42d7fdf7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547692420>}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Trying to clone 38a40918-f67c-4f8d-ad99-312548b8be04 from image 149be2bc-477c-4530-8bc2-5f1d42d7fdf7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'metadata': {}}]). {{(pid=86660) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 01:14:53 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Image download 0.00 MB at 0.00 MB/s
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbc57a3-6936-454d-972b-bee5ddf259b0]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:53 devstack sudo[106801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD
Nov 04 01:14:53 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-6cf30408-8b01-45ea-b18e-9dbac6755e26-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-6cf30408-8b01-45ea-b18e-9dbac6755e26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-e7c3e508-ce04-427b-bb4a-7d396df18f16" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-e7c3e508-ce04-427b-bb4a-7d396df18f16" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-6cf30408-8b01-45ea-b18e-9dbac6755e26" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-6cf30408-8b01-45ea-b18e-9dbac6755e26" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Deleting offline snapshot 6cf30408-8b01-45ea-b18e-9dbac6755e26 of volume e7c3e508-ce04-427b-bb4a-7d396df18f16 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:14:53 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] snapshot_file for this snap is: volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1e9b03-ba54-4530-94da-f5431bfc1ff5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:53 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26
Nov 04 01:14:53 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:53 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD
Nov 04 01:14:53 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Flow 'volume_create_manager' (9e0c0440-0a10-4b4f-848f-2f4c2a36b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f493ffb-e430-4dfe-9264-9d00fdc3491f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f493ffb-e430-4dfe-9264-9d00fdc3491f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686056950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4e3327-c732-43de-a1a7-3aaa80f1f6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de74dff659594e4e9a6d4b829f243206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:54Z,use_quota=True,user_id='74abfca7466844818b590808d9d04d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:53 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a86ffd1-6cee-46b8-89af-2fcdb1931adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a86ffd1-6cee-46b8-89af-2fcdb1931adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649701ef-bec6-4e85-a066-fbbfa308bda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649701ef-bec6-4e85-a066-fbbfa308bda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4e3327-c732-43de-a1a7-3aaa80f1f6a4', 'volume_name': 'volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab92bf1-ef63-4129-a3b0-766e5610649b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab92bf1-ef63-4129-a3b0-766e5610649b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff94d8bc-6c6f-4721-8336-c90eba345f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:54 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Volume 0c4e3327-c732-43de-a1a7-3aaa80f1f6a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4', 'volume_size': 1}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:54 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686056950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4e3327-c732-43de-a1a7-3aaa80f1f6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de74dff659594e4e9a6d4b829f243206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:54Z,use_quota=True,user_id='74abfca7466844818b590808d9d04d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Creating volume 0c4e3327-c732-43de-a1a7-3aaa80f1f6a4 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:54 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26" returned: 0 in 0.486s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7c3e508-ce04-427b-bb4a-7d396df18f16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:14:54 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:54 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4 1073741824
Nov 04 01:14:54 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD" returned: 1 in 0.526s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Temporary image 149be2bc-477c-4530-8bc2-5f1d42d7fdf7 is fetched for user f4fa90efcefc4232adf4331d4f2f42ac. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ac942f-ed9a-4214-9e53-de8f844f6729]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e9dc47-077a-49cd-8843-c10c3d2c9c6c]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:54 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16
Nov 04 01:14:54 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:54 devstack sudo[106819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD
Nov 04 01:14:54 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:54 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16" returned: 0 in 0.549s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:54 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:54 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:54 devstack sudo[106830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4 1073741824" returned: 0 in 0.644s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:54 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:54 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4
Nov 04 01:14:54 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:54 devstack sudo[106831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD
Nov 04 01:14:54 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:54 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26" returned: 0 in 0.346s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:55 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26
Nov 04 01:14:55 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:55 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4" returned: 0 in 0.297s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:55 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a40918-f67c-4f8d-ad99-312548b8be04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a8ea3f63d44f65ac73d36e83df8aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:53Z,use_quota=True,user_id='f4fa90efcefc4232adf4331d4f2f42ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Creating volume 38a40918-f67c-4f8d-ad99-312548b8be04 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:55 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff94d8bc-6c6f-4721-8336-c90eba345f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:55 devstack sudo[106845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04 1073741824
Nov 04 01:14:55 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbd8ef3-5df2-4b92-a60d-53a7530a79a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:55 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Volume volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4 (0c4e3327-c732-43de-a1a7-3aaa80f1f6a4): created successfully
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbd8ef3-5df2-4b92-a60d-53a7530a79a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Flow 'volume_create_manager' (9e0c0440-0a10-4b4f-848f-2f4c2a36b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-518a34a5-00e1-4179-a4ea-23dfb6efa8c5 tempest-ProjectReaderTests-428599336 None] Created volume successfully.
Nov 04 01:14:55 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16.6cf30408-8b01-45ea-b18e-9dbac6755e26" returned: 0 in 0.270s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-6cf30408-8b01-45ea-b18e-9dbac6755e26" released by "_delete_snapshot" :: held 1.817s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-e7c3e508-ce04-427b-bb4a-7d396df18f16" released by "delete_snapshot" :: held 1.845s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Created reservations ['d2d193d9-0aca-4964-9b1e-e1b94fb47fc3', 'aaad77ee-1e07-4989-a0a8-754555723f01', '9fbf12fd-f56f-4ba7-8424-4a281b19d95e', 'eb71b320-e2f0-49d1-b692-829b59c4746c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Delete snapshot completed successfully.
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2c55eb31-6f21-4448-8391-6d0440bb7d50 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-6cf30408-8b01-45ea-b18e-9dbac6755e26-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:55 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04 1073741824" returned: 0 in 0.466s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:55 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04
Nov 04 01:14:55 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-e7c3e508-ce04-427b-bb4a-7d396df18f16-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Lock "cinder-e7c3e508-ce04-427b-bb4a-7d396df18f16-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-e7c3e508-ce04-427b-bb4a-7d396df18f16" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-e7c3e508-ce04-427b-bb4a-7d396df18f16" acquired by "delete_volume" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:55 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04" returned: 0 in 0.409s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[5339630b-f64b-4a4b-add3-a06814770ae1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Attempting download of 149be2bc-477c-4530-8bc2-5f1d42d7fdf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'metadata': {}}])) to volume 38a40918-f67c-4f8d-ad99-312548b8be04. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Acquiring lock "cinder-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Lock "cinder-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0d06db-396f-42a0-9eb0-b7ddcfd91705]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_g2mkkjye {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Acquiring lock "cinder-quobyte-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Lock "cinder-quobyte-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:14:56 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16
Nov 04 01:14:56 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac26da0-c3d4-4717-a604-8669a18df793]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:56 devstack sudo[106856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_g2mkkjye
Nov 04 01:14:56 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:56 devstack sudo[106858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4
Nov 04 01:14:56 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:56 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16" returned: 0 in 0.498s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:56 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_g2mkkjye" returned: 0 in 0.379s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_g2mkkjye {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:56 devstack sudo[106867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16
Nov 04 01:14:56 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:56 devstack sudo[106868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_g2mkkjye
Nov 04 01:14:56 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:56 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4" returned: 0 in 0.484s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:56 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4
Nov 04 01:14:56 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:56 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e7c3e508-ce04-427b-bb4a-7d396df18f16" returned: 0 in 0.337s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-e7c3e508-ce04-427b-bb4a-7d396df18f16" released by "delete_volume" :: held 0.947s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:56 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_g2mkkjye" returned: 1 in 0.411s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_g2mkkjye' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0caeece-24c3-47f6-81da-d89443d7ddf5]: (4, 'raw') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:56 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Created reservations ['4b28a6ac-6204-400c-865a-8c6c0365efbd', 'dce51f19-2e4c-4790-b778-2d6ea1462a6c', '4ecff3dd-9e9b-4b6b-a83c-c5b5a3483dc4', 'edc47738-3764-454f-aa6a-26e5f72b61c3'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:57 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4" returned: 0 in 0.367s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:57 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD
Nov 04 01:14:57 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Lock "cinder-quobyte-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4" released by "delete_volume" :: held 0.939s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:57 devstack sudo[106882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:57 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Created reservations ['d1692f55-b72f-4666-b36a-3135f1e5346e', 'e84b8339-84d9-419f-9f09-7fe0683b0f12', 'bf25bd5f-6b9f-4963-9582-be7411eb015d', '3f6f336f-c63c-4653-bc80-803ecf32ef89'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:57 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:57 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:57 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:57 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.343s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Deleted volume successfully.
Nov 04 01:14:57 devstack sudo[106888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD
Nov 04 01:14:57 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-da09bc57-9672-4823-ab28-a10952fb979c tempest-ProjectMemberTests-1052399897 None] Lock "cinder-e7c3e508-ce04-427b-bb4a-7d396df18f16-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:57 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.306s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:14:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Deleted volume successfully.
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9d5275fd-bc9d-405f-884e-5104a0057d19 tempest-ProjectReaderTests-428599336 None] Lock "cinder-0c4e3327-c732-43de-a1a7-3aaa80f1f6a4-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:14:57 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] 149be2bc-477c-4530-8bc2-5f1d42d7fdf7 was raw, converting to qcow2 {{(pid=86660) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 01:14:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:57 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04
Nov 04 01:14:57 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:58 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04" returned: 0 in 0.519s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_149be2bc-477c-4530-8bc2-5f1d42d7fdf7_u7y_cl3udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04 {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:14:58 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Converted 0.00 MB image at 0.00 MB/s
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:58 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04 1G
Nov 04 01:14:58 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:58 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (ae25b274-a87c-49e7-bebb-f72c7c202696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2531efa3-b16c-418d-a4ea-e1990429a5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04 1G" returned: 0 in 0.503s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Downloaded image 149be2bc-477c-4530-8bc2-5f1d42d7fdf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'metadata': {}}])) to volume 38a40918-f67c-4f8d-ad99-312548b8be04 successfully. {{(pid=86660) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Temporary image 149be2bc-477c-4530-8bc2-5f1d42d7fdf7 for user f4fa90efcefc4232adf4331d4f2f42ac is deleted. {{(pid=86660) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.volume_utils [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Marking volume 38a40918-f67c-4f8d-ad99-312548b8be04 as bootable. {{(pid=86660) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2531efa3-b16c-418d-a4ea-e1990429a5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-223921802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4381f2-3e9e-4f55-9f56-fc53eaa35475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:59Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec71f46-173f-4fc5-a840-32d4e11abdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec71f46-173f-4fc5-a840-32d4e11abdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba96e8c2-139b-42c5-97b7-b4c0420269a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba96e8c2-139b-42c5-97b7-b4c0420269a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4381f2-3e9e-4f55-9f56-fc53eaa35475', 'volume_name': 'volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f4bbfe-3246-41b3-80bc-dfde8cc041f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f4bbfe-3246-41b3-80bc-dfde8cc041f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8b8a14-c1ff-431c-b1fa-d55be6a72ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:58 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Volume 1d4381f2-3e9e-4f55-9f56-fc53eaa35475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475', 'volume_size': 1}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-223921802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4381f2-3e9e-4f55-9f56-fc53eaa35475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:59Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Creating volume 1d4381f2-3e9e-4f55-9f56-fc53eaa35475 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:58 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Copying metadata from image 149be2bc-477c-4530-8bc2-5f1d42d7fdf7 to 38a40918-f67c-4f8d-ad99-312548b8be04. {{(pid=86660) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Creating volume glance metadata for volume 38a40918-f67c-4f8d-ad99-312548b8be04 backed by image 149be2bc-477c-4530-8bc2-5f1d42d7fdf7 with: {'image_id': '149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9c0701c93722416abd8352f80170c757', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86660) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 01:14:58 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 1073741824
Nov 04 01:14:58 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:58 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Flow 'volume_create_manager' (9e5214de-25da-4e46-8d20-579d419ee1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8dad3e6-3731-4492-a50f-cda29bca361e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21be549-dd8c-4600-a9ad-124027da29b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a40918-f67c-4f8d-ad99-312548b8be04', 'volume_size': 1, 'image_id': '149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c0701c93722416abd8352f80170c757', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2a8ea3f63d44f65ac73d36e83df8aad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '726b8945b08c0203b158638c6426f9c34efe0221090576f2e7e9f7cd62313f01255a2b119a50ec133b634929da485f69a8ca04d5af9a5ea17f71de1147f04fd1', 'id': '149be2bc-477c-4530-8bc2-5f1d42d7fdf7', 'created_at': datetime.datetime(2026, 11, 4, 0, 14, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 0, 14, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/149be2bc-477c-4530-8bc2-5f1d42d7fdf7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76b547692420>}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94070e5-9cbc-4b2f-b2b6-1e207429242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8dad3e6-3731-4492-a50f-cda29bca361e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161860772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c39d144-6ea4-4b26-ae4c-955e49a4158a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de74dff659594e4e9a6d4b829f243206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:59Z,use_quota=True,user_id='74abfca7466844818b590808d9d04d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a4ea64-5612-4238-8712-4fa0b4504bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a4ea64-5612-4238-8712-4fa0b4504bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd09910-acce-498e-bd28-27439b8b1690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd09910-acce-498e-bd28-27439b8b1690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c39d144-6ea4-4b26-ae4c-955e49a4158a', 'volume_name': 'volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d13ee1-9bc4-4261-8bec-87bd049518ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d13ee1-9bc4-4261-8bec-87bd049518ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19f46ad-67aa-401a-b5bb-ece225dbbd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:59 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Volume 0c39d144-6ea4-4b26-ae4c-955e49a4158a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a', 'volume_size': 1}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:59 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Volume volume-38a40918-f67c-4f8d-ad99-312548b8be04 (38a40918-f67c-4f8d-ad99-312548b8be04): created successfully
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94070e5-9cbc-4b2f-b2b6-1e207429242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Flow 'volume_create_manager' (fc282ea8-1d22-497a-acfb-567f2ebe6a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:59 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ff13cd7f-538c-4297-9768-38a6e68c1444 tempest-VolumeImageDependencyTests-7338786 None] Created volume successfully.
Nov 04 01:14:59 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 1073741824" returned: 0 in 0.522s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:59 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475
Nov 04 01:14:59 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:59 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475" returned: 0 in 0.265s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161860772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c39d144-6ea4-4b26-ae4c-955e49a4158a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de74dff659594e4e9a6d4b829f243206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:14:59Z,use_quota=True,user_id='74abfca7466844818b590808d9d04d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Creating volume 0c39d144-6ea4-4b26-ae4c-955e49a4158a {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:14:59 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:14:59 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a 1073741824
Nov 04 01:14:59 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8b8a14-c1ff-431c-b1fa-d55be6a72ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992cb9a5-1c44-412e-8e4d-2bbf02e5eeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:14:59 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Volume volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 (1d4381f2-3e9e-4f55-9f56-fc53eaa35475): created successfully
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992cb9a5-1c44-412e-8e4d-2bbf02e5eeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:14:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (ae25b274-a87c-49e7-bebb-f72c7c202696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:14:59 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-31819250-47c1-4755-b981-e1b80a3e5f5a tempest-ProjectMemberTests-1052399897 None] Created volume successfully.
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Acquiring lock "cinder-38a40918-f67c-4f8d-ad99-312548b8be04-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:00 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a 1073741824" returned: 0 in 0.544s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Lock "cinder-38a40918-f67c-4f8d-ad99-312548b8be04-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Acquiring lock "cinder-quobyte-38a40918-f67c-4f8d-ad99-312548b8be04" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Lock "cinder-quobyte-38a40918-f67c-4f8d-ad99-312548b8be04" acquired by "delete_volume" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:00 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a
Nov 04 01:15:00 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[575c5a3c-3f5d-41db-8c6c-1a3a6c1ae33d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:00 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04
Nov 04 01:15:00 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:00 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a" returned: 0 in 0.255s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19f46ad-67aa-401a-b5bb-ece225dbbd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4fb577-8470-465d-a944-573312dfd703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:00 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Volume volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a (0c39d144-6ea4-4b26-ae4c-955e49a4158a): created successfully
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4fb577-8470-465d-a944-573312dfd703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Flow 'volume_create_manager' (9e5214de-25da-4e46-8d20-579d419ee1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:00 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-0d1852d3-9f67-439b-812f-a3d877e590bf tempest-ProjectReaderTests-428599336 None] Created volume successfully.
Nov 04 01:15:00 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04" returned: 0 in 0.413s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:00 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04
Nov 04 01:15:00 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] Creating offline snapshot 4527f5f4-9ec0-421f-b893-9ff31842c918 of volume 1d4381f2-3e9e-4f55-9f56-fc53eaa35475 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eab4f3-1d02-4ab1-b85c-07b843b59fc3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:01 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-38a40918-f67c-4f8d-ad99-312548b8be04" returned: 0 in 0.264s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Lock "cinder-quobyte-38a40918-f67c-4f8d-ad99-312548b8be04" released by "delete_volume" :: held 0.727s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:01 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475
Nov 04 01:15:01 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Created reservations ['d9b8d904-f76b-43ba-bc7b-8c9255c1fc22', 'b981966b-fafb-45c7-b8e4-923d3c2f1c1b', 'f78bf182-c7b8-4f0d-90e0-fc97381c0596', '7b16f314-1a18-449a-a966-fac674ec9479'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Acquiring lock "cinder-0c39d144-6ea4-4b26-ae4c-955e49a4158a-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Lock "cinder-0c39d144-6ea4-4b26-ae4c-955e49a4158a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Acquiring lock "cinder-quobyte-0c39d144-6ea4-4b26-ae4c-955e49a4158a" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:01 devstack sudo[106940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Lock "cinder-quobyte-0c39d144-6ea4-4b26-ae4c-955e49a4158a" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:01 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb0c461-9125-4407-a3cf-2eb0dfaeac7b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:01 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475" returned: 0 in 0.524s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:01 devstack sudo[106942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a
Nov 04 01:15:01 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:01 devstack sudo[106948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918 1G
Nov 04 01:15:01 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:01 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.342s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Deleted volume successfully.
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1060b230-614c-41ae-95e3-a7e19f217a74 tempest-VolumeImageDependencyTests-7338786 None] Lock "cinder-38a40918-f67c-4f8d-ad99-312548b8be04-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:01 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a" returned: 0 in 0.556s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:01 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a
Nov 04 01:15:01 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:02 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918 1G" returned: 0 in 0.658s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:02 devstack sudo[106958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918
Nov 04 01:15:02 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:02 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-0c39d144-6ea4-4b26-ae4c-955e49a4158a" returned: 0 in 0.342s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Lock "cinder-quobyte-0c39d144-6ea4-4b26-ae4c-955e49a4158a" released by "delete_volume" :: held 0.984s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Created reservations ['50b4a38c-dcd6-48e6-a258-b14eb4ed7a0d', '39bcfe80-ed97-4efe-8f94-5c1ca66cddcb', 'a62310af-83c2-42e3-ae7b-5bb5af10fc2d', 'ac9ebb57-74ff-4118-884d-ee8e2a742b20'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:02 devstack sudo[106964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:02 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:02 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918" returned: 0 in 0.503s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:02 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918 is being set with open permissions: ugo+rw
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:02 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918
Nov 04 01:15:02 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:02 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.297s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:02 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Deleted volume successfully.
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-5a6b22ed-08cb-4e62-b2c5-e3fb356974ac tempest-ProjectReaderTests-428599336 None] Lock "cinder-0c39d144-6ea4-4b26-ae4c-955e49a4158a-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:02 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918" returned: 0 in 0.316s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:03 devstack sudo[106970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.info
Nov 04 01:15:03 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:03 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.info" returned: 0 in 0.269s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:03 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.info is being set with open permissions: ugo+rw
Nov 04 01:15:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:03 devstack sudo[106973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.info
Nov 04 01:15:03 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:03 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.info" returned: 0 in 0.287s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.662s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-88e4b6ca-da51-482d-90ca-5accd6b2eabb tempest-ProjectMemberTests-1052399897 None] Create snapshot completed successfully
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Flow 'volume_create_manager' (d3133089-ec3b-46da-9cfc-52e0dead023b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5022e4c-a7e6-46d1-a093-070f0e7a057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5022e4c-a7e6-46d1-a093-070f0e7a057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779671958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5d2437-7633-4bfe-8357-bc99a3fbc873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de74dff659594e4e9a6d4b829f243206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:04Z,use_quota=True,user_id='74abfca7466844818b590808d9d04d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f43becb-6691-4d8d-8566-d8ae77d0364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f43becb-6691-4d8d-8566-d8ae77d0364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685b211c-c73f-4e34-9987-a38542f93d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685b211c-c73f-4e34-9987-a38542f93d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5d2437-7633-4bfe-8357-bc99a3fbc873', 'volume_name': 'volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed084fe1-a178-4c60-935f-d0ddb18f7c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed084fe1-a178-4c60-935f-d0ddb18f7c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419e1f88-5f38-4d73-a3a8-89f4ca52675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:04 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Volume 6c5d2437-7633-4bfe-8357-bc99a3fbc873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873', 'volume_size': 1}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779671958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5d2437-7633-4bfe-8357-bc99a3fbc873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de74dff659594e4e9a6d4b829f243206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:04Z,use_quota=True,user_id='74abfca7466844818b590808d9d04d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Creating volume 6c5d2437-7633-4bfe-8357-bc99a3fbc873 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:15:04 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-4527f5f4-9ec0-421f-b893-9ff31842c918-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:04 devstack sudo[106978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873 1073741824
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Lock "cinder-4527f5f4-9ec0-421f-b893-9ff31842c918-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-1d4381f2-3e9e-4f55-9f56-fc53eaa35475" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:04 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-1d4381f2-3e9e-4f55-9f56-fc53eaa35475" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-4527f5f4-9ec0-421f-b893-9ff31842c918" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-4527f5f4-9ec0-421f-b893-9ff31842c918" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Deleting offline snapshot 4527f5f4-9ec0-421f-b893-9ff31842c918 of volume 1d4381f2-3e9e-4f55-9f56-fc53eaa35475 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] snapshot_file for this snap is: volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[503b2342-e172-4ce0-ac4c-bfe1dd144721]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:04 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918
Nov 04 01:15:04 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:04 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873 1073741824" returned: 0 in 0.631s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:04 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873
Nov 04 01:15:04 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:04 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918" returned: 0 in 0.605s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe527aa-ded3-472e-ae63-5b65dd6eeaed]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:05 devstack sudo[106992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475
Nov 04 01:15:05 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:05 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873" returned: 0 in 0.295s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419e1f88-5f38-4d73-a3a8-89f4ca52675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041dab51-49be-4f7b-bfa2-7c1155fe645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:05 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Volume volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873 (6c5d2437-7633-4bfe-8357-bc99a3fbc873): created successfully
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041dab51-49be-4f7b-bfa2-7c1155fe645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Flow 'volume_create_manager' (d3133089-ec3b-46da-9cfc-52e0dead023b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:05 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-59edeb5b-91e2-4368-b211-3e4ef97da234 tempest-ProjectReaderTests-428599336 None] Created volume successfully.
Nov 04 01:15:05 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475" returned: 0 in 0.401s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:05 devstack sudo[106998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918
Nov 04 01:15:05 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:05 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918" returned: 0 in 0.348s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:05 devstack sudo[107004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918
Nov 04 01:15:05 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:06 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475.4527f5f4-9ec0-421f-b893-9ff31842c918" returned: 0 in 0.282s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-4527f5f4-9ec0-421f-b893-9ff31842c918" released by "_delete_snapshot" :: held 1.805s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-1d4381f2-3e9e-4f55-9f56-fc53eaa35475" released by "delete_snapshot" :: held 1.837s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Created reservations ['984ca727-9b4c-4f1d-8569-f0aa26900729', '177e1c46-c087-4573-a09f-3be4438e18ce', 'a380db08-e351-42e2-8892-ff8d94ccbafa', 'f06cd3ac-3860-4bd3-9403-aa08ef87422d'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Acquiring lock "cinder-6c5d2437-7633-4bfe-8357-bc99a3fbc873-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Lock "cinder-6c5d2437-7633-4bfe-8357-bc99a3fbc873-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Acquiring lock "cinder-quobyte-6c5d2437-7633-4bfe-8357-bc99a3fbc873" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Lock "cinder-quobyte-6c5d2437-7633-4bfe-8357-bc99a3fbc873" acquired by "delete_volume" :: waited 0.032s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:06 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Delete snapshot completed successfully.
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f8fa9761-2e5b-4bbc-8c17-d0718be408de tempest-ProjectMemberTests-1052399897 None] Lock "cinder-4527f5f4-9ec0-421f-b893-9ff31842c918-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb00247-e8bd-4f22-9938-e57d83c90723]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-1d4381f2-3e9e-4f55-9f56-fc53eaa35475-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-1d4381f2-3e9e-4f55-9f56-fc53eaa35475-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-1d4381f2-3e9e-4f55-9f56-fc53eaa35475" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-1d4381f2-3e9e-4f55-9f56-fc53eaa35475" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:06 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873
Nov 04 01:15:06 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d339d88a-54a4-4fdb-b0cf-b977a25b101f]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:06 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475
Nov 04 01:15:06 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:06 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873" returned: 0 in 0.474s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:06 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873
Nov 04 01:15:06 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:07 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475" returned: 0 in 0.479s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:07 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475
Nov 04 01:15:07 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:07 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6c5d2437-7633-4bfe-8357-bc99a3fbc873" returned: 0 in 0.303s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Lock "cinder-quobyte-6c5d2437-7633-4bfe-8357-bc99a3fbc873" released by "delete_volume" :: held 0.844s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Created reservations ['0f2c1fbb-024d-40cd-83a8-d56b83907ff7', 'e811f21f-8fe3-4953-9dc2-ca81db6e8363', 'e6361867-b893-4de4-bad2-1dffea66624f', 'd40f9061-eace-42c1-8778-baa99829a37c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:07 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:07 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:07 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1d4381f2-3e9e-4f55-9f56-fc53eaa35475" returned: 0 in 0.368s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-1d4381f2-3e9e-4f55-9f56-fc53eaa35475" released by "delete_volume" :: held 0.950s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Created reservations ['2e283ee6-774c-4930-bfd7-1fd38143cbc2', '71fce1b3-9216-432f-b73c-5ec7c75aabf8', 'ac31cb5e-a5f8-4bf8-b824-4ac53a79c36d', 'bf41bd12-03ae-4caa-95ce-72a6b3a4cb67'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:07 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.386s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:07 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:07 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:07 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Deleted volume successfully.
Nov 04 01:15:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-6cc878ab-0b19-421c-94f1-65272870a029 tempest-ProjectReaderTests-428599336 None] Lock "cinder-6c5d2437-7633-4bfe-8357-bc99a3fbc873-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:08 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.395s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:08 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Deleted volume successfully.
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-2a7a854d-8945-485e-bfb5-4d8f01822c35 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-1d4381f2-3e9e-4f55-9f56-fc53eaa35475-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (d537b8c0-96d5-4d62-88b5-83e7f7d52263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9448ee4c-f743-4acf-bc1f-4ad741a60d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9448ee4c-f743-4acf-bc1f-4ad741a60d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1394815472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8d39d4-0459-420f-a804-35e0d22b8c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:08Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a91a663-c841-4460-853f-a5883aeff96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a91a663-c841-4460-853f-a5883aeff96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b223688-cbdc-4327-a085-8dd7d6284297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b223688-cbdc-4327-a085-8dd7d6284297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8d39d4-0459-420f-a804-35e0d22b8c98', 'volume_name': 'volume-4f8d39d4-0459-420f-a804-35e0d22b8c98', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dda35de-32e2-456e-a19b-b325b989bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dda35de-32e2-456e-a19b-b325b989bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3ae45e-3bd9-4192-89ab-0b75af71dd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:08 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Volume 4f8d39d4-0459-420f-a804-35e0d22b8c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8d39d4-0459-420f-a804-35e0d22b8c98', 'volume_size': 1}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1394815472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8d39d4-0459-420f-a804-35e0d22b8c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:08Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Creating volume 4f8d39d4-0459-420f-a804-35e0d22b8c98 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:15:08 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:15:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:08 devstack sudo[107031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 1073741824
Nov 04 01:15:08 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:09 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 1073741824" returned: 0 in 0.600s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:09 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98
Nov 04 01:15:09 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:09 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98" returned: 0 in 0.326s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:15:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3ae45e-3bd9-4192-89ab-0b75af71dd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8d39d4-0459-420f-a804-35e0d22b8c98', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e10650-e2c6-4fb2-a189-6877e69d1635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:09 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Volume volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 (4f8d39d4-0459-420f-a804-35e0d22b8c98): created successfully
Nov 04 01:15:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e10650-e2c6-4fb2-a189-6877e69d1635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:09 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (d537b8c0-96d5-4d62-88b5-83e7f7d52263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:09 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-ad68b4be-8273-48b6-86d7-ea2105226e8d tempest-ProjectMemberTests-1052399897 None] Created volume successfully.
Nov 04 01:15:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] Creating offline snapshot 9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc of volume 4f8d39d4-0459-420f-a804-35e0d22b8c98 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:15:10 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[609f5a0e-88c1-4d9d-8c23-c1d8a2fb8759]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:10 devstack sudo[107040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98
Nov 04 01:15:10 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:11 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98" returned: 0 in 0.408s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:11 devstack sudo[107046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc 1G
Nov 04 01:15:11 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:11 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc 1G" returned: 0 in 0.483s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:11 devstack sudo[107051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc
Nov 04 01:15:11 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:11 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc" returned: 0 in 0.351s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:11 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc is being set with open permissions: ugo+rw
Nov 04 01:15:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:11 devstack sudo[107056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc
Nov 04 01:15:11 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Flow 'volume_create_manager' (a0e02d25-5926-48cf-a53a-cc10403d845a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a605c71b-da78-45aa-8cb0-beceb57b6162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a605c71b-da78-45aa-8cb0-beceb57b6162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770920730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986b48b5-4796-437c-92cc-add4d268f3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20fde0cb208a48e6bce8006f21f7f804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:12Z,use_quota=True,user_id='e3732eca680745e78350f1527a0312be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50048953-7dbd-47b8-b07e-8d43236f0479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50048953-7dbd-47b8-b07e-8d43236f0479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3b7121-d6b0-4f79-8bb2-4f29e35f9b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3b7121-d6b0-4f79-8bb2-4f29e35f9b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '986b48b5-4796-437c-92cc-add4d268f3bf', 'volume_name': 'volume-986b48b5-4796-437c-92cc-add4d268f3bf', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9188d64-a4cd-46bf-9f97-64b5920012ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9188d64-a4cd-46bf-9f97-64b5920012ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2d2939-7be0-45b1-9a7a-201427b1c9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:12 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Volume 986b48b5-4796-437c-92cc-add4d268f3bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-986b48b5-4796-437c-92cc-add4d268f3bf', 'volume_size': 1}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:12 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc" returned: 0 in 0.310s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:12 devstack sudo[107059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.info
Nov 04 01:15:12 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:12 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.info" returned: 0 in 0.265s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:12 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.info is being set with open permissions: ugo+rw
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:12 devstack sudo[107062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.info
Nov 04 01:15:12 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:12 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.info" returned: 0 in 0.275s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770920730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986b48b5-4796-437c-92cc-add4d268f3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20fde0cb208a48e6bce8006f21f7f804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:12Z,use_quota=True,user_id='e3732eca680745e78350f1527a0312be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Creating volume 986b48b5-4796-437c-92cc-add4d268f3bf {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:15:12 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:15:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:12 devstack sudo[107065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf 1073741824
Nov 04 01:15:12 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:12 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3a7b3f5e-c621-4e26-aaea-9477eed91d2c tempest-ProjectMemberTests-1052399897 None] Create snapshot completed successfully
Nov 04 01:15:13 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf 1073741824" returned: 0 in 0.439s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:13 devstack sudo[107077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf
Nov 04 01:15:13 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:13 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf" returned: 0 in 0.269s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2d2939-7be0-45b1-9a7a-201427b1c9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-986b48b5-4796-437c-92cc-add4d268f3bf', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8d87f6-082f-4e88-9223-4c6d5d7fba73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:13 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Volume volume-986b48b5-4796-437c-92cc-add4d268f3bf (986b48b5-4796-437c-92cc-add4d268f3bf): created successfully
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8d87f6-082f-4e88-9223-4c6d5d7fba73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Flow 'volume_create_manager' (a0e02d25-5926-48cf-a53a-cc10403d845a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:13 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-519e967a-20fa-4536-afc4-2552e470ddfc tempest-ProjectReaderTests-663070395 None] Created volume successfully.
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Lock "cinder-9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-4f8d39d4-0459-420f-a804-35e0d22b8c98" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-4f8d39d4-0459-420f-a804-35e0d22b8c98" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Deleting offline snapshot 9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc of volume 4f8d39d4-0459-420f-a804-35e0d22b8c98 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] snapshot_file for this snap is: volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b7e507-59f0-426f-84d5-67926f4dc979]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:14 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc
Nov 04 01:15:14 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Acquiring lock "cinder-986b48b5-4796-437c-92cc-add4d268f3bf-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:14 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Lock "cinder-986b48b5-4796-437c-92cc-add4d268f3bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc" returned: 0 in 0.427s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f8d39d4-0459-420f-a804-35e0d22b8c98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3f82a6-4923-435e-8392-46a98aecde81]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Acquiring lock "cinder-quobyte-986b48b5-4796-437c-92cc-add4d268f3bf" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Lock "cinder-quobyte-986b48b5-4796-437c-92cc-add4d268f3bf" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf6450c-b9be-4599-83fb-88b019f894f3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:14 devstack sudo[107086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98
Nov 04 01:15:14 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:14 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf
Nov 04 01:15:14 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98" returned: 0 in 0.455s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:14 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:14 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc
Nov 04 01:15:14 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:14 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf" returned: 0 in 0.439s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:14 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf
Nov 04 01:15:14 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:15 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-986b48b5-4796-437c-92cc-add4d268f3bf" returned: 0 in 0.259s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Lock "cinder-quobyte-986b48b5-4796-437c-92cc-add4d268f3bf" released by "delete_volume" :: held 0.752s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:15 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc" returned: 0 in 0.371s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:15 devstack sudo[107105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc
Nov 04 01:15:15 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Created reservations ['6f4fccc2-93bb-461a-be73-443f58d1cd91', '09712d9e-5564-4f28-9f3b-414c0b870ca7', 'e4d1c626-6b54-443a-aecc-3df6a999e0a6', 'c719cec8-b9b7-45e2-81cf-243e3a426d43'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:15 devstack sudo[107107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:15 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:15 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98.9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc" returned: 0 in 0.264s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc" released by "_delete_snapshot" :: held 1.650s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-4f8d39d4-0459-420f-a804-35e0d22b8c98" released by "delete_snapshot" :: held 1.678s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Created reservations ['e89ae6fa-b5f8-45f0-bdf4-5458ec212750', '600525c9-b47c-458b-bf47-6836e89fb9bc', '7e67b3d8-88d1-452f-8f96-d5e3e95c8cce', '06172f85-e707-4c1d-941d-d27b1e4ed9a3'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:15 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.295s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:15 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Deleted volume successfully.
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b35f653d-8e04-4566-bab2-dbbc2121104b tempest-ProjectReaderTests-663070395 None] Lock "cinder-986b48b5-4796-437c-92cc-add4d268f3bf-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:15 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Delete snapshot completed successfully.
Nov 04 01:15:15 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-b3bce5ac-f2ac-46bb-81e8-10c48a2ab1bb tempest-ProjectMemberTests-1052399897 None] Lock "cinder-9cddb7e5-a614-450b-bb6a-7f3a4dd41dbc-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Flow 'volume_create_manager' (60d63179-735a-4818-9abd-1129abf772ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1116ee-3ca3-4bb6-8c9e-a066d68b6efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-4f8d39d4-0459-420f-a804-35e0d22b8c98-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1116ee-3ca3-4bb6-8c9e-a066d68b6efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-976549372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d23fac-3623-4e89-aee0-65f486b88e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20fde0cb208a48e6bce8006f21f7f804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:16Z,use_quota=True,user_id='e3732eca680745e78350f1527a0312be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a240ee3-4314-44d9-be8c-17f813aefc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a240ee3-4314-44d9-be8c-17f813aefc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412f35a6-0ee6-4678-9460-767c6a6af046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412f35a6-0ee6-4678-9460-767c6a6af046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d23fac-3623-4e89-aee0-65f486b88e93', 'volume_name': 'volume-e4d23fac-3623-4e89-aee0-65f486b88e93', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942feb38-3ade-4c3a-83e5-11f941dd5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942feb38-3ade-4c3a-83e5-11f941dd5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adad65ad-4688-4ed0-b230-3390ff07e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:16 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Volume e4d23fac-3623-4e89-aee0-65f486b88e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d23fac-3623-4e89-aee0-65f486b88e93', 'volume_size': 1}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-976549372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d23fac-3623-4e89-aee0-65f486b88e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20fde0cb208a48e6bce8006f21f7f804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:16Z,use_quota=True,user_id='e3732eca680745e78350f1527a0312be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Creating volume e4d23fac-3623-4e89-aee0-65f486b88e93 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:15:16 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Lock "cinder-4f8d39d4-0459-420f-a804-35e0d22b8c98-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:16 devstack sudo[107111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93 1073741824
Nov 04 01:15:16 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-4f8d39d4-0459-420f-a804-35e0d22b8c98" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-4f8d39d4-0459-420f-a804-35e0d22b8c98" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d37c6b-c625-4251-a9eb-06e7890089d3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:16 devstack sudo[107113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98
Nov 04 01:15:16 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:16 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93 1073741824" returned: 0 in 0.525s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:16 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98" returned: 0 in 0.423s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:16 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98
Nov 04 01:15:16 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:16 devstack sudo[107122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93
Nov 04 01:15:16 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:16 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-4f8d39d4-0459-420f-a804-35e0d22b8c98" returned: 0 in 0.289s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:16 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93" returned: 0 in 0.295s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-4f8d39d4-0459-420f-a804-35e0d22b8c98" released by "delete_volume" :: held 0.798s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adad65ad-4688-4ed0-b230-3390ff07e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d23fac-3623-4e89-aee0-65f486b88e93', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1889c6a-bcfa-4159-8513-21b3328cbd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:17 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Volume volume-e4d23fac-3623-4e89-aee0-65f486b88e93 (e4d23fac-3623-4e89-aee0-65f486b88e93): created successfully
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1889c6a-bcfa-4159-8513-21b3328cbd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Flow 'volume_create_manager' (60d63179-735a-4818-9abd-1129abf772ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-c335394b-db0d-453d-8c14-425db2276b59 tempest-ProjectReaderTests-663070395 None] Created volume successfully.
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Created reservations ['e6c2e79f-be29-4a47-95b3-bd1d3cee7308', '2072c481-fdc5-4443-a15c-09731ad29234', 'ed667edb-fbb3-40bd-8421-45af7dbb92be', '35ef492e-a9cc-4b24-a456-d1515d76c20d'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:17 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:17 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:17 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.326s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:17 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Deleted volume successfully.
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-67176b3c-6d35-428e-adf3-f1a083e9400e tempest-ProjectMemberTests-1052399897 None] Lock "cinder-4f8d39d4-0459-420f-a804-35e0d22b8c98-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (c4794d15-2960-4028-a0b3-762434a68e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ad6f7b-8cc7-4d30-8a1c-e5d63b7fa068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ad6f7b-8cc7-4d30-8a1c-e5d63b7fa068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093236474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6805acf7-362c-448c-ac58-1ee75fc65fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:18Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33674e1-c3b4-44ea-9657-deef484d4d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33674e1-c3b4-44ea-9657-deef484d4d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19e3367-9f99-4ae4-a64c-b014e4305bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19e3367-9f99-4ae4-a64c-b014e4305bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6805acf7-362c-448c-ac58-1ee75fc65fb1', 'volume_name': 'volume-6805acf7-362c-448c-ac58-1ee75fc65fb1', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12de1fac-8c20-4645-abd0-146a7d84fbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12de1fac-8c20-4645-abd0-146a7d84fbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517a795f-3f61-4a18-9fdc-944f18639135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:17 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Volume 6805acf7-362c-448c-ac58-1ee75fc65fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6805acf7-362c-448c-ac58-1ee75fc65fb1', 'volume_size': 1}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093236474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6805acf7-362c-448c-ac58-1ee75fc65fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:18Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Creating volume 6805acf7-362c-448c-ac58-1ee75fc65fb1 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:15:17 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:15:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:18 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 1073741824
Nov 04 01:15:18 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Acquiring lock "cinder-e4d23fac-3623-4e89-aee0-65f486b88e93-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Lock "cinder-e4d23fac-3623-4e89-aee0-65f486b88e93-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Acquiring lock "cinder-quobyte-e4d23fac-3623-4e89-aee0-65f486b88e93" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Lock "cinder-quobyte-e4d23fac-3623-4e89-aee0-65f486b88e93" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0e7ba4-95a1-477e-8dbf-a78ea36c6608]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:18 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93
Nov 04 01:15:18 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:18 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 1073741824" returned: 0 in 0.561s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:18 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1
Nov 04 01:15:18 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:18 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93" returned: 0 in 0.416s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:18 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93
Nov 04 01:15:18 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:18 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1" returned: 0 in 0.265s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517a795f-3f61-4a18-9fdc-944f18639135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6805acf7-362c-448c-ac58-1ee75fc65fb1', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7884cb4a-c7aa-4151-ad94-274bcbf76372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:18 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Volume volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 (6805acf7-362c-448c-ac58-1ee75fc65fb1): created successfully
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7884cb4a-c7aa-4151-ad94-274bcbf76372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:18 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (c4794d15-2960-4028-a0b3-762434a68e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:18 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-09c07583-67b6-4375-9c2d-752a66ce0911 tempest-ProjectMemberTests-1052399897 None] Created volume successfully.
Nov 04 01:15:19 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-e4d23fac-3623-4e89-aee0-65f486b88e93" returned: 0 in 0.280s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Lock "cinder-quobyte-e4d23fac-3623-4e89-aee0-65f486b88e93" released by "delete_volume" :: held 0.742s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Created reservations ['74f56e4c-b843-41b7-9857-a2c94cf1d7c1', '0436cf4e-363a-42db-9f84-be2436c8b24e', 'fef1dfe8-d92f-4a2b-a521-fd71ca5e1092', '67c895e9-39e1-4599-978c-b602d0cd2a16'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:19 devstack sudo[107183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:19 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:19 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.243s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:19 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Deleted volume successfully.
Nov 04 01:15:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-194c80ac-a689-42bb-9567-e3ab224e5423 tempest-ProjectReaderTests-663070395 None] Lock "cinder-e4d23fac-3623-4e89-aee0-65f486b88e93-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:20 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] Creating offline snapshot 2549b786-42b6-4e9d-8e12-f688fbb8c1b6 of volume 6805acf7-362c-448c-ac58-1ee75fc65fb1 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:15:20 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7b70c2-a91d-47aa-9ad1-7210a439096e]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:20 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1
Nov 04 01:15:20 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:20 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1" returned: 0 in 0.421s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:20 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6 1G
Nov 04 01:15:20 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:21 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6 1G" returned: 0 in 0.460s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:21 devstack sudo[107197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6
Nov 04 01:15:21 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:21 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6" returned: 0 in 0.313s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:21 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6 is being set with open permissions: ugo+rw
Nov 04 01:15:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:21 devstack sudo[107202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6
Nov 04 01:15:21 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:21 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6" returned: 0 in 0.252s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:21 devstack sudo[107205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.info
Nov 04 01:15:21 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:21 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.info" returned: 0 in 0.270s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:21 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.info is being set with open permissions: ugo+rw
Nov 04 01:15:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:21 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.info
Nov 04 01:15:21 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:22 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.info" returned: 0 in 0.270s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:22 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d0aeabce-c725-440a-8c1c-4dc15eb09449 tempest-ProjectMemberTests-1052399897 None] Create snapshot completed successfully
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-2549b786-42b6-4e9d-8e12-f688fbb8c1b6-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-2549b786-42b6-4e9d-8e12-f688fbb8c1b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-6805acf7-362c-448c-ac58-1ee75fc65fb1" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-6805acf7-362c-448c-ac58-1ee75fc65fb1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-2549b786-42b6-4e9d-8e12-f688fbb8c1b6" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-2549b786-42b6-4e9d-8e12-f688fbb8c1b6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Deleting offline snapshot 2549b786-42b6-4e9d-8e12-f688fbb8c1b6 of volume 6805acf7-362c-448c-ac58-1ee75fc65fb1 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] snapshot_file for this snap is: volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9518c2-ef1e-4a03-a99f-f6b5e1805665]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:23 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6
Nov 04 01:15:23 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:23 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6" returned: 0 in 0.404s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6805acf7-362c-448c-ac58-1ee75fc65fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bb6db3-858c-4e37-b303-e1626777dbb1]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:24 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1
Nov 04 01:15:24 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:24 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1" returned: 0 in 0.386s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:24 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6
Nov 04 01:15:24 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:24 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6" returned: 0 in 0.387s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:24 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6
Nov 04 01:15:24 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:24 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1.2549b786-42b6-4e9d-8e12-f688fbb8c1b6" returned: 0 in 0.276s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-2549b786-42b6-4e9d-8e12-f688fbb8c1b6" released by "_delete_snapshot" :: held 1.569s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:24 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-6805acf7-362c-448c-ac58-1ee75fc65fb1" released by "delete_snapshot" :: held 1.597s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:25 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Created reservations ['b6f1023c-7600-4307-bfe0-3471ebaf17c9', '90298b67-1aed-4edf-8f3d-18d16bf8f744', '4286015e-2851-4dfd-b3de-6a75edba80f0', 'e22bbd01-e887-41a1-a82e-57ce29b90ba3'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:25 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Delete snapshot completed successfully.
Nov 04 01:15:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-9a7980c8-9a95-49f1-bfe6-97ed763b4601 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-2549b786-42b6-4e9d-8e12-f688fbb8c1b6-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-6805acf7-362c-448c-ac58-1ee75fc65fb1-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-6805acf7-362c-448c-ac58-1ee75fc65fb1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-6805acf7-362c-448c-ac58-1ee75fc65fb1" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-6805acf7-362c-448c-ac58-1ee75fc65fb1" acquired by "delete_volume" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:25 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0e712f-17bb-4884-b18b-b2f85b3f4909]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:25 devstack sudo[107229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1
Nov 04 01:15:25 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:26 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1" returned: 0 in 0.391s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:26 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1
Nov 04 01:15:26 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:26 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-6805acf7-362c-448c-ac58-1ee75fc65fb1" returned: 0 in 0.252s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-6805acf7-362c-448c-ac58-1ee75fc65fb1" released by "delete_volume" :: held 0.707s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Created reservations ['48746762-f57a-484f-b62b-eb86fa26ad0a', '080d18e8-4aa6-4265-90d2-4f0604e1089e', 'd0f98013-4664-4654-9bc8-905022252d6b', 'd83dfe43-b6a3-41ef-8fcc-54fd60e4719d'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:26 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:26 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:26 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.283s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:26 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Deleted volume successfully.
Nov 04 01:15:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-11347a78-1190-458d-96a2-1c96139ce389 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-6805acf7-362c-448c-ac58-1ee75fc65fb1-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (4145b6e4-be10-4a66-afd7-d7f1187c47eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5d409b-82f8-4bc9-bc5f-ae1a13602bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5d409b-82f8-4bc9-bc5f-ae1a13602bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000727323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52255fd8-131a-4f2e-abab-d5974a7ced80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:27Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0cece5-fc80-4dda-b3bf-d611ccdb3c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0cece5-fc80-4dda-b3bf-d611ccdb3c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b519314-3b92-4e22-bfb1-c251527cc1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b519314-3b92-4e22-bfb1-c251527cc1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52255fd8-131a-4f2e-abab-d5974a7ced80', 'volume_name': 'volume-52255fd8-131a-4f2e-abab-d5974a7ced80', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f92893-2c6e-43af-9d5e-2edb7ac85557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f92893-2c6e-43af-9d5e-2edb7ac85557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bac59d0-f1e6-4329-9b0e-7a63d58b5689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:27 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Volume 52255fd8-131a-4f2e-abab-d5974a7ced80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52255fd8-131a-4f2e-abab-d5974a7ced80', 'volume_size': 1}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000727323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52255fd8-131a-4f2e-abab-d5974a7ced80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:27Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Creating volume 52255fd8-131a-4f2e-abab-d5974a7ced80 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:15:27 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:27 devstack sudo[107240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80 1073741824
Nov 04 01:15:27 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:27 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80 1073741824" returned: 0 in 0.473s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:27 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80
Nov 04 01:15:27 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:28 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80" returned: 0 in 0.264s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:15:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bac59d0-f1e6-4329-9b0e-7a63d58b5689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52255fd8-131a-4f2e-abab-d5974a7ced80', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f19e73-5f4b-410e-86cd-d60849c14d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:28 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Volume volume-52255fd8-131a-4f2e-abab-d5974a7ced80 (52255fd8-131a-4f2e-abab-d5974a7ced80): created successfully
Nov 04 01:15:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f19e73-5f4b-410e-86cd-d60849c14d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:28 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (4145b6e4-be10-4a66-afd7-d7f1187c47eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-5b3921df-6818-48e3-9095-ffd829533127 tempest-ProjectMemberTests-1052399897 None] Created volume successfully.
Nov 04 01:15:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] Creating offline snapshot 3f60931f-b858-4ea1-bc75-e13c253af080 of volume 52255fd8-131a-4f2e-abab-d5974a7ced80 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:15:29 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a1e79d-4ae1-4496-9bdf-f67dbee8a7a5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:29 devstack sudo[107249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80
Nov 04 01:15:29 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:29 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80" returned: 0 in 0.397s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:29 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080 1G
Nov 04 01:15:29 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:30 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080 1G" returned: 0 in 0.458s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52255fd8-131a-4f2e-abab-d5974a7ced80 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:30 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52255fd8-131a-4f2e-abab-d5974a7ced80 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080
Nov 04 01:15:30 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:30 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52255fd8-131a-4f2e-abab-d5974a7ced80 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080" returned: 0 in 0.316s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:30 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080 is being set with open permissions: ugo+rw
Nov 04 01:15:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:30 devstack sudo[107265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080
Nov 04 01:15:30 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:30 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080" returned: 0 in 0.271s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:31 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.info
Nov 04 01:15:31 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:31 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.info" returned: 0 in 0.242s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:31 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.info is being set with open permissions: ugo+rw
Nov 04 01:15:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:31 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.info
Nov 04 01:15:31 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:31 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.info" returned: 0 in 0.239s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:31 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-2159a1ab-1728-424c-9a6e-ecfcfe42e04a tempest-ProjectMemberTests-1052399897 None] Create snapshot completed successfully
Nov 04 01:15:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-3f60931f-b858-4ea1-bc75-e13c253af080-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-3f60931f-b858-4ea1-bc75-e13c253af080-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-52255fd8-131a-4f2e-abab-d5974a7ced80" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-52255fd8-131a-4f2e-abab-d5974a7ced80" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-3f60931f-b858-4ea1-bc75-e13c253af080" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-3f60931f-b858-4ea1-bc75-e13c253af080" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Deleting offline snapshot 3f60931f-b858-4ea1-bc75-e13c253af080 of volume 52255fd8-131a-4f2e-abab-d5974a7ced80 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:15:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] snapshot_file for this snap is: volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:15:32 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47ba74c-846e-4902-9126-e77323d9ffa9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:32 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080
Nov 04 01:15:32 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:33 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080" returned: 0 in 0.365s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:33 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52255fd8-131a-4f2e-abab-d5974a7ced80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:15:33 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b7d9a7-923d-4886-9e55-c0ffea1dd15c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:33 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80
Nov 04 01:15:33 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:33 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80" returned: 0 in 0.381s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:33 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080
Nov 04 01:15:33 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:33 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080" returned: 0 in 0.330s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:33 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080
Nov 04 01:15:33 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:34 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80.3f60931f-b858-4ea1-bc75-e13c253af080" returned: 0 in 0.243s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-3f60931f-b858-4ea1-bc75-e13c253af080" released by "_delete_snapshot" :: held 1.418s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-52255fd8-131a-4f2e-abab-d5974a7ced80" released by "delete_snapshot" :: held 1.440s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:34 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Created reservations ['81fad006-086f-49a2-bbde-bd7f3ac81c16', 'dd71d747-e36a-4bc8-a824-dc2bcdd2e0b8', 'd2d7846f-e4c4-47af-bc37-6f5c8dd4044f', '12d7562a-f2a3-460d-bafd-f25e2251f55a'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:34 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Delete snapshot completed successfully.
Nov 04 01:15:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-d07b837a-0b7c-4c28-9d9f-b6056d049ea3 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-3f60931f-b858-4ea1-bc75-e13c253af080-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-52255fd8-131a-4f2e-abab-d5974a7ced80-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Lock "cinder-52255fd8-131a-4f2e-abab-d5974a7ced80-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-52255fd8-131a-4f2e-abab-d5974a7ced80" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-52255fd8-131a-4f2e-abab-d5974a7ced80" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:34 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[301cc8d3-0af8-416f-8251-0c1489b0188a]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:35 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80
Nov 04 01:15:35 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:35 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80" returned: 0 in 0.351s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:35 devstack sudo[107298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80
Nov 04 01:15:35 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:35 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-52255fd8-131a-4f2e-abab-d5974a7ced80" returned: 0 in 0.237s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-52255fd8-131a-4f2e-abab-d5974a7ced80" released by "delete_volume" :: held 0.649s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Created reservations ['496bd670-fa58-4201-9147-9b2e98a6c98e', '12701826-c3d3-497e-8329-15f0efbc70a5', 'f133ad8c-e6fa-4c37-8cd6-d2bac45c49ce', '2a2375c7-9cf2-40b6-8f45-3fe4c5477f95'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:35 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:35 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:35 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.251s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:35 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Deleted volume successfully.
Nov 04 01:15:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-851f84da-02af-4ecb-8dfa-996758054efa tempest-ProjectMemberTests-1052399897 None] Lock "cinder-52255fd8-131a-4f2e-abab-d5974a7ced80-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (83c4faaf-7b46-47d6-9733-1aa2a97ef764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc64b2e3-52dc-442d-8891-cf4f16370ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc64b2e3-52dc-442d-8891-cf4f16370ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1889423386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8583b378-236c-4879-b92d-9921c9d82eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:36Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620783d3-3eba-46b9-bb47-a3564c4b5ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620783d3-3eba-46b9-bb47-a3564c4b5ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de689590-b83f-4aad-936f-54c6bdfbeed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de689590-b83f-4aad-936f-54c6bdfbeed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8583b378-236c-4879-b92d-9921c9d82eb4', 'volume_name': 'volume-8583b378-236c-4879-b92d-9921c9d82eb4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2206d115-96a7-466c-8a8d-4ad2afdea339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2206d115-96a7-466c-8a8d-4ad2afdea339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8131d079-d028-4a02-8e82-e931e3e7eeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:36 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Volume 8583b378-236c-4879-b92d-9921c9d82eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8583b378-236c-4879-b92d-9921c9d82eb4', 'volume_size': 1}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1889423386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8583b378-236c-4879-b92d-9921c9d82eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:36Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Creating volume 8583b378-236c-4879-b92d-9921c9d82eb4 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:15:36 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:36 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4 1073741824
Nov 04 01:15:36 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:36 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4 1073741824" returned: 0 in 0.434s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:36 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:36 devstack sudo[107309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4
Nov 04 01:15:36 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:37 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4" returned: 0 in 0.234s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8131d079-d028-4a02-8e82-e931e3e7eeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8583b378-236c-4879-b92d-9921c9d82eb4', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55b0537-420a-4b51-99e8-11f0a6e255c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:37 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Volume volume-8583b378-236c-4879-b92d-9921c9d82eb4 (8583b378-236c-4879-b92d-9921c9d82eb4): created successfully
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55b0537-420a-4b51-99e8-11f0a6e255c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (83c4faaf-7b46-47d6-9733-1aa2a97ef764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:37 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-891a08c2-1367-43be-9d45-1844212767af tempest-ProjectMemberTests-1052399897 None] Created volume successfully.
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] Creating offline snapshot d7a704d9-eec5-477f-a4fd-5508a8d99c75 of volume 8583b378-236c-4879-b92d-9921c9d82eb4 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f8e1ee-a6e2-48fd-aa8c-52d0865cfda4]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:37 devstack sudo[107312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4
Nov 04 01:15:37 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:37 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4" returned: 0 in 0.347s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:37 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:37 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75 1G
Nov 04 01:15:37 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:38 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75 1G" returned: 0 in 0.383s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8583b378-236c-4879-b92d-9921c9d82eb4 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:38 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8583b378-236c-4879-b92d-9921c9d82eb4 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75
Nov 04 01:15:38 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:38 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8583b378-236c-4879-b92d-9921c9d82eb4 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75" returned: 0 in 0.281s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:38 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75 is being set with open permissions: ugo+rw
Nov 04 01:15:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:38 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75
Nov 04 01:15:38 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:38 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75" returned: 0 in 0.231s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:38 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:38 devstack sudo[107330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.info
Nov 04 01:15:38 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:39 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.info" returned: 0 in 0.240s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:39 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.info is being set with open permissions: ugo+rw
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:39 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.info
Nov 04 01:15:39 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:39 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.info" returned: 0 in 0.234s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.791s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:39 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-9bd0f587-ddcb-43d5-80ad-49c539b90029 tempest-ProjectMemberTests-1052399897 None] Create snapshot completed successfully
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-d7a704d9-eec5-477f-a4fd-5508a8d99c75-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-d7a704d9-eec5-477f-a4fd-5508a8d99c75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-8583b378-236c-4879-b92d-9921c9d82eb4" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-8583b378-236c-4879-b92d-9921c9d82eb4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-d7a704d9-eec5-477f-a4fd-5508a8d99c75" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-d7a704d9-eec5-477f-a4fd-5508a8d99c75" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Deleting offline snapshot d7a704d9-eec5-477f-a4fd-5508a8d99c75 of volume 8583b378-236c-4879-b92d-9921c9d82eb4 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] snapshot_file for this snap is: volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[6debb683-2415-41d0-992a-0eced2a13dc6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:39 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:39 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75
Nov 04 01:15:39 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:40 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75" returned: 0 in 0.344s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:40 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8583b378-236c-4879-b92d-9921c9d82eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:15:40 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab119e82-f5ae-4646-942c-ef0dc5150759]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:40 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4
Nov 04 01:15:40 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:40 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4" returned: 0 in 0.344s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:40 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75
Nov 04 01:15:40 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:40 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75" returned: 0 in 0.330s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:40 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:40 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75
Nov 04 01:15:40 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:41 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4.d7a704d9-eec5-477f-a4fd-5508a8d99c75" returned: 0 in 0.232s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-d7a704d9-eec5-477f-a4fd-5508a8d99c75" released by "_delete_snapshot" :: held 1.338s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-8583b378-236c-4879-b92d-9921c9d82eb4" released by "delete_snapshot" :: held 1.359s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:41 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Created reservations ['39bd8f11-03d4-4673-bb42-93d16e875c8f', '98abfdd0-d334-44c6-ab0f-b84e3beffe92', '9a5ec439-3bcc-4e84-a916-bfff531b526b', '8c285b40-c757-4b5f-88f7-ca4741c14167'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:41 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Delete snapshot completed successfully.
Nov 04 01:15:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-e363f07f-53c5-4a16-a9e4-20f5d29fe877 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-d7a704d9-eec5-477f-a4fd-5508a8d99c75-delete_snapshot" released by "delete_snapshot" :: held 1.483s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-8583b378-236c-4879-b92d-9921c9d82eb4-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-8583b378-236c-4879-b92d-9921c9d82eb4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-8583b378-236c-4879-b92d-9921c9d82eb4" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:41 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-8583b378-236c-4879-b92d-9921c9d82eb4" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:41 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3e01bc-675c-40c6-acdd-b2251f3d2e7b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:41 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:42 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4
Nov 04 01:15:42 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:42 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4" returned: 0 in 0.357s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:42 devstack sudo[107360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4
Nov 04 01:15:42 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:42 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-8583b378-236c-4879-b92d-9921c9d82eb4" returned: 0 in 0.243s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-8583b378-236c-4879-b92d-9921c9d82eb4" released by "delete_volume" :: held 0.658s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Created reservations ['164cbb43-5329-40d8-b2b5-b58bfdd5b80f', 'a57dc916-edba-4401-b614-a7ad50c62a50', '02d01df6-de15-4d85-9355-c3cd0c931a70', '27e3b59a-bba9-4687-bb9e-7fac221b8ea9'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:42 devstack sudo[107363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:42 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:42 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.231s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:42 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Deleted volume successfully.
Nov 04 01:15:42 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-057c77aa-db17-445e-9df9-4f560298ff31 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-8583b378-236c-4879-b92d-9921c9d82eb4-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (cfbcd0a4-3223-406f-ac67-c9416d292180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcd70f9-a7aa-4fb9-b75e-eb27af76d838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcd70f9-a7aa-4fb9-b75e-eb27af76d838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-46802077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a92c0f-7b39-46e7-a014-1e831e39ba10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:43Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77284b64-64ff-40a9-86ad-f508c20a63fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77284b64-64ff-40a9-86ad-f508c20a63fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c97a67e-dd94-4610-97db-056b74ec4dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c97a67e-dd94-4610-97db-056b74ec4dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79a92c0f-7b39-46e7-a014-1e831e39ba10', 'volume_name': 'volume-79a92c0f-7b39-46e7-a014-1e831e39ba10', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be3158c-3ae8-4b8a-822f-80987fee8d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be3158c-3ae8-4b8a-822f-80987fee8d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f3c389-89dc-4680-87eb-dd2f675b646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:43 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Volume 79a92c0f-7b39-46e7-a014-1e831e39ba10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79a92c0f-7b39-46e7-a014-1e831e39ba10', 'volume_size': 1}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-46802077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a92c0f-7b39-46e7-a014-1e831e39ba10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:43Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Creating volume 79a92c0f-7b39-46e7-a014-1e831e39ba10 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:15:43 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:43 devstack sudo[107366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 1073741824
Nov 04 01:15:43 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:43 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 1073741824" returned: 0 in 0.400s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:43 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:43 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10
Nov 04 01:15:43 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:44 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10" returned: 0 in 0.241s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f3c389-89dc-4680-87eb-dd2f675b646f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a92c0f-7b39-46e7-a014-1e831e39ba10', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c995aa7c-9c45-437a-94bd-86ff9f3656b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:44 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Volume volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 (79a92c0f-7b39-46e7-a014-1e831e39ba10): created successfully
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c995aa7c-9c45-437a-94bd-86ff9f3656b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (cfbcd0a4-3223-406f-ac67-c9416d292180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:44 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-3bb812cf-9b20-4a58-a4bc-38c51a64bc35 tempest-ProjectMemberTests-1052399897 None] Created volume successfully.
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] Creating offline snapshot 5564f5ad-0704-46fc-92a8-d75d25515602 of volume 79a92c0f-7b39-46e7-a014-1e831e39ba10 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a8ebf4-7f69-4467-95ae-07ac302cf5ea]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:44 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10
Nov 04 01:15:44 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:44 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10" returned: 0 in 0.362s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:44 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:45 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602 1G
Nov 04 01:15:45 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:45 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602 1G" returned: 0 in 0.417s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:45 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602
Nov 04 01:15:45 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:45 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602" returned: 0 in 0.302s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:45 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602 is being set with open permissions: ugo+rw
Nov 04 01:15:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:45 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602
Nov 04 01:15:45 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:45 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602" returned: 0 in 0.233s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:45 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:46 devstack sudo[107392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.info
Nov 04 01:15:46 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:46 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.info" returned: 0 in 0.240s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:46 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.info is being set with open permissions: ugo+rw
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:46 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.info
Nov 04 01:15:46 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:46 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.info" returned: 0 in 0.243s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:46 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-addcc898-8e8a-4ca8-8f08-0a81cf7fff7f tempest-ProjectMemberTests-1052399897 None] Create snapshot completed successfully
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-5564f5ad-0704-46fc-92a8-d75d25515602-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-5564f5ad-0704-46fc-92a8-d75d25515602-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-79a92c0f-7b39-46e7-a014-1e831e39ba10" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-79a92c0f-7b39-46e7-a014-1e831e39ba10" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-5564f5ad-0704-46fc-92a8-d75d25515602" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-5564f5ad-0704-46fc-92a8-d75d25515602" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Deleting offline snapshot 5564f5ad-0704-46fc-92a8-d75d25515602 of volume 79a92c0f-7b39-46e7-a014-1e831e39ba10 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] snapshot_file for this snap is: volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d3309c-0ef9-480e-961c-c004dcda5864]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:46 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:46 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602
Nov 04 01:15:46 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:47 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602" returned: 0 in 0.339s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:47 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a92c0f-7b39-46e7-a014-1e831e39ba10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:15:47 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2c06b3-1cf0-4c39-83c5-aa616dc56f6d]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:47 devstack sudo[107403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10
Nov 04 01:15:47 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:47 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10" returned: 0 in 0.345s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:47 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602
Nov 04 01:15:47 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:47 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602" returned: 0 in 0.349s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:47 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:47 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602
Nov 04 01:15:47 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:48 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:48 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10.5564f5ad-0704-46fc-92a8-d75d25515602" returned: 0 in 0.248s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-5564f5ad-0704-46fc-92a8-d75d25515602" released by "_delete_snapshot" :: held 1.369s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-79a92c0f-7b39-46e7-a014-1e831e39ba10" released by "delete_snapshot" :: held 1.390s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:48 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Created reservations ['ee0f2ff9-2567-42ba-b9b1-93fb1d01d7f9', '37397ce7-6b54-47e8-a4e4-3f11b219be5a', 'b2decd8a-c6b4-4753-8e5a-eae08f731db6', 'd9d73359-ceb2-401d-af0c-8bee8446ee37'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:48 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Delete snapshot completed successfully.
Nov 04 01:15:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-16269b40-4b79-41a8-a2da-e77477d8eea1 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-5564f5ad-0704-46fc-92a8-d75d25515602-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-79a92c0f-7b39-46e7-a014-1e831e39ba10-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Lock "cinder-79a92c0f-7b39-46e7-a014-1e831e39ba10-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-79a92c0f-7b39-46e7-a014-1e831e39ba10" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:48 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-79a92c0f-7b39-46e7-a014-1e831e39ba10" acquired by "delete_volume" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b324cb-a90f-4ae0-bac6-e4e36eb3ffbd]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:49 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10
Nov 04 01:15:49 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:49 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10" returned: 0 in 0.368s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:49 devstack sudo[107421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10
Nov 04 01:15:49 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:49 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-79a92c0f-7b39-46e7-a014-1e831e39ba10" returned: 0 in 0.258s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-79a92c0f-7b39-46e7-a014-1e831e39ba10" released by "delete_volume" :: held 0.687s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=199,cinder:SELECT=152,cinder:INSERT=48,cinder:DELETE=14 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=141,cinder:UPDATE=187,cinder:DELETE=19,cinder:INSERT=61 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Created reservations ['6e41d21d-f5e4-40d2-a682-61bec1309314', '2391f37b-8405-4970-a606-02a21ebfd917', '158b1ff8-c626-436b-9e13-724df4b788ec', 'bc578f1a-7e55-41b5-a673-ece0eba492be'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:49 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:49 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:49 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:50 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.260s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:50 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Deleted volume successfully.
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-fd7f0905-8a20-4334-982d-35f1a830226b tempest-ProjectMemberTests-1052399897 None] Lock "cinder-79a92c0f-7b39-46e7-a014-1e831e39ba10-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (96c696a5-2251-4819-9420-9950128a2193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed232945-7941-4edf-8bfb-87cddc4c5d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed232945-7941-4edf-8bfb-87cddc4c5d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2065793462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75f1811-355f-4900-9364-5763bce7d43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:50Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ba3a82-2f1b-44d0-a45e-1fbc85608a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ba3a82-2f1b-44d0-a45e-1fbc85608a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a77d0d-80b9-42b9-9434-64bad8ac919e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a77d0d-80b9-42b9-9434-64bad8ac919e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a75f1811-355f-4900-9364-5763bce7d43b', 'volume_name': 'volume-a75f1811-355f-4900-9364-5763bce7d43b', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ee532a-6a0e-4037-b72a-253f370f546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ee532a-6a0e-4037-b72a-253f370f546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2299a2-1c09-4c65-8263-ee67458063ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:50 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Volume a75f1811-355f-4900-9364-5763bce7d43b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a75f1811-355f-4900-9364-5763bce7d43b', 'volume_size': 1}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2065793462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75f1811-355f-4900-9364-5763bce7d43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3e7a1f69b94a6080832a014d656576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:15:50Z,use_quota=True,user_id='d793933831b34a3a8632f43b8fa5261a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Creating volume a75f1811-355f-4900-9364-5763bce7d43b {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:15:50 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:15:50 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:50 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b 1073741824
Nov 04 01:15:50 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:51 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b 1073741824" returned: 0 in 0.385s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:51 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b
Nov 04 01:15:51 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:51 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b" returned: 0 in 0.240s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2299a2-1c09-4c65-8263-ee67458063ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a75f1811-355f-4900-9364-5763bce7d43b', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1c6b58-ae7f-4756-ba40-a618e3254ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:15:51 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Volume volume-a75f1811-355f-4900-9364-5763bce7d43b (a75f1811-355f-4900-9364-5763bce7d43b): created successfully
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1c6b58-ae7f-4756-ba40-a618e3254ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Flow 'volume_create_manager' (96c696a5-2251-4819-9420-9950128a2193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:15:51 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8e0c54f6-df9b-4061-a877-7b4ef70d06cf tempest-ProjectMemberTests-1052399897 None] Created volume successfully.
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] Creating offline snapshot 4c21b913-ad00-45e4-97ee-14a9f063d3a0 of volume a75f1811-355f-4900-9364-5763bce7d43b {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:15:51 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:51 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef8bed6-599b-4347-a8c3-b497390cc871]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:51 devstack sudo[107439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b
Nov 04 01:15:51 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:51 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.251s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:15:51 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:15:52 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b" returned: 0 in 0.368s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:52 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0 1G
Nov 04 01:15:52 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:52 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0 1G" returned: 0 in 0.398s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a75f1811-355f-4900-9364-5763bce7d43b -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:52 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a75f1811-355f-4900-9364-5763bce7d43b -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0
Nov 04 01:15:52 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:52 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a75f1811-355f-4900-9364-5763bce7d43b -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0" returned: 0 in 0.297s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:52 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0 is being set with open permissions: ugo+rw
Nov 04 01:15:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:52 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0
Nov 04 01:15:52 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:53 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0" returned: 0 in 0.244s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:53 devstack sudo[107458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.info
Nov 04 01:15:53 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:53 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.info" returned: 0 in 0.247s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:53 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.info is being set with open permissions: ugo+rw
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:53 devstack sudo[107461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.info
Nov 04 01:15:53 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:53 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.info" returned: 0 in 0.238s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:53 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-382bf025-7ea2-4ffc-86fe-7863b7f09fb0 tempest-ProjectMemberTests-1052399897 None] Create snapshot completed successfully
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-4c21b913-ad00-45e4-97ee-14a9f063d3a0-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Lock "cinder-4c21b913-ad00-45e4-97ee-14a9f063d3a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-a75f1811-355f-4900-9364-5763bce7d43b" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-a75f1811-355f-4900-9364-5763bce7d43b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-4c21b913-ad00-45e4-97ee-14a9f063d3a0" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-4c21b913-ad00-45e4-97ee-14a9f063d3a0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Deleting offline snapshot 4c21b913-ad00-45e4-97ee-14a9f063d3a0 of volume a75f1811-355f-4900-9364-5763bce7d43b {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] snapshot_file for this snap is: volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[910d789a-25da-4793-bf06-9761ee5ef168]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:53 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:54 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0
Nov 04 01:15:54 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:54 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0" returned: 0 in 0.345s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:54 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a75f1811-355f-4900-9364-5763bce7d43b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:15:54 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[49829a81-da98-4d0c-86ff-d78144c031c3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:54 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b
Nov 04 01:15:54 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:54 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b" returned: 0 in 0.358s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:54 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:54 devstack sudo[107474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0
Nov 04 01:15:54 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:55 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0" returned: 0 in 0.323s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:55 devstack sudo[107479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0
Nov 04 01:15:55 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:55 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b.4c21b913-ad00-45e4-97ee-14a9f063d3a0" returned: 0 in 0.256s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-4c21b913-ad00-45e4-97ee-14a9f063d3a0" released by "_delete_snapshot" :: held 1.370s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-a75f1811-355f-4900-9364-5763bce7d43b" released by "delete_snapshot" :: held 1.392s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:55 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Created reservations ['ddfbceb2-a14d-404a-b526-12fd790f6913', '1b351f29-828a-4a5d-a9dc-244fbd8d2fcb', 'dfb03943-9e17-41e5-aa66-dfa0122bb479', 'ff8afffe-c03d-44d2-9e16-f85bb1943591'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:55 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Delete snapshot completed successfully.
Nov 04 01:15:55 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-79a87ef6-1d43-4119-addc-a5dfc3f10dee tempest-ProjectMemberTests-1052399897 None] Lock "cinder-4c21b913-ad00-45e4-97ee-14a9f063d3a0-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-a75f1811-355f-4900-9364-5763bce7d43b-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-a75f1811-355f-4900-9364-5763bce7d43b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "cinder-quobyte-a75f1811-355f-4900-9364-5763bce7d43b" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-a75f1811-355f-4900-9364-5763bce7d43b" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d001946f-d540-4b8e-8c06-a3de5470ad61]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:56 devstack sudo[107482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b
Nov 04 01:15:56 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:56 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b" returned: 0 in 0.342s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:56 devstack sudo[107487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b
Nov 04 01:15:56 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:56 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-a75f1811-355f-4900-9364-5763bce7d43b" returned: 0 in 0.256s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-quobyte-a75f1811-355f-4900-9364-5763bce7d43b" released by "delete_volume" :: held 0.660s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Created reservations ['141ff14a-9d80-4b3d-9bc0-00dee4b176c1', '45efc9c8-c1e2-4c38-9001-bbfa89fd45a7', '14c539b0-5662-4204-8d62-03d6bb7579dc', '6aa5acb4-6490-4f5d-9706-d693d5aaa5e8'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:15:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:15:56 devstack sudo[107490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:15:56 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:15:57 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root
Nov 04 01:15:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.246s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:15:57 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:15:57 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Deleted volume successfully.
Nov 04 01:15:57 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-1204f61d-a79c-4e2d-be78-321800ab2442 tempest-ProjectMemberTests-1052399897 None] Lock "cinder-a75f1811-355f-4900-9364-5763bce7d43b-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Flow 'volume_create_manager' (f11502dd-a767-4c9a-919f-d636c6077a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94db2d61-d983-4366-8d76-075d9bc4415f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94db2d61-d983-4366-8d76-075d9bc4415f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423840287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33f8838-be48-4efa-8785-11e9cd161b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13379a5a634fa899f2355a69d551ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:01Z,use_quota=True,user_id='4c867c5265304792a521a53a2cbc469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c60275a-be95-48f9-a645-5d7b3062e9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c60275a-be95-48f9-a645-5d7b3062e9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3a8407-f213-4e62-af78-7a1458d97e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3a8407-f213-4e62-af78-7a1458d97e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f33f8838-be48-4efa-8785-11e9cd161b4d', 'volume_name': 'volume-f33f8838-be48-4efa-8785-11e9cd161b4d', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93868121-1512-40f7-889e-9839031f86a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93868121-1512-40f7-889e-9839031f86a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb56483-9a73-4e92-be71-89878bee614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:00 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Volume f33f8838-be48-4efa-8785-11e9cd161b4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f33f8838-be48-4efa-8785-11e9cd161b4d', 'volume_size': 1}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423840287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33f8838-be48-4efa-8785-11e9cd161b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13379a5a634fa899f2355a69d551ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:01Z,use_quota=True,user_id='4c867c5265304792a521a53a2cbc469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Creating volume f33f8838-be48-4efa-8785-11e9cd161b4d {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:16:00 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:16:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:00 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d 1073741824
Nov 04 01:16:00 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:01 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d 1073741824" returned: 0 in 0.405s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:01 devstack sudo[107500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d
Nov 04 01:16:01 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:01 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d" returned: 0 in 0.233s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb56483-9a73-4e92-be71-89878bee614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f33f8838-be48-4efa-8785-11e9cd161b4d', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e492b03a-5e53-412e-94f4-cd7748c54c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:01 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Volume volume-f33f8838-be48-4efa-8785-11e9cd161b4d (f33f8838-be48-4efa-8785-11e9cd161b4d): created successfully
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e492b03a-5e53-412e-94f4-cd7748c54c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Flow 'volume_create_manager' (f11502dd-a767-4c9a-919f-d636c6077a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:01 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-02d3e22e-6b40-4b15-ba10-1926aebb45d8 tempest-ProjectReaderTests-129355816 None] Created volume successfully.
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] Creating offline snapshot 56f4bdad-2b55-48fa-9ceb-d00df54921f4 of volume f33f8838-be48-4efa-8785-11e9cd161b4d {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e1e11d-2c82-47f5-b13f-06954a5674c9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:01 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:02 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d
Nov 04 01:16:02 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:02 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d" returned: 0 in 0.356s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:02 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4 1G
Nov 04 01:16:02 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:02 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4 1G" returned: 0 in 0.386s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33f8838-be48-4efa-8785-11e9cd161b4d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:02 devstack sudo[107514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33f8838-be48-4efa-8785-11e9cd161b4d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4
Nov 04 01:16:02 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:02 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33f8838-be48-4efa-8785-11e9cd161b4d -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4" returned: 0 in 0.283s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:02 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4 is being set with open permissions: ugo+rw
Nov 04 01:16:02 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:03 devstack sudo[107519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4
Nov 04 01:16:03 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:03 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4" returned: 0 in 0.235s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:03 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.info
Nov 04 01:16:03 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:03 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.info" returned: 0 in 0.236s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:03 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.info is being set with open permissions: ugo+rw
Nov 04 01:16:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:03 devstack sudo[107525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.info
Nov 04 01:16:03 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:03 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.info" returned: 0 in 0.240s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:03 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:03 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-23f197f3-226d-4e4d-a2fa-f5b973ff42ba tempest-ProjectReaderTests-129355816 None] Create snapshot completed successfully
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-56f4bdad-2b55-48fa-9ceb-d00df54921f4-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Lock "cinder-56f4bdad-2b55-48fa-9ceb-d00df54921f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-f33f8838-be48-4efa-8785-11e9cd161b4d" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-f33f8838-be48-4efa-8785-11e9cd161b4d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-56f4bdad-2b55-48fa-9ceb-d00df54921f4" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-56f4bdad-2b55-48fa-9ceb-d00df54921f4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Deleting offline snapshot 56f4bdad-2b55-48fa-9ceb-d00df54921f4 of volume f33f8838-be48-4efa-8785-11e9cd161b4d {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] snapshot_file for this snap is: volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7afb63d-53e5-4405-9435-2df824a92615]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:04 devstack sudo[107530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4
Nov 04 01:16:04 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:04 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4" returned: 0 in 0.360s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f33f8838-be48-4efa-8785-11e9cd161b4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dc8059-32cc-4f5f-95f4-f19a56320336]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:04 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:04 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d
Nov 04 01:16:04 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:05 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d" returned: 0 in 0.372s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:05 devstack sudo[107541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4
Nov 04 01:16:05 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:05 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4" returned: 0 in 0.356s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:05 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4
Nov 04 01:16:05 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:05 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d.56f4bdad-2b55-48fa-9ceb-d00df54921f4" returned: 0 in 0.256s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-56f4bdad-2b55-48fa-9ceb-d00df54921f4" released by "_delete_snapshot" :: held 1.450s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-f33f8838-be48-4efa-8785-11e9cd161b4d" released by "delete_snapshot" :: held 1.470s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:05 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Created reservations ['e1ecfbb1-bb81-483a-a8a6-d80ef4112bb8', '12658bc6-f7f4-4a75-881d-13fe42892737', 'c6d3c493-34e8-4e2d-a03a-f23dff57d5e8', '96d47e61-2553-420f-985b-c4e356b845ed'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:16:05 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Delete snapshot completed successfully.
Nov 04 01:16:05 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f426aa0a-f6ec-4c15-a4f2-ee8ca7e0bb33 tempest-ProjectReaderTests-129355816 None] Lock "cinder-56f4bdad-2b55-48fa-9ceb-d00df54921f4-delete_snapshot" released by "delete_snapshot" :: held 1.591s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-f33f8838-be48-4efa-8785-11e9cd161b4d-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Lock "cinder-f33f8838-be48-4efa-8785-11e9cd161b4d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-f33f8838-be48-4efa-8785-11e9cd161b4d" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-f33f8838-be48-4efa-8785-11e9cd161b4d" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[212a2d31-4198-4dd2-b4f8-69d5478ce1b7]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:06 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d
Nov 04 01:16:06 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:06 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d" returned: 0 in 0.355s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:06 devstack sudo[107554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d
Nov 04 01:16:06 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:07 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-f33f8838-be48-4efa-8785-11e9cd161b4d" returned: 0 in 0.240s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-f33f8838-be48-4efa-8785-11e9cd161b4d" released by "delete_volume" :: held 0.656s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Created reservations ['612b8014-0110-4ea4-b9de-d45c4e7907a8', '4f9b16bb-4311-447c-acbc-b9a6a49db2fd', '62ce05bf-640f-409c-b361-1c72fa92c639', 'dc4dbc7e-8ec6-44e0-94eb-ceaf5cf99a64'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:07 devstack sudo[107557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:16:07 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:07 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.244s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:16:07 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Deleted volume successfully.
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-133c648c-a022-4b64-8022-54c4941ee6b3 tempest-ProjectReaderTests-129355816 None] Lock "cinder-f33f8838-be48-4efa-8785-11e9cd161b4d-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Flow 'volume_create_manager' (74c3f3f6-ece5-4df5-8170-c68799b124d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be9a33f-2953-4eb5-912a-b2c34731d956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be9a33f-2953-4eb5-912a-b2c34731d956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-135009001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0c7036-b589-4666-a2cd-0b70e8421dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13379a5a634fa899f2355a69d551ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:08Z,use_quota=True,user_id='4c867c5265304792a521a53a2cbc469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3094c3f3-b5a8-43fe-86cf-8d075c81f7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3094c3f3-b5a8-43fe-86cf-8d075c81f7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:07 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f07e4c9-0450-4e5c-86f9-cd67b0ff49f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f07e4c9-0450-4e5c-86f9-cd67b0ff49f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b0c7036-b589-4666-a2cd-0b70e8421dfb', 'volume_name': 'volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e248461a-8161-4402-b5bf-ea55657a0df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e248461a-8161-4402-b5bf-ea55657a0df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d6b547-7c03-4a5f-8872-7c24820e15eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:08 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Volume 9b0c7036-b589-4666-a2cd-0b70e8421dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb', 'volume_size': 1}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-135009001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0c7036-b589-4666-a2cd-0b70e8421dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13379a5a634fa899f2355a69d551ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:08Z,use_quota=True,user_id='4c867c5265304792a521a53a2cbc469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Creating volume 9b0c7036-b589-4666-a2cd-0b70e8421dfb {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:16:08 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:08 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb 1073741824
Nov 04 01:16:08 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:08 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb 1073741824" returned: 0 in 0.407s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:08 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb
Nov 04 01:16:08 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:08 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb" returned: 0 in 0.242s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d6b547-7c03-4a5f-8872-7c24820e15eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319477ef-3054-45d6-83b7-48fbecaae3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:08 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Volume volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb (9b0c7036-b589-4666-a2cd-0b70e8421dfb): created successfully
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319477ef-3054-45d6-83b7-48fbecaae3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:08 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Flow 'volume_create_manager' (74c3f3f6-ece5-4df5-8170-c68799b124d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:08 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-1dfb2556-669c-4265-b2c0-6bc46aca3c85 tempest-ProjectReaderTests-129355816 None] Created volume successfully.
Nov 04 01:16:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] Creating offline snapshot 513d1057-5dc1-40f1-9880-23e85c1c3f5b of volume 9b0c7036-b589-4666-a2cd-0b70e8421dfb {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:16:09 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[999625f6-e631-4026-ad63-d7c82a3cd70b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:09 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb
Nov 04 01:16:09 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:09 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb" returned: 0 in 0.356s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:09 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b 1G
Nov 04 01:16:09 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:09 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b 1G" returned: 0 in 0.388s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:09 devstack sudo[107578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b
Nov 04 01:16:09 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:10 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b" returned: 0 in 0.281s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:10 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b is being set with open permissions: ugo+rw
Nov 04 01:16:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:10 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b
Nov 04 01:16:10 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:10 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b" returned: 0 in 0.237s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:10 devstack sudo[107586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.info
Nov 04 01:16:10 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:10 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.info" returned: 0 in 0.241s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:10 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.info is being set with open permissions: ugo+rw
Nov 04 01:16:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:10 devstack sudo[107589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.info
Nov 04 01:16:10 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:10 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.info" returned: 0 in 0.232s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-6da5a6fe-a30b-4d5b-9616-c009ea37aafb tempest-ProjectReaderTests-129355816 None] Create snapshot completed successfully
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-513d1057-5dc1-40f1-9880-23e85c1c3f5b-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Lock "cinder-513d1057-5dc1-40f1-9880-23e85c1c3f5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-9b0c7036-b589-4666-a2cd-0b70e8421dfb" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-9b0c7036-b589-4666-a2cd-0b70e8421dfb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-513d1057-5dc1-40f1-9880-23e85c1c3f5b" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-513d1057-5dc1-40f1-9880-23e85c1c3f5b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Deleting offline snapshot 513d1057-5dc1-40f1-9880-23e85c1c3f5b of volume 9b0c7036-b589-4666-a2cd-0b70e8421dfb {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] snapshot_file for this snap is: volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ebac97-4a8e-482b-baba-e38202a65ddc]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:11 devstack sudo[107593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b
Nov 04 01:16:11 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:11 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b" returned: 0 in 0.342s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4c568f-a697-4ab9-820e-dc68f933c9b5]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:11 devstack sudo[107598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb
Nov 04 01:16:11 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:12 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb" returned: 0 in 0.344s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:12 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b
Nov 04 01:16:12 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:12 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b" returned: 0 in 0.339s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:12 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b
Nov 04 01:16:12 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:12 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:12 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb.513d1057-5dc1-40f1-9880-23e85c1c3f5b" returned: 0 in 0.237s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-513d1057-5dc1-40f1-9880-23e85c1c3f5b" released by "_delete_snapshot" :: held 1.351s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-9b0c7036-b589-4666-a2cd-0b70e8421dfb" released by "delete_snapshot" :: held 1.373s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:12 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Created reservations ['d589a637-06ce-4c18-8bbf-71e712c41c05', 'c1d4dbb5-5389-423a-8a41-6e5d2223b2be', '4af73c46-272b-40db-bdfa-a763d4cfdbf9', '86f9adff-7bf8-4b3d-8994-17d90881a64e'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:16:12 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Delete snapshot completed successfully.
Nov 04 01:16:12 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-4650bd0c-c39c-4574-bf0b-fe2d3a684079 tempest-ProjectReaderTests-129355816 None] Lock "cinder-513d1057-5dc1-40f1-9880-23e85c1c3f5b-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-9b0c7036-b589-4666-a2cd-0b70e8421dfb-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Lock "cinder-9b0c7036-b589-4666-a2cd-0b70e8421dfb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-9b0c7036-b589-4666-a2cd-0b70e8421dfb" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:13 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-9b0c7036-b589-4666-a2cd-0b70e8421dfb" acquired by "delete_volume" :: waited 0.014s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:13 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f96c52-2428-4ef3-b2d4-06391ae2afa3]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:13 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb
Nov 04 01:16:13 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:13 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb" returned: 0 in 0.367s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:13 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:13 devstack sudo[107623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb
Nov 04 01:16:13 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:14 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9b0c7036-b589-4666-a2cd-0b70e8421dfb" returned: 0 in 0.237s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-9b0c7036-b589-4666-a2cd-0b70e8421dfb" released by "delete_volume" :: held 0.660s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Created reservations ['8b29d81d-51af-4cf9-bd89-95554f1a76e4', '3c4e9878-0340-47a9-aa34-fcad0a2b305d', 'ae6c9edf-89cc-4060-873d-f444e00ad1b3', 'e6e5ae78-76c9-43be-b94f-02e4cdba8b9b'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:14 devstack sudo[107626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:16:14 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:14 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.238s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:16:14 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Deleted volume successfully.
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-344a4932-9a10-4605-8f5c-7eb359572312 tempest-ProjectReaderTests-129355816 None] Lock "cinder-9b0c7036-b589-4666-a2cd-0b70e8421dfb-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Flow 'volume_create_manager' (5103d761-20d7-491e-85c1-88a9ca6ba40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:14 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009aedcf-1ef5-4e7a-a985-190531d25972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009aedcf-1ef5-4e7a-a985-190531d25972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1799886088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb68784-9145-4b82-809d-9f4313618338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13379a5a634fa899f2355a69d551ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:15Z,use_quota=True,user_id='4c867c5265304792a521a53a2cbc469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30303e4f-00f1-47f3-86c7-84f242cff97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30303e4f-00f1-47f3-86c7-84f242cff97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc262ea-c196-4166-8d7f-34c4aefbb1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc262ea-c196-4166-8d7f-34c4aefbb1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb68784-9145-4b82-809d-9f4313618338', 'volume_name': 'volume-deb68784-9145-4b82-809d-9f4313618338', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9ba74d-98fc-41a4-a319-afa5a77427d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9ba74d-98fc-41a4-a319-afa5a77427d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad255b26-c47a-4db2-acac-c1a5063b005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:15 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Volume deb68784-9145-4b82-809d-9f4313618338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb68784-9145-4b82-809d-9f4313618338', 'volume_size': 1}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1799886088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb68784-9145-4b82-809d-9f4313618338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13379a5a634fa899f2355a69d551ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:15Z,use_quota=True,user_id='4c867c5265304792a521a53a2cbc469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Creating volume deb68784-9145-4b82-809d-9f4313618338 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:16:15 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:15 devstack sudo[107629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338 1073741824
Nov 04 01:16:15 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:15 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338 1073741824" returned: 0 in 0.391s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:15 devstack sudo[107634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338
Nov 04 01:16:15 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:15 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338" returned: 0 in 0.235s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad255b26-c47a-4db2-acac-c1a5063b005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb68784-9145-4b82-809d-9f4313618338', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912fbd06-708c-49b7-bf12-92961a2bea1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:15 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Volume volume-deb68784-9145-4b82-809d-9f4313618338 (deb68784-9145-4b82-809d-9f4313618338): created successfully
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912fbd06-708c-49b7-bf12-92961a2bea1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:15 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Flow 'volume_create_manager' (5103d761-20d7-491e-85c1-88a9ca6ba40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:15 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-72e30126-bf06-4835-81fc-ad9da11034bf tempest-ProjectReaderTests-129355816 None] Created volume successfully.
Nov 04 01:16:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:16 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] Creating offline snapshot a82588b0-875c-45cc-8557-2e209d70c004 of volume deb68784-9145-4b82-809d-9f4313618338 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:16:16 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1565be2-8007-4cf8-a911-e15f0bfb944c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:16 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338
Nov 04 01:16:16 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:16 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338" returned: 0 in 0.350s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:16 devstack sudo[107642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004 1G
Nov 04 01:16:16 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:16 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004 1G" returned: 0 in 0.375s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:16 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb68784-9145-4b82-809d-9f4313618338 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:16 devstack sudo[107648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb68784-9145-4b82-809d-9f4313618338 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004
Nov 04 01:16:16 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:17 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb68784-9145-4b82-809d-9f4313618338 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004" returned: 0 in 0.303s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:17 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004 is being set with open permissions: ugo+rw
Nov 04 01:16:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:17 devstack sudo[107654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004
Nov 04 01:16:17 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:17 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004" returned: 0 in 0.241s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:17 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.info
Nov 04 01:16:17 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:17 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.info" returned: 0 in 0.258s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:17 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.info is being set with open permissions: ugo+rw
Nov 04 01:16:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:17 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.info
Nov 04 01:16:17 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:17 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.info" returned: 0 in 0.244s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:17 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:18 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8fd2d118-e797-4928-b12e-1c82079a212c tempest-ProjectReaderTests-129355816 None] Create snapshot completed successfully
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-a82588b0-875c-45cc-8557-2e209d70c004-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Lock "cinder-a82588b0-875c-45cc-8557-2e209d70c004-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-deb68784-9145-4b82-809d-9f4313618338" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-deb68784-9145-4b82-809d-9f4313618338" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-a82588b0-875c-45cc-8557-2e209d70c004" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-a82588b0-875c-45cc-8557-2e209d70c004" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Deleting offline snapshot a82588b0-875c-45cc-8557-2e209d70c004 of volume deb68784-9145-4b82-809d-9f4313618338 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] snapshot_file for this snap is: volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbe5721-9667-45e9-88a7-a1d76609df79]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:18 devstack sudo[107699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004
Nov 04 01:16:18 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:18 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004" returned: 0 in 0.363s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deb68784-9145-4b82-809d-9f4313618338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2ee570-f9ef-4489-af28-a5f4bdf22222]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:18 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:18 devstack sudo[107704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338
Nov 04 01:16:18 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:19 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338" returned: 0 in 0.368s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:19 devstack sudo[107709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004
Nov 04 01:16:19 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:19 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004" returned: 0 in 0.339s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:19 devstack sudo[107715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004
Nov 04 01:16:19 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:19 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:19 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338.a82588b0-875c-45cc-8557-2e209d70c004" returned: 0 in 0.246s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-a82588b0-875c-45cc-8557-2e209d70c004" released by "_delete_snapshot" :: held 1.416s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-deb68784-9145-4b82-809d-9f4313618338" released by "delete_snapshot" :: held 1.439s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:19 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Created reservations ['16f9e488-14a7-4830-8799-cc550240c01b', '47f51cc1-b471-4270-a1b3-2b0416a438cf', 'a0fcb07f-448b-4016-bd0a-183c4aabf248', 'd3d66d51-0c12-400e-b268-7a7723cc75dc'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:16:19 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Delete snapshot completed successfully.
Nov 04 01:16:19 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-82112484-2fd3-4788-b26b-e7fd340d37dd tempest-ProjectReaderTests-129355816 None] Lock "cinder-a82588b0-875c-45cc-8557-2e209d70c004-delete_snapshot" released by "delete_snapshot" :: held 1.573s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-deb68784-9145-4b82-809d-9f4313618338-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Lock "cinder-deb68784-9145-4b82-809d-9f4313618338-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-deb68784-9145-4b82-809d-9f4313618338" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:20 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-deb68784-9145-4b82-809d-9f4313618338" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:20 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c27517-8a13-443b-8b4a-a3abdbabdfa0]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:20 devstack sudo[107718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338
Nov 04 01:16:20 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:20 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338" returned: 0 in 0.352s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:20 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:20 devstack sudo[107723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338
Nov 04 01:16:20 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:21 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-deb68784-9145-4b82-809d-9f4313618338" returned: 0 in 0.264s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-deb68784-9145-4b82-809d-9f4313618338" released by "delete_volume" :: held 0.675s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Created reservations ['7dc04655-631c-4d46-b05c-38fe413cf86e', '009b7051-4f07-415c-a8a8-bfe034ae88ae', '0236d249-7676-44a3-8252-4974175f6ba4', '6082a938-31fa-4d1a-b946-d42cac498d7c'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:21 devstack sudo[107727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:16:21 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:21 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.236s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:16:21 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Deleted volume successfully.
Nov 04 01:16:21 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-dd535e6c-1ea5-4044-be2f-37248e865ba4 tempest-ProjectReaderTests-129355816 None] Lock "cinder-deb68784-9145-4b82-809d-9f4313618338-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Flow 'volume_create_manager' (9e9c42e5-11b6-41e2-808a-e06c622809f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dfc105-1833-4e2b-a477-ee6097161c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dfc105-1833-4e2b-a477-ee6097161c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505587754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2c4365-8b84-48e0-8a19-6f11c5074053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13379a5a634fa899f2355a69d551ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:22Z,use_quota=True,user_id='4c867c5265304792a521a53a2cbc469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d6d131-1b25-43c1-bd8c-3d27cd530a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d6d131-1b25-43c1-bd8c-3d27cd530a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104a83d8-a5b8-4a7b-8f70-632add9e7c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104a83d8-a5b8-4a7b-8f70-632add9e7c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c2c4365-8b84-48e0-8a19-6f11c5074053', 'volume_name': 'volume-9c2c4365-8b84-48e0-8a19-6f11c5074053', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b0cf26-0999-479c-85eb-175983418999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b0cf26-0999-479c-85eb-175983418999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf51f9a1-ff89-4725-957a-b49f96e623a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:22 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Volume 9c2c4365-8b84-48e0-8a19-6f11c5074053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c2c4365-8b84-48e0-8a19-6f11c5074053', 'volume_size': 1}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505587754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2c4365-8b84-48e0-8a19-6f11c5074053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13379a5a634fa899f2355a69d551ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:22Z,use_quota=True,user_id='4c867c5265304792a521a53a2cbc469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Creating volume 9c2c4365-8b84-48e0-8a19-6f11c5074053 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:16:22 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:22 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 1073741824
Nov 04 01:16:22 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:22 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 1073741824" returned: 0 in 0.409s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:22 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053
Nov 04 01:16:22 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:22 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053" returned: 0 in 0.269s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf51f9a1-ff89-4725-957a-b49f96e623a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c2c4365-8b84-48e0-8a19-6f11c5074053', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ef64ff-183a-483b-ba8c-eeb8ab0c9ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:22 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Volume volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 (9c2c4365-8b84-48e0-8a19-6f11c5074053): created successfully
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ef64ff-183a-483b-ba8c-eeb8ab0c9ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:22 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Flow 'volume_create_manager' (9e9c42e5-11b6-41e2-808a-e06c622809f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:22 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-21a8ee85-d4d1-46cb-9816-c399b5fbe365 tempest-ProjectReaderTests-129355816 None] Created volume successfully.
Nov 04 01:16:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:23 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] Creating offline snapshot 356c6fc5-9c7a-4403-ad64-95ed4c272f3e of volume 9c2c4365-8b84-48e0-8a19-6f11c5074053 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:16:23 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1eeec4-6a79-46ce-8416-7013f5900a2b]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:23 devstack sudo[107738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053
Nov 04 01:16:23 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:23 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053" returned: 0 in 0.390s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:23 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:23 devstack sudo[107743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e 1G
Nov 04 01:16:23 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:24 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e 1G" returned: 0 in 0.399s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:24 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e
Nov 04 01:16:24 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:24 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e" returned: 0 in 0.307s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:24 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e is being set with open permissions: ugo+rw
Nov 04 01:16:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:24 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e
Nov 04 01:16:24 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:24 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e" returned: 0 in 0.261s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:24 devstack sudo[107756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.info
Nov 04 01:16:24 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:24 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.info" returned: 0 in 0.261s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:24 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.info is being set with open permissions: ugo+rw
Nov 04 01:16:24 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:24 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.info
Nov 04 01:16:24 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:25 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.info" returned: 0 in 0.240s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:25 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7064c810-96b8-4d48-9e79-bf4f1c250125 tempest-ProjectReaderTests-129355816 None] Create snapshot completed successfully
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-356c6fc5-9c7a-4403-ad64-95ed4c272f3e-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Lock "cinder-356c6fc5-9c7a-4403-ad64-95ed4c272f3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-9c2c4365-8b84-48e0-8a19-6f11c5074053" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-9c2c4365-8b84-48e0-8a19-6f11c5074053" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-356c6fc5-9c7a-4403-ad64-95ed4c272f3e" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-356c6fc5-9c7a-4403-ad64-95ed4c272f3e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Deleting offline snapshot 356c6fc5-9c7a-4403-ad64-95ed4c272f3e of volume 9c2c4365-8b84-48e0-8a19-6f11c5074053 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] snapshot_file for this snap is: volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9b7733-565b-4a56-a771-3d006d69acbe]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:25 devstack sudo[107762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e
Nov 04 01:16:25 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:25 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e" returned: 0 in 0.352s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c2c4365-8b84-48e0-8a19-6f11c5074053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7274fae-a59c-4564-8752-cc242521f8c9]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:25 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:25 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053
Nov 04 01:16:25 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:26 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053" returned: 0 in 0.352s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:26 devstack sudo[107773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e
Nov 04 01:16:26 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:26 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e" returned: 0 in 0.341s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:26 devstack sudo[107778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e
Nov 04 01:16:26 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:26 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:26 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053.356c6fc5-9c7a-4403-ad64-95ed4c272f3e" returned: 0 in 0.244s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-356c6fc5-9c7a-4403-ad64-95ed4c272f3e" released by "_delete_snapshot" :: held 1.388s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-9c2c4365-8b84-48e0-8a19-6f11c5074053" released by "delete_snapshot" :: held 1.408s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:26 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Created reservations ['2517f122-8114-4e1f-be2b-84b3de0c4e85', '112337c6-d16c-41c8-8487-fdfae55bd48c', 'b96f0f23-344a-4852-aa05-65a22f7baaec', '296e1806-c5d6-45e8-9278-a47568a71dc9'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:16:26 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Delete snapshot completed successfully.
Nov 04 01:16:26 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a60fdda5-424d-4c58-9992-ece11f7a090e tempest-ProjectReaderTests-129355816 None] Lock "cinder-356c6fc5-9c7a-4403-ad64-95ed4c272f3e-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-9c2c4365-8b84-48e0-8a19-6f11c5074053-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Lock "cinder-9c2c4365-8b84-48e0-8a19-6f11c5074053-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-9c2c4365-8b84-48e0-8a19-6f11c5074053" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:27 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-9c2c4365-8b84-48e0-8a19-6f11c5074053" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:27 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6722d3-f766-41ae-a88f-b14e3bcb0b53]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:27 devstack sudo[107781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053
Nov 04 01:16:27 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:27 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053" returned: 0 in 0.348s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:27 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:27 devstack sudo[107786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053
Nov 04 01:16:27 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:28 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-9c2c4365-8b84-48e0-8a19-6f11c5074053" returned: 0 in 0.235s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-9c2c4365-8b84-48e0-8a19-6f11c5074053" released by "delete_volume" :: held 0.646s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Created reservations ['5fa24f52-adce-4e29-9860-6c4c424e8c94', '8073cd08-fcb8-4db9-b9e2-275b1ad93342', '996fbc4a-4398-4667-a784-de49b8590777', 'acb9e113-f8ef-4950-9a98-3c01f2b906f6'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:28 devstack sudo[107789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:16:28 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:28 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.259s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:16:28 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Deleted volume successfully.
Nov 04 01:16:28 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-f0995029-e900-4355-be95-0060bc253b32 tempest-ProjectReaderTests-129355816 None] Lock "cinder-9c2c4365-8b84-48e0-8a19-6f11c5074053-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Flow 'volume_create_manager' (25e255bf-d9e0-455d-b755-3f0c42e287fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854b6884-f087-4af2-822b-16bfb3552f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854b6884-f087-4af2-822b-16bfb3552f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1047890216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4be855f-eb1f-4111-81f9-d91c4e53d29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13379a5a634fa899f2355a69d551ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:29Z,use_quota=True,user_id='4c867c5265304792a521a53a2cbc469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddc8b78-94a5-497b-93cf-3249192a340b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddc8b78-94a5-497b-93cf-3249192a340b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b650b3e5-ebf2-46e5-b7e0-fb3e42e160e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b650b3e5-ebf2-46e5-b7e0-fb3e42e160e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4be855f-eb1f-4111-81f9-d91c4e53d29c', 'volume_name': 'volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05526fd-3403-4848-ad2c-fd0a0b6016d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05526fd-3403-4848-ad2c-fd0a0b6016d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d193681a-da3e-4bd7-8787-68cf88bfd6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:29 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Volume c4be855f-eb1f-4111-81f9-d91c4e53d29c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c', 'volume_size': 1}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1047890216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4be855f-eb1f-4111-81f9-d91c4e53d29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13379a5a634fa899f2355a69d551ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:29Z,use_quota=True,user_id='4c867c5265304792a521a53a2cbc469d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Creating volume c4be855f-eb1f-4111-81f9-d91c4e53d29c {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:16:29 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:29 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c 1073741824
Nov 04 01:16:29 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:29 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c 1073741824" returned: 0 in 0.406s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:29 devstack sudo[107797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c
Nov 04 01:16:29 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:29 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c" returned: 0 in 0.253s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d193681a-da3e-4bd7-8787-68cf88bfd6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac076c53-75a3-4800-b5b5-ef80a01aa324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:29 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Volume volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c (c4be855f-eb1f-4111-81f9-d91c4e53d29c): created successfully
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac076c53-75a3-4800-b5b5-ef80a01aa324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:29 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Flow 'volume_create_manager' (25e255bf-d9e0-455d-b755-3f0c42e287fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:29 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-0ba6c519-c0b1-46c5-adb4-7f383bce9060 tempest-ProjectReaderTests-129355816 None] Created volume successfully.
Nov 04 01:16:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:30 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] Creating offline snapshot ffbb03b6-cb11-4d62-bb09-dc976d4d7081 of volume c4be855f-eb1f-4111-81f9-d91c4e53d29c {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:16:30 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf95021-79ce-4225-9c71-c5bee3160a34]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:30 devstack sudo[107801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c
Nov 04 01:16:30 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:30 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c" returned: 0 in 0.352s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:30 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:30 devstack sudo[107806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081 1G
Nov 04 01:16:30 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:31 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081 1G" returned: 0 in 0.382s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:31 devstack sudo[107812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081
Nov 04 01:16:31 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:31 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081" returned: 0 in 0.282s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:31 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081 is being set with open permissions: ugo+rw
Nov 04 01:16:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:31 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081
Nov 04 01:16:31 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:31 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081" returned: 0 in 0.237s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:31 devstack sudo[107820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.info
Nov 04 01:16:31 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:31 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.info" returned: 0 in 0.259s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:31 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.info is being set with open permissions: ugo+rw
Nov 04 01:16:31 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:31 devstack sudo[107823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.info
Nov 04 01:16:31 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:32 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.info" returned: 0 in 0.246s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:32 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-02574036-9a9b-4ef1-8236-ef3930892f8e tempest-ProjectReaderTests-129355816 None] Create snapshot completed successfully
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-ffbb03b6-cb11-4d62-bb09-dc976d4d7081-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Lock "cinder-ffbb03b6-cb11-4d62-bb09-dc976d4d7081-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-c4be855f-eb1f-4111-81f9-d91c4e53d29c" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-c4be855f-eb1f-4111-81f9-d91c4e53d29c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-ffbb03b6-cb11-4d62-bb09-dc976d4d7081" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-ffbb03b6-cb11-4d62-bb09-dc976d4d7081" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Deleting offline snapshot ffbb03b6-cb11-4d62-bb09-dc976d4d7081 of volume c4be855f-eb1f-4111-81f9-d91c4e53d29c {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] snapshot_file for this snap is: volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[4980fef0-644e-45f6-9c48-f09953ff8bc2]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:32 devstack sudo[107826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081
Nov 04 01:16:32 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:32 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081" returned: 0 in 0.381s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fc4a42-a2d9-42ed-b2c1-52a05e98920c]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:32 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:33 devstack sudo[107832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c
Nov 04 01:16:33 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:33 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c" returned: 0 in 0.367s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:33 devstack sudo[107837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081
Nov 04 01:16:33 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:33 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081" returned: 0 in 0.336s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:33 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081
Nov 04 01:16:33 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:33 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:33 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c.ffbb03b6-cb11-4d62-bb09-dc976d4d7081" returned: 0 in 0.245s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-ffbb03b6-cb11-4d62-bb09-dc976d4d7081" released by "_delete_snapshot" :: held 1.425s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:33 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-c4be855f-eb1f-4111-81f9-d91c4e53d29c" released by "delete_snapshot" :: held 1.453s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:33 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Created reservations ['23e701fd-9145-4409-922e-fd6460ba6c4d', 'ef7d2034-575f-4085-9471-6d7e0abf1032', '4dc2802c-a9d8-4f1b-97f2-dd41dc441b0c', 'b61ee1e5-2a29-49d2-ab1f-81fed330521b'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:16:34 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Delete snapshot completed successfully.
Nov 04 01:16:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-858329e8-af44-44f7-84f0-0082a4a57b15 tempest-ProjectReaderTests-129355816 None] Lock "cinder-ffbb03b6-cb11-4d62-bb09-dc976d4d7081-delete_snapshot" released by "delete_snapshot" :: held 1.589s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-c4be855f-eb1f-4111-81f9-d91c4e53d29c-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Lock "cinder-c4be855f-eb1f-4111-81f9-d91c4e53d29c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Acquiring lock "cinder-quobyte-c4be855f-eb1f-4111-81f9-d91c4e53d29c" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:34 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-c4be855f-eb1f-4111-81f9-d91c4e53d29c" acquired by "delete_volume" :: waited 0.019s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:34 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1855fb8-89e7-43ae-adce-a7e650e98f33]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:34 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:34 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c
Nov 04 01:16:34 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:35 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c" returned: 0 in 0.360s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:35 devstack sudo[107851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c
Nov 04 01:16:35 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:35 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-c4be855f-eb1f-4111-81f9-d91c4e53d29c" returned: 0 in 0.262s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Lock "cinder-quobyte-c4be855f-eb1f-4111-81f9-d91c4e53d29c" released by "delete_volume" :: held 0.681s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Created reservations ['7062e1b7-b26a-4b9d-861b-fb1ae3446bd4', 'a0a9e895-66b5-4f2b-869e-e27d28cb4b15', 'd2324b0e-6254-47b7-84c3-2b84153af096', '24247e75-a1c8-43d9-aa73-b8888622770b'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:35 devstack sudo[107854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:16:35 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:35 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.263s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:16:35 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Deleted volume successfully.
Nov 04 01:16:35 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-8f3cedff-671f-45c1-a6aa-dd631b9b3ef2 tempest-ProjectReaderTests-129355816 None] Lock "cinder-c4be855f-eb1f-4111-81f9-d91c4e53d29c-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:16:45 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=84,cinder:INSERT=32,cinder:UPDATE=112,cinder:DELETE=10 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:16:45 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:INSERT=32,cinder:UPDATE=120,cinder:SELECT=91,cinder:DELETE=9 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:16:51 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:16:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:51 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:51 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:51 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:16:51 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:52 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:52 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.279s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:52 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:16:52 devstack cinder-volume[86660]: DEBUG oslo_service.periodic_task [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] Running periodic task VolumeManager._thread_info {{(pid=86660) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 01:16:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread count: 28 {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 01:16:52 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-6831a87c-4808-402d-b06e-82d241bbc0af None None] thread info: [<_MainThread(MainThread, started 130521084440704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130520972621568)>, <Thread(Thread-3 (stat_writer), started daemon 130520970772928)>, <Thread(Rabbit-heartbeat, started daemon 130520970069952)>, <Thread(Thread-5 (_runner), started daemon 130520968069568)>, <Thread(Thread-7 (_runner), started daemon 130520968188544)>, <Thread(fd_logger, started daemon 130520967766528)>, <Thread(privsep_reader, started daemon 130520966554432)>, <Thread(tpool_thread_0, started daemon 130520957572800)>, <Thread(tpool_thread_1, started daemon 130520949180096)>, <Thread(tpool_thread_2, started daemon 130520940771008)>, <Thread(tpool_thread_3, started daemon 130520932361920)>, <Thread(tpool_thread_4, started daemon 130520923952832)>, <Thread(tpool_thread_5, started daemon 130520915543744)>, <Thread(tpool_thread_6, started daemon 130520907134656)>, <Thread(tpool_thread_7, started daemon 130520898725568)>, <Thread(tpool_thread_8, started daemon 130520890316480)>, <Thread(tpool_thread_9, started daemon 130520881907392)>, <Thread(tpool_thread_10, started daemon 130520873498304)>, <Thread(tpool_thread_11, started daemon 130520865089216)>, <Thread(tpool_thread_12, started daemon 130520856680128)>, <Thread(tpool_thread_13, started daemon 130520848271040)>, <Thread(tpool_thread_14, started daemon 130520839861952)>, <Thread(tpool_thread_15, started daemon 130520831452864)>, <Thread(tpool_thread_16, started daemon 130520823043776)>, <Thread(tpool_thread_17, started daemon 130520814634688)>, <Thread(tpool_thread_18, started daemon 130520806225600)>, <Thread(tpool_thread_19, started daemon 130520797816512)>] {{(pid=86660) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Flow 'volume_create_manager' (7916393e-5ffd-49ba-955c-530c2dc0d0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06433e26-ad27-4b56-87c6-1568df7d871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06433e26-ad27-4b56-87c6-1568df7d871d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1420988588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b072a19-f339-411f-a2b6-5907804f0867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b16c3e4b4634643930ba9595bd75117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:55Z,use_quota=True,user_id='0ad47705c5c44551b5a08ce57ddfb178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6026d4-ea77-4ff0-bdca-0448e2ba9469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6026d4-ea77-4ff0-bdca-0448e2ba9469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7715032c-c408-4354-9464-54c2e4feeeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7715032c-c408-4354-9464-54c2e4feeeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b072a19-f339-411f-a2b6-5907804f0867', 'volume_name': 'volume-1b072a19-f339-411f-a2b6-5907804f0867', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d034208-458a-403a-a00f-67b5e4dea166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d034208-458a-403a-a00f-67b5e4dea166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1099ee4-6d1e-4010-a779-333d0a3942b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:55 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Volume 1b072a19-f339-411f-a2b6-5907804f0867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b072a19-f339-411f-a2b6-5907804f0867', 'volume_size': 1}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76b548103d70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1420988588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b072a19-f339-411f-a2b6-5907804f0867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b16c3e4b4634643930ba9595bd75117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:55Z,use_quota=True,user_id='0ad47705c5c44551b5a08ce57ddfb178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)}" {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Creating volume 1b072a19-f339-411f-a2b6-5907804f0867 {{(pid=86660) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:16:55 devstack cinder-volume[86660]: INFO cinder.volume.drivers.remotefs [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] casted to osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 1073741824 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:55 devstack sudo[107864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 1073741824
Nov 04 01:16:55 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:55 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 1073741824" returned: 0 in 0.405s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:55 devstack sudo[107869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867
Nov 04 01:16:55 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:55 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867" returned: 0 in 0.250s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'} {{(pid=86660) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 01:16:55 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1099ee4-6d1e-4010-a779-333d0a3942b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b072a19-f339-411f-a2b6-5907804f0867', 'volume_size': 1}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103b0804-d188-457c-bb37-5275e58d4489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:56 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Volume volume-1b072a19-f339-411f-a2b6-5907804f0867 (1b072a19-f339-411f-a2b6-5907804f0867): created successfully
Nov 04 01:16:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103b0804-d188-457c-bb37-5275e58d4489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:56 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Flow 'volume_create_manager' (7916393e-5ffd-49ba-955c-530c2dc0d0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:56 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-87d6887f-cb2e-4e1d-aa2b-8a571b6a2fbd tempest-SnapshotDependencyTests-2038825533 None] Created volume successfully.
Nov 04 01:16:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:56 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] Creating offline snapshot 5ae76805-12e2-45b6-9b41-dda5ccf6c774 of volume 1b072a19-f339-411f-a2b6-5907804f0867 {{(pid=86660) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 01:16:56 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73e1bef-e2c7-405f-8198-67829793c132]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:56 devstack sudo[107872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867
Nov 04 01:16:56 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:56 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867" returned: 0 in 0.349s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:56 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774 1G {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:56 devstack sudo[107877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774 1G
Nov 04 01:16:56 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:57 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774 1G" returned: 0 in 0.386s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b072a19-f339-411f-a2b6-5907804f0867 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:57 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b072a19-f339-411f-a2b6-5907804f0867 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774
Nov 04 01:16:57 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:57 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b072a19-f339-411f-a2b6-5907804f0867 -F qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774" returned: 0 in 0.298s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:57 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774 is being set with open permissions: ugo+rw
Nov 04 01:16:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:57 devstack sudo[107887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774
Nov 04 01:16:57 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:57 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774" returned: 0 in 0.234s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:57 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:57 devstack sudo[107890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.info
Nov 04 01:16:57 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:58 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.info" returned: 0 in 0.244s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:58 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.info is being set with open permissions: ugo+rw
Nov 04 01:16:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.info {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:58 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.info
Nov 04 01:16:58 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:58 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.info" returned: 0 in 0.232s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:58 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:58 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-99e87efd-2d81-46ba-8c53-bc6b8c818103 tempest-SnapshotDependencyTests-2038825533 None] Create snapshot completed successfully
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.flows.manager.create_volume [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86660) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Flow 'volume_create_manager' (45ae49ec-aa64-45da-a02c-4d7ae9e3147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e5920a-cbe0-4ac0-a39f-f1f4eceff859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e5920a-cbe0-4ac0-a39f-f1f4eceff859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T00:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2131ca98-8a15-4916-b8da-6ec22321e49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b16c3e4b4634643930ba9595bd75117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T00:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5ae76805-12e2-45b6-9b41-dda5ccf6c774,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T00:16:59Z,use_quota=True,user_id='0ad47705c5c44551b5a08ce57ddfb178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ba2bc0a-f89c-4b9f-97b4-d26016921ea3),volume_type_id=5ba2bc0a-f89c-4b9f-97b4-d26016921ea3)' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033de10b-0ae0-4064-b5b0-469dec3f0be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033de10b-0ae0-4064-b5b0-469dec3f0be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3609230-1289-43ae-9d94-45f505a55613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3609230-1289-43ae-9d94-45f505a55613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2131ca98-8a15-4916-b8da-6ec22321e49f', 'volume_name': 'volume-2131ca98-8a15-4916-b8da-6ec22321e49f', 'volume_size': 1, 'snapshot_id': '5ae76805-12e2-45b6-9b41-dda5ccf6c774'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf6c5d3-d6df-40bd-99bc-dfcfb55d5610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf6c5d3-d6df-40bd-99bc-dfcfb55d5610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b63d47-2105-4d5c-8b73-65707ed951f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:16:59 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Volume 2131ca98-8a15-4916-b8da-6ec22321e49f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2131ca98-8a15-4916-b8da-6ec22321e49f', 'volume_size': 1, 'snapshot_id': '5ae76805-12e2-45b6-9b41-dda5ccf6c774'}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "cinder-quobyte-5ae76805-12e2-45b6-9b41-dda5ccf6c774-2131ca98-8a15-4916-b8da-6ec22321e49f" by "_create_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-5ae76805-12e2-45b6-9b41-dda5ccf6c774-2131ca98-8a15-4916-b8da-6ec22321e49f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Creating volume 2131ca98-8a15-4916-b8da-6ec22321e49f from snapshot 5ae76805-12e2-45b6-9b41-dda5ccf6c774 {{(pid=86660) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Selected osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157 as target Quobyte volume. {{(pid=86660) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "cinder-quobyte-2131ca98-8a15-4916-b8da-6ec22321e49f" by "_copy_volume_from_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-2131ca98-8a15-4916-b8da-6ec22321e49f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] snapshot: 5ae76805-12e2-45b6-9b41-dda5ccf6c774, volume: 2131ca98-8a15-4916-b8da-6ec22321e49f,  {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f126c34-ceb8-4f44-9628-213ca8e8bdfa]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:59 devstack sudo[107896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774
Nov 04 01:16:59 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:16:59 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774" returned: 0 in 0.341s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b072a19-f339-411f-a2b6-5907804f0867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b13614a-5aa5-40fb-adf1-f27e0cd03720]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:16:59 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:16:59 devstack sudo[107901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867
Nov 04 01:16:59 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:00 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867" returned: 0 in 0.343s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 01:17:00 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Creating direct copy from snapshot {{(pid=86660) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 01:17:00 devstack cinder-volume[86660]: DEBUG cinder.utils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Path /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f not found in is_blk_device check {{(pid=86660) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 01:17:00 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:00 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f
Nov 04 01:17:00 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:05 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f" returned: 0 in 5.752s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:05 devstack cinder-volume[86660]: DEBUG cinder.image.image_utils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f {{(pid=86660) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 01:17:05 devstack cinder-volume[86660]: INFO cinder.image.image_utils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Converted 1024.00 MB image at 177.98 MB/s
Nov 04 01:17:05 devstack cinder-volume[86660]: WARNING cinder.volume.drivers.remotefs [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f is being set with open permissions: ugo+rw
Nov 04 01:17:05 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:05 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f
Nov 04 01:17:05 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:06 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f" returned: 0 in 0.226s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-2131ca98-8a15-4916-b8da-6ec22321e49f" released by "_copy_volume_from_snapshot" :: held 6.740s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-5ae76805-12e2-45b6-9b41-dda5ccf6c774-2131ca98-8a15-4916-b8da-6ec22321e49f" released by "_create_volume_from_snapshot" :: held 6.801s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.821s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b63d47-2105-4d5c-8b73-65707ed951f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2131ca98-8a15-4916-b8da-6ec22321e49f', 'volume_size': 1, 'snapshot_id': '5ae76805-12e2-45b6-9b41-dda5ccf6c774'}' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201913f4-69ca-4d0e-8c1c-03cd6b0f1b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 01:17:06 devstack cinder-volume[86660]: INFO cinder.volume.flows.manager.create_volume [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Volume volume-2131ca98-8a15-4916-b8da-6ec22321e49f (2131ca98-8a15-4916-b8da-6ec22321e49f): created successfully
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201913f4-69ca-4d0e-8c1c-03cd6b0f1b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86660) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Flow 'volume_create_manager' (45ae49ec-aa64-45da-a02c-4d7ae9e3147c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86660) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 01:17:06 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-a602ada2-fdae-44b0-a17d-10c788d3121b tempest-SnapshotDependencyTests-2038825533 None] Created volume successfully.
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "cinder-5ae76805-12e2-45b6-9b41-dda5ccf6c774-delete_snapshot" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-5ae76805-12e2-45b6-9b41-dda5ccf6c774-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "cinder-quobyte-1b072a19-f339-411f-a2b6-5907804f0867" by "delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-1b072a19-f339-411f-a2b6-5907804f0867" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "cinder-quobyte-5ae76805-12e2-45b6-9b41-dda5ccf6c774" by "_delete_snapshot" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-5ae76805-12e2-45b6-9b41-dda5ccf6c774" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Deleting offline snapshot 5ae76805-12e2-45b6-9b41-dda5ccf6c774 of volume 1b072a19-f339-411f-a2b6-5907804f0867 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] snapshot_file for this snap is: volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774 {{(pid=86660) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73dcc0d-6423-47a9-95e1-d7959732c2b6]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:17:06 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:06 devstack sudo[107929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774
Nov 04 01:17:06 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:07 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774" returned: 0 in 0.344s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:07 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.remotefs [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b072a19-f339-411f-a2b6-5907804f0867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86660) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 01:17:07 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[daacf8db-878d-41d1-a3e4-bd0968c39e76]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:17:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:07 devstack sudo[107935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867
Nov 04 01:17:07 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:07 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867" returned: 0 in 0.508s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:07 devstack sudo[107940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774
Nov 04 01:17:07 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:07 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:07 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774" returned: 0 in 0.317s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:08 devstack sudo[107945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774
Nov 04 01:17:08 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:08 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:08 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867.5ae76805-12e2-45b6-9b41-dda5ccf6c774" returned: 0 in 0.237s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-5ae76805-12e2-45b6-9b41-dda5ccf6c774" released by "_delete_snapshot" :: held 1.504s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:17:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-1b072a19-f339-411f-a2b6-5907804f0867" released by "delete_snapshot" :: held 1.524s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:17:08 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Created reservations ['e17c3440-6a57-42e8-88ad-a08c0afdb617', 'a4eae9d2-2c1d-4653-a583-35732c341059', '296af419-e510-4e14-b747-dae2a5ce26cd', '9bf9cc69-d4bd-4514-8d85-1f833abb975f'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:17:08 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Delete snapshot completed successfully.
Nov 04 01:17:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-54dfd3d5-024e-46b7-b78a-5e74b7fa58a8 tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-5ae76805-12e2-45b6-9b41-dda5ccf6c774-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:17:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "cinder-1b072a19-f339-411f-a2b6-5907804f0867-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:17:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-1b072a19-f339-411f-a2b6-5907804f0867-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:17:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "cinder-quobyte-1b072a19-f339-411f-a2b6-5907804f0867" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:17:08 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-1b072a19-f339-411f-a2b6-5907804f0867" acquired by "delete_volume" :: waited 0.017s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f764de-894e-4fa5-bc0b-1cffd4c4ad05]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:09 devstack sudo[107948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867
Nov 04 01:17:09 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:09 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867" returned: 0 in 0.382s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867 {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:09 devstack sudo[107953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867
Nov 04 01:17:09 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:09 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-1b072a19-f339-411f-a2b6-5907804f0867" returned: 0 in 0.251s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-1b072a19-f339-411f-a2b6-5907804f0867" released by "delete_volume" :: held 0.701s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Created reservations ['1abf624b-90b0-4748-b0f8-ed024828f923', '72fc378b-0f11-432c-9d27-28c21ac80e86', 'dfb41617-2028-4186-bd7b-de721c3981e5', '41a86ea7-2091-47ff-8b24-b132e1edf5ff'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:17:09 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:09 devstack sudo[107956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:17:09 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:10 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.245s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:17:10 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Deleted volume successfully.
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-7a493527-b52f-4be3-aa04-dcb4a3ea21ab tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-1b072a19-f339-411f-a2b6-5907804f0867-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "cinder-2131ca98-8a15-4916-b8da-6ec22321e49f-delete_volume" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-2131ca98-8a15-4916-b8da-6ec22321e49f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "cinder-quobyte-2131ca98-8a15-4916-b8da-6ec22321e49f" by "delete_volume" {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-2131ca98-8a15-4916-b8da-6ec22321e49f" acquired by "delete_volume" :: waited 0.016s {{(pid=86660) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeab26e9-4372-4ebd-bb88-5c50ae8e3c55]: (4, 'qcow2') {{(pid=87968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:10 devstack sudo[107959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f
Nov 04 01:17:10 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:10 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f" returned: 0 in 0.354s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:10 devstack sudo[107964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f
Nov 04 01:17:10 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:10 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d/volume-2131ca98-8a15-4916-b8da-6ec22321e49f" returned: 0 in 0.264s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-quobyte-2131ca98-8a15-4916-b8da-6ec22321e49f" released by "delete_volume" :: held 0.661s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG cinder.quota [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Created reservations ['fa3cf59e-c028-45d7-9c34-75e10c141a99', '6b4c5a10-350e-47af-8722-5aa3230c44c6', 'ebdf01a2-47d8-4095-94ea-808cc2316247', '1cd2df63-f801-4e39-a8db-b37ec3106ebe'] {{(pid=86660) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157': None} {{(pid=86660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG cinder.volume.drivers.quobyte [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30b72fcf-8cb0-43f6-b7bd-966497012157'] {{(pid=86660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.lockutils [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86660) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 01:17:10 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 01:17:10 devstack sudo[107967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d
Nov 04 01:17:10 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 01:17:11 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root
Nov 04 01:17:11 devstack cinder-volume[86660]: DEBUG oslo_concurrency.processutils [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f2294b184774313e1b408e68a89af6d" returned: 0 in 0.261s {{(pid=86660) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 01:17:11 devstack cinder-volume[86660]: DEBUG cinder.manager [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Notifying Schedulers of capabilities ... {{(pid=86660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 01:17:11 devstack cinder-volume[86660]: INFO cinder.volume.manager [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Deleted volume successfully.
Nov 04 01:17:11 devstack cinder-volume[86660]: DEBUG cinder.coordination [None req-546f47bc-31b3-405f-a5b9-da7251e5d9b6 tempest-SnapshotDependencyTests-2038825533 None] Lock "cinder-2131ca98-8a15-4916-b8da-6ec22321e49f-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86660) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 01:17:20 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:SELECT=21,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 01:17:21 devstack cinder-volume[86660]: DEBUG dbcounter [-] [86660] Writing DB stats cinder:UPDATE=26,cinder:SELECT=28,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86660) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}